2024-04-26T20:09:10.386 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T20:09:10.386 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/norstats}} --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158 --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158/orig.config.yaml 2024-04-26T20:09:10.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T20:09:10.538 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158 branch: wip-rishabh-testing-20240426.111959 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/norstats}} email: null first_in_suite: false job_id: '7675158' kernel: client: sha1: distro flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync rbytes: false syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAsGxku3GU/mxZXK558+VDsyecqz+vv+WcbI3uLWLyoLV4Vp/JUNqvg9r3mm76zHC4ZrAmPDlX2VXWm1Kk37apk= smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIGQ4R2t4LNhrk/1odrEgI7ulqJk1n2TakQSRHu8W00urKXzV+yVxLdutseUVBv7T1PDfZUZWWB6Bjn+GaY4reU= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9KRnA1tntn1iUre8c781pzDkJv8kfaTwtQN5TzAsL5Tgghyu/hqLSA4mG+s0+3AqdnIybj8mSj0pg3PWtcA+k= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T20:09:10.538 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T20:09:10.539 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T20:09:10.539 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T20:09:10.540 INFO:teuthology.task.internal:Checking packages... 2024-04-26T20:09:10.563 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T20:09:10.563 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T20:09:10.563 INFO:teuthology.packaging:ref: None 2024-04-26T20:09:10.563 INFO:teuthology.packaging:tag: None 2024-04-26T20:09:10.564 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T20:09:10.564 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:09:10.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T20:09:10.800 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306.gbc612ffb 2024-04-26T20:09:10.802 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T20:09:10.805 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T20:09:10.805 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T20:09:10.814 INFO:teuthology.task.internal:Saving configuration 2024-04-26T20:09:10.834 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T20:09:10.839 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T20:09:10.864 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:04:02.419577', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAsGxku3GU/mxZXK558+VDsyecqz+vv+WcbI3uLWLyoLV4Vp/JUNqvg9r3mm76zHC4ZrAmPDlX2VXWm1Kk37apk='} 2024-04-26T20:09:10.887 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:04:02.422900', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIGQ4R2t4LNhrk/1odrEgI7ulqJk1n2TakQSRHu8W00urKXzV+yVxLdutseUVBv7T1PDfZUZWWB6Bjn+GaY4reU='} 2024-04-26T20:09:10.906 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:04:02.421556', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9KRnA1tntn1iUre8c781pzDkJv8kfaTwtQN5TzAsL5Tgghyu/hqLSA4mG+s0+3AqdnIybj8mSj0pg3PWtcA+k='} 2024-04-26T20:09:10.907 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T20:09:10.912 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-26T20:09:10.912 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-26T20:09:10.912 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-26T20:09:10.912 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T20:09:11.057 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd384938160>, signals=[15]) 2024-04-26T20:09:11.057 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T20:09:11.062 INFO:teuthology.task.internal:Opening connections... 2024-04-26T20:09:11.062 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T20:09:11.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:09:11.140 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T20:09:11.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:09:11.216 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-04-26T20:09:11.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:09:11.293 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T20:09:11.298 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-04-26T20:09:11.316 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-04-26T20:09:11.316 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-04-26T20:09:11.372 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T20:09:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T20:09:11.374 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-04-26T20:09:11.398 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-04-26T20:09:11.415 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-04-26T20:09:11.415 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-04-26T20:09:11.471 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-04-26T20:09:11.471 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-04-26T20:09:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-04-26T20:09:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-04-26T20:09:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-04-26T20:09:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-04-26T20:09:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T20:09:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-04-26T20:09:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-04-26T20:09:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T20:09:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-04-26T20:09:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T20:09:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T20:09:11.473 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T20:09:11.473 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-04-26T20:09:11.498 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-04-26T20:09:11.516 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-04-26T20:09:11.517 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-04-26T20:09:11.574 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-04-26T20:09:11.574 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-04-26T20:09:11.574 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-04-26T20:09:11.575 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-04-26T20:09:11.575 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-04-26T20:09:11.575 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-04-26T20:09:11.575 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T20:09:11.575 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-04-26T20:09:11.575 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-04-26T20:09:11.575 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T20:09:11.575 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-04-26T20:09:11.575 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T20:09:11.575 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T20:09:11.575 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T20:09:11.575 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-04-26T20:09:11.597 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T20:09:11.607 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T20:09:11.613 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T20:09:11.613 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-04-26T20:09:11.615 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-04-26T20:09:11.618 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-04-26T20:09:11.633 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T20:09:11.638 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T20:09:11.638 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-04-26T20:09:11.672 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-04-26T20:09:11.674 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-04-26T20:09:11.712 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T20:09:11.787 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T20:09:11.801 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T20:09:11.801 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-26T20:09:11.801 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-26T20:09:11.802 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:09:11.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:09:11.818 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-04-26T20:09:11.875 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-437.el9.x86_64 2024-04-26T20:09:11.875 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.14.0-437.el9.x86_64 2024-04-26T20:09:11.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum install -y kernel 2024-04-26T20:09:17.170 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.0 MB 00:03 2024-04-26T20:09:21.876 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 5.2 MB/s | 19 MB 00:03 2024-04-26T20:09:27.543 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.2 MB 00:02 2024-04-26T20:09:29.151 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 16 kB 00:00 2024-04-26T20:09:31.496 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 21 MB 00:02 2024-04-26T20:09:36.585 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-26T20:09:38.458 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T20:09:38.495 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T20:09:38.547 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-04-26T20:09:38.559 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-04-26T20:09:38.569 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-04-26T20:09:38.658 DEBUG:teuthology.orchestra.run.smithi070:> echo no | sudo yum reinstall kernel || true 2024-04-26T20:09:39.170 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 08:09:36 PM UTC. 2024-04-26T20:09:39.289 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-04-26T20:09:39.304 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T20:09:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-04-26T20:09:39.319 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T20:09:39.331 INFO:teuthology.orchestra.run.smithi070.stdout:Reinstalling: 2024-04-26T20:09:39.372 INFO:teuthology.orchestra.run.smithi070.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T20:09:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:09:39.464 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-04-26T20:09:39.480 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T20:09:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:09:39.506 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 255 k 2024-04-26T20:09:39.521 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 0 2024-04-26T20:09:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:Operation aborted. 2024-04-26T20:09:39.627 INFO:teuthology.orchestra.run.smithi070.stdout:Is this ok [y/N]: 2024-04-26T20:09:39.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum reinstall -y kernel || true 2024-04-26T20:09:40.136 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:04 ago on Fri 26 Apr 2024 08:09:36 PM UTC. 2024-04-26T20:09:40.250 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-04-26T20:09:40.269 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T20:09:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-04-26T20:09:40.410 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T20:09:40.421 INFO:teuthology.orchestra.run.smithi070.stdout:Reinstalling: 2024-04-26T20:09:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T20:09:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:09:40.459 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-04-26T20:09:40.468 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T20:09:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:09:40.486 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 255 k 2024-04-26T20:09:40.496 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 0 2024-04-26T20:09:40.521 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-04-26T20:09:40.720 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-437.el9.x86_64.rpm 630 kB/s | 255 kB 00:00 2024-04-26T20:09:40.741 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:09:40.753 INFO:teuthology.orchestra.run.smithi070.stdout:Total 545 kB/s | 255 kB 00:00 2024-04-26T20:09:40.765 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-04-26T20:09:40.932 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-04-26T20:09:40.950 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-04-26T20:09:40.963 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-04-26T20:09:40.972 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-04-26T20:09:41.086 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-04-26T20:09:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T20:09:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T20:09:41.787 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T20:09:41.817 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T20:09:42.471 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T20:09:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:09:42.498 INFO:teuthology.orchestra.run.smithi070.stdout:Reinstalled: 2024-04-26T20:09:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T20:09:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:09:42.589 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-04-26T20:09:42.658 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T20:09:42.710 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T20:09:42.721 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T20:09:42.730 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T20:09:42.738 DEBUG:teuthology.parallel:result is None 2024-04-26T20:09:42.746 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T20:09:42.764 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T20:09:42.825 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:09:42.836 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:09:42.847 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:09:42.891 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T20:09:42.913 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T20:09:42.928 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T20:09:42.937 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:09:42.947 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:09:42.958 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:09:43.075 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T20:09:43.156 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T20:09:43.166 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:09:43.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:09:43.199 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:09:43.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:09:43.266 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:09:43.278 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:09:43.292 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:09:43.306 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:09:43.324 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:09:43.341 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:09:43.366 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:09:43.392 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:09:43.404 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:09:43.452 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T20:09:43.466 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T20:09:43.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:09:43.535 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:09:43.545 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:09:43.618 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T20:09:43.650 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T20:09:43.657 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:09:43.686 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:09:43.789 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:09:43.816 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:09:43.900 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:09:43.948 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:09:44.029 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:09:44.069 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:09:44.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:09:44.135 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:09:44.195 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:09:44.252 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:09:44.335 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:09:44.376 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T20:09:44.403 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:09:44.442 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:09:44.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:09:44.557 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:09:44.640 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:09:44.684 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T20:09:44.692 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:09:44.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-04-26T20:09:44.764 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-04-26T20:09:44.825 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:09:44.837 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-04-26T20:09:44.871 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:09:44.885 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:09:45.321 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T20:09:45.396 INFO:teuthology.task.internal:Starting timer... 2024-04-26T20:09:45.402 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T20:09:45.444 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T20:09:45.503 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-26T20:09:45.512 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-04-26T20:09:45.601 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-04-26T20:09:45.668 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2024-04-26T20:09:45.764 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2024-04-26T20:09:45.825 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-04-26T20:09:45.923 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-04-26T20:09:45.954 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T20:09:45.965 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-04-26T20:09:45.999 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-04-26T20:09:46.010 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2024-04-26T20:09:46.057 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2024-04-26T20:09:46.095 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-04-26T20:09:46.128 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-04-26T20:09:46.162 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi080.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive'} 2024-04-26T20:09:46.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:09:46.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:09:46.239 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:09:46.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:09:46.282 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:09:46.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:09:46.324 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T20:09:46.338 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-04-26T20:09:46.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2024-04-26T20:09:46.438 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-04-26T20:09:46.487 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T20:09:46.562 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T20:09:46.578 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T20:09:46.765 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T20:09:46.798 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T20:09:46.851 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi080.front.sepia.ceph.com,smithi098.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T20:13:43.108 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com')] 2024-04-26T20:13:43.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-26T20:13:43.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:13:43.212 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-04-26T20:13:43.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-26T20:13:43.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-26T20:13:43.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:13:43.371 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-04-26T20:13:43.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-26T20:13:43.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-26T20:13:43.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:13:43.521 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-04-26T20:13:43.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-26T20:13:43.598 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T20:13:43.609 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T20:13:43.609 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:13:43.610 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:13:43.612 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:13:43.612 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:13:43.614 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:13:43.614 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:13:43.638 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T20:13:43.642 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T20:13:43.652 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T20:13:43.656 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T20:13:43.666 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T20:13:43.674 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-04-26T20:13:43.679 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2024-04-26T20:13:43.679 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T20:13:43.684 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-04-26T20:13:43.689 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2024-04-26T20:13:43.697 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T20:13:43.702 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-04-26T20:13:43.702 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T20:13:43.710 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T20:13:43.713 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-04-26T20:13:43.715 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T20:13:43.726 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T20:13:43.739 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T20:13:43.768 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:13:43.770 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:13:43.771 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:13:43.771 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-04-26T20:13:43.771 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.771 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.771 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.771 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.773 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:13:43.773 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-26T20:13:43.774 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.774 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.774 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.774 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.791 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:13:43.794 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:13:43.794 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-04-26T20:13:43.794 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.794 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.794 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.794 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:13:43.795 INFO:teuthology.run_tasks:Running task install... 2024-04-26T20:13:43.803 DEBUG:teuthology.task.install:project ceph 2024-04-26T20:13:43.803 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T20:13:43.803 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T20:13:43.804 INFO:teuthology.task.install:Using flavor: default 2024-04-26T20:13:43.809 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T20:13:43.809 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T20:13:43.810 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T20:13:43.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:13:43.812 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T20:13:43.812 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:13:43.813 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T20:13:43.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:13:43.959 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T20:13:43.959 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T20:13:44.085 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T20:13:44.085 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:13:44.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T20:13:44.110 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T20:13:44.110 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T20:13:44.111 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T20:13:44.111 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T20:13:44.115 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T20:13:44.115 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T20:13:44.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T20:13:44.228 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T20:13:44.228 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T20:13:44.228 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T20:13:44.246 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T20:13:44.253 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T20:13:44.253 DEBUG:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T20:13:44.309 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T20:13:44.309 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T20:13:44.309 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T20:13:44.311 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-04-26T20:13:44.311 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-04-26T20:13:44.317 DEBUG:teuthology.orchestra.run.smithi080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T20:13:44.337 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T20:13:44.337 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T20:13:44.391 DEBUG:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T20:13:44.403 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T20:13:44.453 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2024-04-26T20:13:44.455 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum clean all 2024-04-26T20:13:44.477 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T20:13:44.535 INFO:teuthology.orchestra.run.smithi070.stdout:48 files removed 2024-04-26T20:13:44.539 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-04-26T20:13:44.541 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-04-26T20:13:44.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T20:13:44.679 INFO:teuthology.orchestra.run.smithi080.stdout:48 files removed 2024-04-26T20:13:44.706 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T20:13:44.764 INFO:teuthology.orchestra.run.smithi098.stdout:48 files removed 2024-04-26T20:13:44.791 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T20:13:45.298 INFO:teuthology.orchestra.run.smithi080.stdout:ceph packages for x86_64 251 kB/s | 84 kB 00:00 2024-04-26T20:13:45.344 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 160 kB/s | 84 kB 00:00 2024-04-26T20:13:45.487 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 191 kB/s | 84 kB 00:00 2024-04-26T20:13:45.632 INFO:teuthology.orchestra.run.smithi080.stdout:ceph noarch packages 40 kB/s | 12 kB 00:00 2024-04-26T20:13:45.878 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-04-26T20:13:45.921 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-04-26T20:13:46.207 INFO:teuthology.orchestra.run.smithi080.stdout:ceph source packages 3.5 kB/s | 1.9 kB 00:00 2024-04-26T20:13:46.329 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-04-26T20:13:46.405 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2024-04-26T20:13:47.432 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.0 MB 00:01 2024-04-26T20:13:47.588 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 8.0 MB 00:01 2024-04-26T20:13:48.145 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.0 MB 00:01 2024-04-26T20:13:50.221 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-26T20:13:50.458 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 19 MB 00:01 2024-04-26T20:13:51.756 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-04-26T20:13:54.807 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.2 MB 00:01 2024-04-26T20:13:56.289 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 16 kB 00:00 2024-04-26T20:13:56.665 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.2 MB 00:01 2024-04-26T20:13:57.490 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-26T20:13:58.108 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 16 kB 00:00 2024-04-26T20:13:59.243 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-04-26T20:14:02.066 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 785 kB/s | 6.2 MB 00:08 2024-04-26T20:14:02.573 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-04-26T20:14:04.234 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-04-26T20:14:04.349 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-26T20:14:04.724 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:14:04.725 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:14:04.735 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T20:14:04.736 INFO:teuthology.orchestra.run.smithi070.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T20:14:04.737 INFO:teuthology.orchestra.run.smithi070.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T20:14:04.738 INFO:teuthology.orchestra.run.smithi070.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T20:14:04.739 INFO:teuthology.orchestra.run.smithi070.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T20:14:04.741 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T20:14:04.742 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T20:14:04.803 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-04-26T20:14:04.812 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-04-26T20:14:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-04-26T20:14:04.812 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-04-26T20:14:04.812 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-04-26T20:14:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T20:14:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T20:14:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:14:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T20:14:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T20:14:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T20:14:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T20:14:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T20:14:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T20:14:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T20:14:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T20:14:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T20:14:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T20:14:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T20:14:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T20:14:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:14:04.815 INFO:teuthology.orchestra.run.smithi070.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T20:14:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T20:14:04.817 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T20:14:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T20:14:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T20:14:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T20:14:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T20:14:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T20:14:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T20:14:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T20:14:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T20:14:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T20:14:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T20:14:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T20:14:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T20:14:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T20:14:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T20:14:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout:Installing weak dependencies: 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-04-26T20:14:04.824 INFO:teuthology.orchestra.run.smithi070.stdout:Install 148 Packages 2024-04-26T20:14:04.825 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 4 Packages 2024-04-26T20:14:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:14:04.825 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 222 M 2024-04-26T20:14:04.825 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-04-26T20:14:05.399 INFO:teuthology.orchestra.run.smithi070.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 43 kB/s | 6.6 kB 00:00 2024-04-26T20:14:05.641 INFO:teuthology.orchestra.run.smithi070.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 3.6 MB/s | 889 kB 00:00 2024-04-26T20:14:05.716 INFO:teuthology.orchestra.run.smithi070.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 1.9 MB/s | 145 kB 00:00 2024-04-26T20:14:05.744 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-26T20:14:06.041 INFO:teuthology.orchestra.run.smithi070.stdout:(4/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 7.3 MB/s | 2.4 MB 00:00 2024-04-26T20:14:06.300 INFO:teuthology.orchestra.run.smithi070.stdout:(5/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 5.9 MB/s | 1.5 MB 00:00 2024-04-26T20:14:06.368 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:14:06.369 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:14:06.379 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T20:14:06.380 INFO:teuthology.orchestra.run.smithi098.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T20:14:06.381 INFO:teuthology.orchestra.run.smithi098.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T20:14:06.382 INFO:teuthology.orchestra.run.smithi098.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T20:14:06.383 INFO:teuthology.orchestra.run.smithi098.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T20:14:06.386 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T20:14:06.386 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T20:14:06.446 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-04-26T20:14:06.458 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-04-26T20:14:06.458 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T20:14:06.459 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T20:14:06.460 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T20:14:06.461 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T20:14:06.462 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T20:14:06.463 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T20:14:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T20:14:06.465 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T20:14:06.466 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T20:14:06.467 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T20:14:06.468 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T20:14:06.469 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T20:14:06.470 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T20:14:06.471 INFO:teuthology.orchestra.run.smithi098.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T20:14:06.471 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T20:14:06.471 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T20:14:06.471 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-04-26T20:14:06.471 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T20:14:06.471 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:14:06.471 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-04-26T20:14:06.471 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-04-26T20:14:06.471 INFO:teuthology.orchestra.run.smithi098.stdout:Install 148 Packages 2024-04-26T20:14:06.471 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 4 Packages 2024-04-26T20:14:06.471 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:14:06.472 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 222 M 2024-04-26T20:14:06.472 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-04-26T20:14:06.658 INFO:teuthology.orchestra.run.smithi070.stdout:(6/152): ceph-common-19.0.0-3306.gbc612ffb.el9. 15 MB/s | 21 MB 00:01 2024-04-26T20:14:06.842 INFO:teuthology.orchestra.run.smithi070.stdout:(7/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 8.7 MB/s | 4.7 MB 00:00 2024-04-26T20:14:07.244 INFO:teuthology.orchestra.run.smithi098.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-04-26T20:14:07.759 INFO:teuthology.orchestra.run.smithi070.stdout:(8/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x86 15 MB/s | 17 MB 00:01 2024-04-26T20:14:07.826 INFO:teuthology.orchestra.run.smithi070.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 378 kB/s | 25 kB 00:00 2024-04-26T20:14:07.978 INFO:teuthology.orchestra.run.smithi098.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.2 MB/s | 889 kB 00:00 2024-04-26T20:14:08.017 INFO:teuthology.orchestra.run.smithi070.stdout:(10/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el 9.0 MB/s | 11 MB 00:01 2024-04-26T20:14:08.076 INFO:teuthology.orchestra.run.smithi070.stdout:(11/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 3.8 MB/s | 225 kB 00:00 2024-04-26T20:14:08.118 INFO:teuthology.orchestra.run.smithi070.stdout:(12/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 650 kB/s | 27 kB 00:00 2024-04-26T20:14:08.160 INFO:teuthology.orchestra.run.smithi070.stdout:(13/152): libcephfs-devel-19.0.0-3306.gbc612ffb 763 kB/s | 32 kB 00:00 2024-04-26T20:14:08.178 INFO:teuthology.orchestra.run.smithi098.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 725 kB/s | 145 kB 00:00 2024-04-26T20:14:08.252 INFO:teuthology.orchestra.run.smithi070.stdout:(14/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 8.0 MB/s | 747 kB 00:00 2024-04-26T20:14:08.253 INFO:teuthology.orchestra.run.smithi098.stdout:(4/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 4.0 MB/s | 5.4 MB 00:01 2024-04-26T20:14:08.302 INFO:teuthology.orchestra.run.smithi070.stdout:(15/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 3.2 MB/s | 163 kB 00:00 2024-04-26T20:14:08.361 INFO:teuthology.orchestra.run.smithi070.stdout:(16/152): librados-devel-19.0.0-3306.gbc612ffb. 2.1 MB/s | 127 kB 00:00 2024-04-26T20:14:08.429 INFO:teuthology.orchestra.run.smithi098.stdout:(5/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-04-26T20:14:08.445 INFO:teuthology.orchestra.run.smithi070.stdout:(17/152): libradosstriper1-19.0.0-3306.gbc612ff 5.9 MB/s | 501 kB 00:00 2024-04-26T20:14:09.128 INFO:teuthology.orchestra.run.smithi070.stdout:(18/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 7.9 MB/s | 5.4 MB 00:00 2024-04-26T20:14:09.195 INFO:teuthology.orchestra.run.smithi070.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 681 kB/s | 45 kB 00:00 2024-04-26T20:14:09.212 INFO:teuthology.orchestra.run.smithi098.stdout:(6/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 6.0 MB/s | 4.7 MB 00:00 2024-04-26T20:14:09.279 INFO:teuthology.orchestra.run.smithi070.stdout:(20/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x 1.3 MB/s | 5.4 MB 00:04 2024-04-26T20:14:09.304 INFO:teuthology.orchestra.run.smithi070.stdout:(21/152): python3-ceph-common-19.0.0-3306.gbc61 1.2 MB/s | 135 kB 00:00 2024-04-26T20:14:09.404 INFO:teuthology.orchestra.run.smithi070.stdout:(22/152): python3-rados-19.0.0-3306.gbc612ffb.e 3.1 MB/s | 321 kB 00:00 2024-04-26T20:14:09.471 INFO:teuthology.orchestra.run.smithi070.stdout:(23/152): python3-cephfs-19.0.0-3306.gbc612ffb. 841 kB/s | 161 kB 00:00 2024-04-26T20:14:09.504 INFO:teuthology.orchestra.run.smithi070.stdout:(24/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 2.9 MB/s | 298 kB 00:00 2024-04-26T20:14:09.580 INFO:teuthology.orchestra.run.smithi070.stdout:(25/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 916 kB/s | 99 kB 00:00 2024-04-26T20:14:09.605 INFO:teuthology.orchestra.run.smithi070.stdout:(26/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 852 kB/s | 85 kB 00:00 2024-04-26T20:14:09.714 INFO:teuthology.orchestra.run.smithi070.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 1.5 MB/s | 171 kB 00:00 2024-04-26T20:14:09.806 INFO:teuthology.orchestra.run.smithi070.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3306.g 373 kB/s | 34 kB 00:00 2024-04-26T20:14:09.864 INFO:teuthology.orchestra.run.smithi070.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 2.4 MB/s | 142 kB 00:00 2024-04-26T20:14:09.996 INFO:teuthology.orchestra.run.smithi098.stdout:(7/152): ceph-common-19.0.0-3306.gbc612ffb.el9. 6.9 MB/s | 21 MB 00:03 2024-04-26T20:14:10.046 INFO:teuthology.orchestra.run.smithi098.stdout:(8/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 1.3 MB/s | 2.4 MB 00:01 2024-04-26T20:14:10.154 INFO:teuthology.orchestra.run.smithi098.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 233 kB/s | 25 kB 00:00 2024-04-26T20:14:10.306 INFO:teuthology.orchestra.run.smithi070.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 8.0 MB/s | 3.5 MB 00:00 2024-04-26T20:14:10.811 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-26T20:14:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:(31/152): ceph-mgr-diskprediction-local-19.0.0- 6.3 MB/s | 7.4 MB 00:01 2024-04-26T20:14:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3306.gbc 3.7 MB/s | 249 kB 00:00 2024-04-26T20:14:11.591 INFO:teuthology.orchestra.run.smithi070.stdout:(33/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 1.2 MB/s | 49 kB 00:00 2024-04-26T20:14:11.633 INFO:teuthology.orchestra.run.smithi070.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3306.gb 396 kB/s | 16 kB 00:00 2024-04-26T20:14:11.700 INFO:teuthology.orchestra.run.smithi070.stdout:(35/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 4.0 MB/s | 273 kB 00:00 2024-04-26T20:14:11.738 INFO:teuthology.orchestra.run.smithi098.stdout:(10/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x8 6.7 MB/s | 17 MB 00:02 2024-04-26T20:14:11.817 INFO:teuthology.orchestra.run.smithi070.stdout:(36/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 6.4 MB/s | 762 kB 00:00 2024-04-26T20:14:11.855 INFO:teuthology.orchestra.run.smithi098.stdout:(11/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el 5.7 MB/s | 11 MB 00:01 2024-04-26T20:14:11.867 INFO:teuthology.orchestra.run.smithi070.stdout:(37/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 1.4 MB/s | 3.1 MB 00:02 2024-04-26T20:14:11.880 INFO:teuthology.orchestra.run.smithi098.stdout:(12/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 1.6 MB/s | 225 kB 00:00 2024-04-26T20:14:11.892 INFO:teuthology.orchestra.run.smithi070.stdout:(38/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 243 kB/s | 18 kB 00:00 2024-04-26T20:14:11.905 INFO:teuthology.orchestra.run.smithi098.stdout:(13/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 541 kB/s | 27 kB 00:00 2024-04-26T20:14:11.931 INFO:teuthology.orchestra.run.smithi098.stdout:(14/152): libcephfs-devel-19.0.0-3306.gbc612ffb 630 kB/s | 32 kB 00:00 2024-04-26T20:14:11.989 INFO:teuthology.orchestra.run.smithi098.stdout:(15/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 2.7 MB/s | 163 kB 00:00 2024-04-26T20:14:12.015 INFO:teuthology.orchestra.run.smithi098.stdout:(16/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 6.7 MB/s | 747 kB 00:00 2024-04-26T20:14:12.040 INFO:teuthology.orchestra.run.smithi098.stdout:(17/152): librados-devel-19.0.0-3306.gbc612ffb. 2.5 MB/s | 127 kB 00:00 2024-04-26T20:14:12.042 INFO:teuthology.orchestra.run.smithi070.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 459 kB/s | 80 kB 00:00 2024-04-26T20:14:12.090 INFO:teuthology.orchestra.run.smithi098.stdout:(18/152): libradosstriper1-19.0.0-3306.gbc612ff 6.5 MB/s | 501 kB 00:00 2024-04-26T20:14:12.149 INFO:teuthology.orchestra.run.smithi098.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 774 kB/s | 45 kB 00:00 2024-04-26T20:14:12.151 INFO:teuthology.orchestra.run.smithi070.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-04-26T20:14:12.193 INFO:teuthology.orchestra.run.smithi070.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-04-26T20:14:12.199 INFO:teuthology.orchestra.run.smithi098.stdout:(20/152): python3-ceph-common-19.0.0-3306.gbc61 2.6 MB/s | 135 kB 00:00 2024-04-26T20:14:12.243 INFO:teuthology.orchestra.run.smithi070.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-26T20:14:12.266 INFO:teuthology.orchestra.run.smithi098.stdout:(21/152): python3-cephfs-19.0.0-3306.gbc612ffb. 2.4 MB/s | 161 kB 00:00 2024-04-26T20:14:12.302 INFO:teuthology.orchestra.run.smithi070.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-26T20:14:12.341 INFO:teuthology.orchestra.run.smithi098.stdout:(22/152): python3-rados-19.0.0-3306.gbc612ffb.e 4.2 MB/s | 321 kB 00:00 2024-04-26T20:14:12.360 INFO:teuthology.orchestra.run.smithi070.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-26T20:14:12.411 INFO:teuthology.orchestra.run.smithi070.stdout:(45/152): python3-cryptography-36.0.1-4.el9.x86 5.6 MB/s | 1.2 MB 00:00 2024-04-26T20:14:12.416 INFO:teuthology.orchestra.run.smithi098.stdout:(23/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 3.9 MB/s | 298 kB 00:00 2024-04-26T20:14:12.436 INFO:teuthology.orchestra.run.smithi070.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-26T20:14:12.470 INFO:teuthology.orchestra.run.smithi070.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-04-26T20:14:12.483 INFO:teuthology.orchestra.run.smithi098.stdout:(24/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.5 MB/s | 99 kB 00:00 2024-04-26T20:14:12.576 INFO:teuthology.orchestra.run.smithi098.stdout:(25/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 10 MB/s | 5.4 MB 00:00 2024-04-26T20:14:12.617 INFO:teuthology.orchestra.run.smithi098.stdout:(26/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 638 kB/s | 85 kB 00:00 2024-04-26T20:14:12.684 INFO:teuthology.orchestra.run.smithi098.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 2.5 MB/s | 171 kB 00:00 2024-04-26T20:14:12.735 INFO:teuthology.orchestra.run.smithi098.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3306.g 686 kB/s | 34 kB 00:00 2024-04-26T20:14:12.762 INFO:teuthology.orchestra.run.smithi070.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-04-26T20:14:12.793 INFO:teuthology.orchestra.run.smithi098.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 2.4 MB/s | 142 kB 00:00 2024-04-26T20:14:12.853 INFO:teuthology.orchestra.run.smithi070.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-04-26T20:14:12.886 INFO:teuthology.orchestra.run.smithi098.stdout:(30/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 10 MB/s | 3.1 MB 00:00 2024-04-26T20:14:12.954 INFO:teuthology.orchestra.run.smithi070.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 215 kB/s | 21 kB 00:00 2024-04-26T20:14:12.962 INFO:teuthology.orchestra.run.smithi080.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:14:12.963 INFO:teuthology.orchestra.run.smithi080.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:14:12.973 INFO:teuthology.orchestra.run.smithi080.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T20:14:12.974 INFO:teuthology.orchestra.run.smithi080.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T20:14:12.975 INFO:teuthology.orchestra.run.smithi080.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T20:14:12.976 INFO:teuthology.orchestra.run.smithi080.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T20:14:12.977 INFO:teuthology.orchestra.run.smithi080.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T20:14:12.979 INFO:teuthology.orchestra.run.smithi070.stdout:(51/152): bison-3.7.4-5.el9.x86_64.rpm 1.8 MB/s | 943 kB 00:00 2024-04-26T20:14:12.980 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T20:14:12.980 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T20:14:13.041 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-26T20:14:13.061 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-26T20:14:13.061 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-04-26T20:14:13.061 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-26T20:14:13.061 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T20:14:13.062 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T20:14:13.063 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:14:13.064 INFO:teuthology.orchestra.run.smithi080.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T20:14:13.065 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T20:14:13.066 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T20:14:13.067 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T20:14:13.068 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T20:14:13.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T20:14:13.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T20:14:13.069 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T20:14:13.070 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T20:14:13.071 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T20:14:13.072 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T20:14:13.073 INFO:teuthology.orchestra.run.smithi080.stdout:Installing weak dependencies: 2024-04-26T20:14:13.074 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T20:14:13.074 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:14:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-26T20:14:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-26T20:14:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:Install 148 Packages 2024-04-26T20:14:13.074 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 4 Packages 2024-04-26T20:14:13.074 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:14:13.075 INFO:teuthology.orchestra.run.smithi070.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 357 kB/s | 33 kB 00:00 2024-04-26T20:14:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 222 M 2024-04-26T20:14:13.075 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-04-26T20:14:13.105 INFO:teuthology.orchestra.run.smithi070.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-04-26T20:14:13.172 INFO:teuthology.orchestra.run.smithi070.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 274 kB/s | 18 kB 00:00 2024-04-26T20:14:13.253 INFO:teuthology.orchestra.run.smithi098.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 7.7 MB/s | 3.5 MB 00:00 2024-04-26T20:14:13.256 INFO:teuthology.orchestra.run.smithi070.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 131 kB/s | 11 kB 00:00 2024-04-26T20:14:13.304 INFO:teuthology.orchestra.run.smithi098.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3306.gbc 4.9 MB/s | 249 kB 00:00 2024-04-26T20:14:13.330 INFO:teuthology.orchestra.run.smithi070.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-04-26T20:14:13.362 INFO:teuthology.orchestra.run.smithi098.stdout:(33/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 846 kB/s | 49 kB 00:00 2024-04-26T20:14:13.406 INFO:teuthology.orchestra.run.smithi070.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 603 kB/s | 45 kB 00:00 2024-04-26T20:14:13.421 INFO:teuthology.orchestra.run.smithi098.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3306.gb 283 kB/s | 16 kB 00:00 2024-04-26T20:14:13.496 INFO:teuthology.orchestra.run.smithi098.stdout:(35/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 3.6 MB/s | 273 kB 00:00 2024-04-26T20:14:13.622 INFO:teuthology.orchestra.run.smithi098.stdout:(36/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 6.0 MB/s | 762 kB 00:00 2024-04-26T20:14:13.639 INFO:teuthology.orchestra.run.smithi070.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 662 kB 00:00 2024-04-26T20:14:13.713 INFO:teuthology.orchestra.run.smithi098.stdout:(37/152): ceph-mgr-diskprediction-local-19.0.0- 9.0 MB/s | 7.4 MB 00:00 2024-04-26T20:14:13.739 INFO:teuthology.orchestra.run.smithi098.stdout:(38/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 156 kB/s | 18 kB 00:00 2024-04-26T20:14:13.848 INFO:teuthology.orchestra.run.smithi070.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 2.7 MB/s | 582 kB 00:00 2024-04-26T20:14:13.932 INFO:teuthology.orchestra.run.smithi070.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 306 kB/s | 25 kB 00:00 2024-04-26T20:14:13.997 INFO:teuthology.orchestra.run.smithi098.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 283 kB/s | 80 kB 00:00 2024-04-26T20:14:14.147 INFO:teuthology.orchestra.run.smithi098.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-04-26T20:14:14.229 INFO:teuthology.orchestra.run.smithi080.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-04-26T20:14:14.264 INFO:teuthology.orchestra.run.smithi098.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 803 kB 00:00 2024-04-26T20:14:14.373 INFO:teuthology.orchestra.run.smithi070.stdout:(61/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 7.5 MB/s | 49 MB 00:06 2024-04-26T20:14:14.399 INFO:teuthology.orchestra.run.smithi070.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 102 kB/s | 47 kB 00:00 2024-04-26T20:14:14.482 INFO:teuthology.orchestra.run.smithi070.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-26T20:14:14.506 INFO:teuthology.orchestra.run.smithi098.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 706 kB/s | 253 kB 00:00 2024-04-26T20:14:14.529 INFO:teuthology.orchestra.run.smithi080.stdout:(2/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 8.4 MB/s | 5.4 MB 00:00 2024-04-26T20:14:14.533 INFO:teuthology.orchestra.run.smithi070.stdout:(64/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.0 MB/s | 3.0 MB 00:01 2024-04-26T20:14:14.550 INFO:teuthology.orchestra.run.smithi070.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 525 kB/s | 35 kB 00:00 2024-04-26T20:14:14.565 INFO:teuthology.orchestra.run.smithi098.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 4.1 MB/s | 1.2 MB 00:00 2024-04-26T20:14:14.583 INFO:teuthology.orchestra.run.smithi070.stdout:(66/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-04-26T20:14:14.590 INFO:teuthology.orchestra.run.smithi098.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-04-26T20:14:14.604 INFO:teuthology.orchestra.run.smithi080.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 1.9 MB/s | 145 kB 00:00 2024-04-26T20:14:14.624 INFO:teuthology.orchestra.run.smithi098.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-26T20:14:14.649 INFO:teuthology.orchestra.run.smithi098.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-26T20:14:14.708 INFO:teuthology.orchestra.run.smithi098.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-26T20:14:14.863 INFO:teuthology.orchestra.run.smithi080.stdout:(4/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 9.1 MB/s | 2.4 MB 00:00 2024-04-26T20:14:14.896 INFO:teuthology.orchestra.run.smithi080.stdout:(5/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.3 MB/s | 889 kB 00:00 2024-04-26T20:14:14.950 INFO:teuthology.orchestra.run.smithi070.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-04-26T20:14:15.014 INFO:teuthology.orchestra.run.smithi080.stdout:(6/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 10 MB/s | 1.5 MB 00:00 2024-04-26T20:14:15.217 INFO:teuthology.orchestra.run.smithi070.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 3.3 MB/s | 911 kB 00:00 2024-04-26T20:14:15.301 INFO:teuthology.orchestra.run.smithi070.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-04-26T20:14:15.468 INFO:teuthology.orchestra.run.smithi070.stdout:(70/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.8 MB/s | 4.4 MB 00:00 2024-04-26T20:14:15.751 INFO:teuthology.orchestra.run.smithi070.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 3.6 MB/s | 1.0 MB 00:00 2024-04-26T20:14:15.818 INFO:teuthology.orchestra.run.smithi070.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-26T20:14:15.938 INFO:teuthology.orchestra.run.smithi080.stdout:(7/152): ceph-common-19.0.0-3306.gbc612ffb.el9. 10 MB/s | 21 MB 00:02 2024-04-26T20:14:16.050 INFO:teuthology.orchestra.run.smithi098.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 492 kB/s | 689 kB 00:01 2024-04-26T20:14:16.455 INFO:teuthology.orchestra.run.smithi080.stdout:(8/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x86 12 MB/s | 17 MB 00:01 2024-04-26T20:14:16.486 INFO:teuthology.orchestra.run.smithi098.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 531 kB/s | 943 kB 00:01 2024-04-26T20:14:16.497 INFO:teuthology.orchestra.run.smithi080.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 605 kB/s | 25 kB 00:00 2024-04-26T20:14:16.798 INFO:teuthology.orchestra.run.smithi080.stdout:(10/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el 12 MB/s | 11 MB 00:00 2024-04-26T20:14:16.843 INFO:teuthology.orchestra.run.smithi070.stdout:(73/152): openblas-openmp-0.3.21-2.el9.x86_64.r 2.1 MB/s | 4.7 MB 00:02 2024-04-26T20:14:16.890 INFO:teuthology.orchestra.run.smithi080.stdout:(11/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 2.4 MB/s | 225 kB 00:00 2024-04-26T20:14:16.900 INFO:teuthology.orchestra.run.smithi098.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 126 kB/s | 107 kB 00:00 2024-04-26T20:14:16.956 INFO:teuthology.orchestra.run.smithi080.stdout:(12/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 406 kB/s | 27 kB 00:00 2024-04-26T20:14:16.969 INFO:teuthology.orchestra.run.smithi070.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.9 MB/s | 244 kB 00:00 2024-04-26T20:14:17.023 INFO:teuthology.orchestra.run.smithi080.stdout:(13/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x8 2.2 MB/s | 4.7 MB 00:02 2024-04-26T20:14:17.048 INFO:teuthology.orchestra.run.smithi080.stdout:(14/152): libcephfs-devel-19.0.0-3306.gbc612ffb 345 kB/s | 32 kB 00:00 2024-04-26T20:14:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 37 kB/s | 21 kB 00:00 2024-04-26T20:14:17.124 INFO:teuthology.orchestra.run.smithi080.stdout:(15/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 2.1 MB/s | 163 kB 00:00 2024-04-26T20:14:17.144 INFO:teuthology.orchestra.run.smithi070.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 4.5 MB/s | 6.0 MB 00:01 2024-04-26T20:14:17.169 INFO:teuthology.orchestra.run.smithi070.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.2 MB/s | 248 kB 00:00 2024-04-26T20:14:17.194 INFO:teuthology.orchestra.run.smithi070.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-04-26T20:14:17.199 INFO:teuthology.orchestra.run.smithi080.stdout:(16/152): librados-devel-19.0.0-3306.gbc612ffb. 1.7 MB/s | 127 kB 00:00 2024-04-26T20:14:17.219 INFO:teuthology.orchestra.run.smithi070.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-04-26T20:14:17.253 INFO:teuthology.orchestra.run.smithi070.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-26T20:14:17.291 INFO:teuthology.orchestra.run.smithi080.stdout:(17/152): libradosstriper1-19.0.0-3306.gbc612ff 5.3 MB/s | 501 kB 00:00 2024-04-26T20:14:17.307 INFO:teuthology.orchestra.run.smithi070.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 400 kB/s | 35 kB 00:00 2024-04-26T20:14:17.459 INFO:teuthology.orchestra.run.smithi080.stdout:(18/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 1.7 MB/s | 747 kB 00:00 2024-04-26T20:14:17.487 INFO:teuthology.orchestra.run.smithi070.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-04-26T20:14:17.602 INFO:teuthology.orchestra.run.smithi080.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 319 kB/s | 45 kB 00:00 2024-04-26T20:14:17.654 INFO:teuthology.orchestra.run.smithi070.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-04-26T20:14:17.709 INFO:teuthology.orchestra.run.smithi098.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 51 kB/s | 33 kB 00:00 2024-04-26T20:14:17.721 INFO:teuthology.orchestra.run.smithi070.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-04-26T20:14:17.742 INFO:teuthology.orchestra.run.smithi080.stdout:(20/152): python3-ceph-common-19.0.0-3306.gbc61 954 kB/s | 135 kB 00:00 2024-04-26T20:14:17.796 INFO:teuthology.orchestra.run.smithi070.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 563 kB/s | 42 kB 00:00 2024-04-26T20:14:17.868 INFO:teuthology.orchestra.run.smithi080.stdout:(21/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 9.3 MB/s | 5.4 MB 00:00 2024-04-26T20:14:17.893 INFO:teuthology.orchestra.run.smithi080.stdout:(22/152): python3-cephfs-19.0.0-3306.gbc612ffb. 1.0 MB/s | 161 kB 00:00 2024-04-26T20:14:17.960 INFO:teuthology.orchestra.run.smithi080.stdout:(23/152): python3-rados-19.0.0-3306.gbc612ffb.e 3.4 MB/s | 321 kB 00:00 2024-04-26T20:14:17.996 INFO:teuthology.orchestra.run.smithi070.stdout:(85/152): postgresql-server-13.14-1.el9.x86_64. 2.1 MB/s | 5.8 MB 00:02 2024-04-26T20:14:18.022 INFO:teuthology.orchestra.run.smithi070.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 1.2 MB/s | 269 kB 00:00 2024-04-26T20:14:18.026 INFO:teuthology.orchestra.run.smithi098.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 279 kB/s | 313 kB 00:01 2024-04-26T20:14:18.035 INFO:teuthology.orchestra.run.smithi080.stdout:(24/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.3 MB/s | 99 kB 00:00 2024-04-26T20:14:18.088 INFO:teuthology.orchestra.run.smithi070.stdout:(87/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.1 MB/s | 5.1 MB 00:00 2024-04-26T20:14:18.103 INFO:teuthology.orchestra.run.smithi080.stdout:(25/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 1.4 MB/s | 298 kB 00:00 2024-04-26T20:14:18.128 INFO:teuthology.orchestra.run.smithi080.stdout:(26/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 925 kB/s | 85 kB 00:00 2024-04-26T20:14:18.147 INFO:teuthology.orchestra.run.smithi070.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-04-26T20:14:18.172 INFO:teuthology.orchestra.run.smithi070.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 610 kB/s | 51 kB 00:00 2024-04-26T20:14:18.197 INFO:teuthology.orchestra.run.smithi070.stdout:(90/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-04-26T20:14:18.211 INFO:teuthology.orchestra.run.smithi080.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 2.0 MB/s | 171 kB 00:00 2024-04-26T20:14:18.223 INFO:teuthology.orchestra.run.smithi070.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-04-26T20:14:18.281 INFO:teuthology.orchestra.run.smithi070.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-04-26T20:14:18.287 INFO:teuthology.orchestra.run.smithi080.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3306.g 456 kB/s | 34 kB 00:00 2024-04-26T20:14:18.307 INFO:teuthology.orchestra.run.smithi070.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 529 kB/s | 44 kB 00:00 2024-04-26T20:14:18.376 INFO:teuthology.orchestra.run.smithi070.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 522 kB/s | 36 kB 00:00 2024-04-26T20:14:18.393 INFO:teuthology.orchestra.run.smithi080.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 1.3 MB/s | 142 kB 00:00 2024-04-26T20:14:18.409 INFO:teuthology.orchestra.run.smithi070.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-04-26T20:14:18.434 INFO:teuthology.orchestra.run.smithi070.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-04-26T20:14:18.493 INFO:teuthology.orchestra.run.smithi070.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 991 kB/s | 58 kB 00:00 2024-04-26T20:14:18.560 INFO:teuthology.orchestra.run.smithi070.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 2.0 MB/s | 305 kB 00:00 2024-04-26T20:14:18.585 INFO:teuthology.orchestra.run.smithi070.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-04-26T20:14:18.601 INFO:teuthology.orchestra.run.smithi098.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 32 kB/s | 18 kB 00:00 2024-04-26T20:14:18.669 INFO:teuthology.orchestra.run.smithi070.stdout:(100/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 538 kB/s | 45 kB 00:00 2024-04-26T20:14:18.686 INFO:teuthology.orchestra.run.smithi070.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 507 kB/s | 64 kB 00:00 2024-04-26T20:14:18.820 INFO:teuthology.orchestra.run.smithi070.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-04-26T20:14:18.879 INFO:teuthology.orchestra.run.smithi080.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 7.3 MB/s | 3.5 MB 00:00 2024-04-26T20:14:19.403 INFO:teuthology.orchestra.run.smithi070.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 940 kB/s | 548 kB 00:00 2024-04-26T20:14:19.560 INFO:teuthology.orchestra.run.smithi098.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 12 kB/s | 11 kB 00:00 2024-04-26T20:14:19.670 INFO:teuthology.orchestra.run.smithi070.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 878 kB/s | 863 kB 00:00 2024-04-26T20:14:19.671 INFO:teuthology.orchestra.run.smithi080.stdout:(31/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 15 MB/s | 49 MB 00:03 2024-04-26T20:14:19.721 INFO:teuthology.orchestra.run.smithi080.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3306.gbc 4.9 MB/s | 249 kB 00:00 2024-04-26T20:14:19.813 INFO:teuthology.orchestra.run.smithi080.stdout:(33/152): ceph-mgr-diskprediction-local-19.0.0- 7.9 MB/s | 7.4 MB 00:00 2024-04-26T20:14:19.839 INFO:teuthology.orchestra.run.smithi080.stdout:(34/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 422 kB/s | 49 kB 00:00 2024-04-26T20:14:19.864 INFO:teuthology.orchestra.run.smithi080.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3306.gb 328 kB/s | 16 kB 00:00 2024-04-26T20:14:19.889 INFO:teuthology.orchestra.run.smithi080.stdout:(36/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 5.3 MB/s | 273 kB 00:00 2024-04-26T20:14:19.929 INFO:teuthology.orchestra.run.smithi070.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-04-26T20:14:19.948 INFO:teuthology.orchestra.run.smithi080.stdout:(37/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 1.7 MB/s | 3.1 MB 00:01 2024-04-26T20:14:19.973 INFO:teuthology.orchestra.run.smithi080.stdout:(38/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 218 kB/s | 18 kB 00:00 2024-04-26T20:14:19.987 INFO:teuthology.orchestra.run.smithi070.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 529 kB/s | 309 kB 00:00 2024-04-26T20:14:20.007 INFO:teuthology.orchestra.run.smithi080.stdout:(39/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 5.2 MB/s | 762 kB 00:00 2024-04-26T20:14:20.132 INFO:teuthology.orchestra.run.smithi080.stdout:(40/152): fuse-2.9.9-15.el9.x86_64.rpm 437 kB/s | 80 kB 00:00 2024-04-26T20:14:20.274 INFO:teuthology.orchestra.run.smithi080.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 731 kB/s | 195 kB 00:00 2024-04-26T20:14:20.300 INFO:teuthology.orchestra.run.smithi080.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-04-26T20:14:20.325 INFO:teuthology.orchestra.run.smithi080.stdout:(43/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-04-26T20:14:20.367 INFO:teuthology.orchestra.run.smithi080.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-26T20:14:20.371 INFO:teuthology.orchestra.run.smithi070.stdout:(107/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-04-26T20:14:20.374 INFO:teuthology.orchestra.run.smithi098.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 197 kB/s | 160 kB 00:00 2024-04-26T20:14:20.396 INFO:teuthology.orchestra.run.smithi070.stdout:(108/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 64 kB/s | 26 kB 00:00 2024-04-26T20:14:20.400 INFO:teuthology.orchestra.run.smithi080.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-04-26T20:14:20.517 INFO:teuthology.orchestra.run.smithi080.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 830 kB/s | 125 kB 00:00 2024-04-26T20:14:20.543 INFO:teuthology.orchestra.run.smithi080.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 1.5 MB/s | 215 kB 00:00 2024-04-26T20:14:20.635 INFO:teuthology.orchestra.run.smithi080.stdout:(48/152): python3-cryptography-36.0.1-4.el9.x86 3.4 MB/s | 1.2 MB 00:00 2024-04-26T20:14:20.713 INFO:teuthology.orchestra.run.smithi070.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 142 kB/s | 49 kB 00:00 2024-04-26T20:14:20.730 INFO:teuthology.orchestra.run.smithi070.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 202 kB/s | 67 kB 00:00 2024-04-26T20:14:20.910 INFO:teuthology.orchestra.run.smithi080.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 430 kB/s | 107 kB 00:00 2024-04-26T20:14:20.952 INFO:teuthology.orchestra.run.smithi080.stdout:(50/152): automake-1.16.2-8.el9.noarch.rpm 1.5 MB/s | 689 kB 00:00 2024-04-26T20:14:21.011 INFO:teuthology.orchestra.run.smithi080.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 214 kB/s | 21 kB 00:00 2024-04-26T20:14:21.103 INFO:teuthology.orchestra.run.smithi080.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 943 kB 00:00 2024-04-26T20:14:21.128 INFO:teuthology.orchestra.run.smithi080.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-04-26T20:14:21.138 INFO:teuthology.orchestra.run.smithi070.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 355 kB/s | 151 kB 00:00 2024-04-26T20:14:21.161 INFO:teuthology.orchestra.run.smithi080.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-04-26T20:14:21.220 INFO:teuthology.orchestra.run.smithi080.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 197 kB/s | 18 kB 00:00 2024-04-26T20:14:21.262 INFO:teuthology.orchestra.run.smithi080.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-04-26T20:14:21.286 INFO:teuthology.orchestra.run.smithi098.stdout:(57/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 4.4 MB/s | 49 MB 00:11 2024-04-26T20:14:21.302 INFO:teuthology.orchestra.run.smithi098.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 49 kB/s | 45 kB 00:00 2024-04-26T20:14:21.346 INFO:teuthology.orchestra.run.smithi080.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-04-26T20:14:21.363 INFO:teuthology.orchestra.run.smithi080.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-04-26T20:14:21.430 INFO:teuthology.orchestra.run.smithi080.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.2 MB/s | 3.0 MB 00:00 2024-04-26T20:14:21.430 INFO:teuthology.orchestra.run.smithi070.stdout:(112/152): libarrow-9.0.0-11.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2024-04-26T20:14:21.456 INFO:teuthology.orchestra.run.smithi070.stdout:(113/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.1 MB/s | 839 kB 00:00 2024-04-26T20:14:21.489 INFO:teuthology.orchestra.run.smithi080.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 4.5 MB/s | 582 kB 00:00 2024-04-26T20:14:21.505 INFO:teuthology.orchestra.run.smithi080.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 338 kB/s | 25 kB 00:00 2024-04-26T20:14:21.547 INFO:teuthology.orchestra.run.smithi080.stdout:(62/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-04-26T20:14:21.572 INFO:teuthology.orchestra.run.smithi080.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-04-26T20:14:21.648 INFO:teuthology.orchestra.run.smithi080.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-04-26T20:14:21.673 INFO:teuthology.orchestra.run.smithi080.stdout:(65/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-04-26T20:14:21.698 INFO:teuthology.orchestra.run.smithi080.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 280 kB/s | 35 kB 00:00 2024-04-26T20:14:21.722 INFO:teuthology.orchestra.run.smithi070.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 121 kB/s | 32 kB 00:00 2024-04-26T20:14:21.773 INFO:teuthology.orchestra.run.smithi070.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 127 kB/s | 43 kB 00:00 2024-04-26T20:14:21.831 INFO:teuthology.orchestra.run.smithi070.stdout:(116/152): python3-asyncssh-2.13.2-5.el9.noarch 791 kB/s | 548 kB 00:00 2024-04-26T20:14:22.015 INFO:teuthology.orchestra.run.smithi070.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 51 kB/s | 15 kB 00:00 2024-04-26T20:14:22.049 INFO:teuthology.orchestra.run.smithi080.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2024-04-26T20:14:22.199 INFO:teuthology.orchestra.run.smithi080.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 5.9 MB/s | 911 kB 00:00 2024-04-26T20:14:22.282 INFO:teuthology.orchestra.run.smithi070.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 338 kB/s | 172 kB 00:00 2024-04-26T20:14:22.299 INFO:teuthology.orchestra.run.smithi080.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 2.6 MB/s | 1.6 MB 00:00 2024-04-26T20:14:22.325 INFO:teuthology.orchestra.run.smithi080.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-04-26T20:14:22.348 INFO:teuthology.orchestra.run.smithi070.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 693 kB/s | 358 kB 00:00 2024-04-26T20:14:22.450 INFO:teuthology.orchestra.run.smithi080.stdout:(71/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-04-26T20:14:22.478 INFO:teuthology.orchestra.run.smithi098.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 642 kB/s | 3.0 MB 00:04 2024-04-26T20:14:22.534 INFO:teuthology.orchestra.run.smithi080.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-04-26T20:14:22.549 INFO:teuthology.orchestra.run.smithi070.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 132 kB/s | 35 kB 00:00 2024-04-26T20:14:22.559 INFO:teuthology.orchestra.run.smithi080.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 805 kB/s | 87 kB 00:00 2024-04-26T20:14:22.599 INFO:teuthology.orchestra.run.smithi070.stdout:(121/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 519 kB/s | 303 kB 00:00 2024-04-26T20:14:22.643 INFO:teuthology.orchestra.run.smithi080.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-04-26T20:14:22.701 INFO:teuthology.orchestra.run.smithi080.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-04-26T20:14:22.768 INFO:teuthology.orchestra.run.smithi080.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-04-26T20:14:22.818 INFO:teuthology.orchestra.run.smithi080.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-04-26T20:14:22.820 INFO:teuthology.orchestra.run.smithi098.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 384 kB/s | 582 kB 00:01 2024-04-26T20:14:22.853 INFO:teuthology.orchestra.run.smithi098.stdout:(61/152): librdkafka-1.6.1-102.el9.x86_64.rpm 423 kB/s | 662 kB 00:01 2024-04-26T20:14:22.858 INFO:teuthology.orchestra.run.smithi070.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 404 kB/s | 206 kB 00:00 2024-04-26T20:14:22.869 INFO:teuthology.orchestra.run.smithi080.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-04-26T20:14:22.902 INFO:teuthology.orchestra.run.smithi080.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-04-26T20:14:22.953 INFO:teuthology.orchestra.run.smithi080.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 415 kB/s | 35 kB 00:00 2024-04-26T20:14:23.028 INFO:teuthology.orchestra.run.smithi080.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-04-26T20:14:23.041 INFO:teuthology.orchestra.run.smithi070.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2024-04-26T20:14:23.078 INFO:teuthology.orchestra.run.smithi098.stdout:(62/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 42 kB/s | 25 kB 00:00 2024-04-26T20:14:23.086 INFO:teuthology.orchestra.run.smithi080.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-04-26T20:14:23.108 INFO:teuthology.orchestra.run.smithi070.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 284 kB/s | 144 kB 00:00 2024-04-26T20:14:23.112 INFO:teuthology.orchestra.run.smithi080.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-04-26T20:14:23.179 INFO:teuthology.orchestra.run.smithi080.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 839 kB/s | 77 kB 00:00 2024-04-26T20:14:23.204 INFO:teuthology.orchestra.run.smithi080.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 460 kB/s | 42 kB 00:00 2024-04-26T20:14:23.254 INFO:teuthology.orchestra.run.smithi080.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-04-26T20:14:23.280 INFO:teuthology.orchestra.run.smithi080.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-26T20:14:23.309 INFO:teuthology.orchestra.run.smithi070.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 66 kB/s | 18 kB 00:00 2024-04-26T20:14:23.347 INFO:teuthology.orchestra.run.smithi080.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-04-26T20:14:23.372 INFO:teuthology.orchestra.run.smithi080.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-04-26T20:14:23.375 INFO:teuthology.orchestra.run.smithi070.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2024-04-26T20:14:23.417 INFO:teuthology.orchestra.run.smithi070.stdout:(127/152): python3-grpcio-1.46.7-10.el9.x86_64. 2.3 MB/s | 2.0 MB 00:00 2024-04-26T20:14:23.447 INFO:teuthology.orchestra.run.smithi080.stdout:(90/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.4 MB/s | 5.1 MB 00:00 2024-04-26T20:14:23.452 INFO:teuthology.orchestra.run.smithi098.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 75 kB/s | 47 kB 00:00 2024-04-26T20:14:23.464 INFO:teuthology.orchestra.run.smithi080.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 458 kB/s | 54 kB 00:00 2024-04-26T20:14:23.498 INFO:teuthology.orchestra.run.smithi080.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-04-26T20:14:23.523 INFO:teuthology.orchestra.run.smithi080.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 752 kB/s | 44 kB 00:00 2024-04-26T20:14:23.590 INFO:teuthology.orchestra.run.smithi080.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-04-26T20:14:23.607 INFO:teuthology.orchestra.run.smithi080.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 428 kB/s | 36 kB 00:00 2024-04-26T20:14:23.609 INFO:teuthology.orchestra.run.smithi070.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 65 kB/s | 19 kB 00:00 2024-04-26T20:14:23.635 INFO:teuthology.orchestra.run.smithi070.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 76 kB/s | 20 kB 00:00 2024-04-26T20:14:23.657 INFO:teuthology.orchestra.run.smithi080.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-04-26T20:14:23.691 INFO:teuthology.orchestra.run.smithi080.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.5 MB/s | 305 kB 00:00 2024-04-26T20:14:23.741 INFO:teuthology.orchestra.run.smithi080.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 692 kB/s | 58 kB 00:00 2024-04-26T20:14:23.767 INFO:teuthology.orchestra.run.smithi080.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-04-26T20:14:23.812 INFO:teuthology.orchestra.run.smithi098.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 305 kB/s | 292 kB 00:00 2024-04-26T20:14:23.817 INFO:teuthology.orchestra.run.smithi080.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 847 kB/s | 64 kB 00:00 2024-04-26T20:14:23.851 INFO:teuthology.orchestra.run.smithi080.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 535 kB/s | 45 kB 00:00 2024-04-26T20:14:23.953 INFO:teuthology.orchestra.run.smithi070.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 135 kB/s | 46 kB 00:00 2024-04-26T20:14:23.954 INFO:teuthology.orchestra.run.smithi098.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 215 kB/s | 188 kB 00:00 2024-04-26T20:14:23.977 INFO:teuthology.orchestra.run.smithi070.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 231 kB/s | 79 kB 00:00 2024-04-26T20:14:24.038 INFO:teuthology.orchestra.run.smithi098.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 60 kB/s | 35 kB 00:00 2024-04-26T20:14:24.085 INFO:teuthology.orchestra.run.smithi070.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-04-26T20:14:24.093 INFO:teuthology.orchestra.run.smithi080.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-04-26T20:14:24.294 INFO:teuthology.orchestra.run.smithi070.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 169 kB/s | 58 kB 00:00 2024-04-26T20:14:24.353 INFO:teuthology.orchestra.run.smithi070.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 61 kB/s | 16 kB 00:00 2024-04-26T20:14:24.486 INFO:teuthology.orchestra.run.smithi070.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 535 kB/s | 272 kB 00:00 2024-04-26T20:14:24.526 INFO:teuthology.orchestra.run.smithi080.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-04-26T20:14:24.628 INFO:teuthology.orchestra.run.smithi070.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 102 kB/s | 28 kB 00:00 2024-04-26T20:14:24.653 INFO:teuthology.orchestra.run.smithi070.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 251 kB/s | 90 kB 00:00 2024-04-26T20:14:24.685 INFO:teuthology.orchestra.run.smithi080.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 927 kB/s | 548 kB 00:00 2024-04-26T20:14:24.745 INFO:teuthology.orchestra.run.smithi070.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 119 kB/s | 31 kB 00:00 2024-04-26T20:14:24.802 INFO:teuthology.orchestra.run.smithi080.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 168 kB/s | 19 kB 00:00 2024-04-26T20:14:25.004 INFO:teuthology.orchestra.run.smithi070.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 169 kB/s | 59 kB 00:00 2024-04-26T20:14:25.021 INFO:teuthology.orchestra.run.smithi070.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 130 kB/s | 36 kB 00:00 2024-04-26T20:14:25.044 INFO:teuthology.orchestra.run.smithi080.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 597 kB/s | 309 kB 00:00 2024-04-26T20:14:25.054 INFO:teuthology.orchestra.run.smithi070.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 443 kB/s | 188 kB 00:00 2024-04-26T20:14:25.127 INFO:teuthology.orchestra.run.smithi080.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-04-26T20:14:25.220 INFO:teuthology.orchestra.run.smithi080.stdout:(108/152): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-26T20:14:25.244 INFO:teuthology.orchestra.run.smithi080.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 415 kB/s | 49 kB 00:00 2024-04-26T20:14:25.312 INFO:teuthology.orchestra.run.smithi080.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 734 kB/s | 67 kB 00:00 2024-04-26T20:14:25.370 INFO:teuthology.orchestra.run.smithi080.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-04-26T20:14:25.371 INFO:teuthology.orchestra.run.smithi070.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 139 kB/s | 51 kB 00:00 2024-04-26T20:14:25.405 INFO:teuthology.orchestra.run.smithi070.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 256 kB/s | 90 kB 00:00 2024-04-26T20:14:25.429 INFO:teuthology.orchestra.run.smithi080.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-04-26T20:14:25.530 INFO:teuthology.orchestra.run.smithi070.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 451 kB/s | 230 kB 00:00 2024-04-26T20:14:25.646 INFO:teuthology.orchestra.run.smithi080.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 201 kB/s | 43 kB 00:00 2024-04-26T20:14:25.680 INFO:teuthology.orchestra.run.smithi070.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 72 kB/s | 20 kB 00:00 2024-04-26T20:14:25.738 INFO:teuthology.orchestra.run.smithi080.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 1.5 MB/s | 548 kB 00:00 2024-04-26T20:14:25.763 INFO:teuthology.orchestra.run.smithi080.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 275 kB/s | 32 kB 00:00 2024-04-26T20:14:25.822 INFO:teuthology.orchestra.run.smithi080.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-04-26T20:14:25.864 INFO:teuthology.orchestra.run.smithi080.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-04-26T20:14:25.955 INFO:teuthology.orchestra.run.smithi070.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 451 kB/s | 192 kB 00:00 2024-04-26T20:14:25.989 INFO:teuthology.orchestra.run.smithi070.stdout:(147/152): python3-werkzeug-2.0.3-3.el9.1.noarc 692 kB/s | 427 kB 00:00 2024-04-26T20:14:25.997 INFO:teuthology.orchestra.run.smithi080.stdout:(118/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-04-26T20:14:26.031 INFO:teuthology.orchestra.run.smithi080.stdout:(119/152): protobuf-compiler-3.14.0-13.el9.x86_ 396 kB/s | 863 kB 00:02 2024-04-26T20:14:26.073 INFO:teuthology.orchestra.run.smithi080.stdout:(120/152): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2024-04-26T20:14:26.098 INFO:teuthology.orchestra.run.smithi080.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 350 kB/s | 35 kB 00:00 2024-04-26T20:14:26.223 INFO:teuthology.orchestra.run.smithi080.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-04-26T20:14:26.332 INFO:teuthology.orchestra.run.smithi080.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-04-26T20:14:26.416 INFO:teuthology.orchestra.run.smithi080.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 212 kB/s | 18 kB 00:00 2024-04-26T20:14:26.439 INFO:teuthology.orchestra.run.smithi070.stdout:(148/152): librados2-19.0.0-3306.gbc612ffb.el9. 7.0 MB/s | 3.4 MB 00:00 2024-04-26T20:14:26.491 INFO:teuthology.orchestra.run.smithi080.stdout:(125/152): python3-jaraco-collections-3.0.0-8.e 309 kB/s | 23 kB 00:00 2024-04-26T20:14:26.533 INFO:teuthology.orchestra.run.smithi080.stdout:(126/152): python3-google-auth-2.29.0-1.el9.noa 410 kB/s | 206 kB 00:00 2024-04-26T20:14:26.558 INFO:teuthology.orchestra.run.smithi080.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-04-26T20:14:26.617 INFO:teuthology.orchestra.run.smithi080.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-04-26T20:14:26.648 INFO:teuthology.orchestra.run.smithi070.stdout:(149/152): thrift-0.15.0-2.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-04-26T20:14:26.692 INFO:teuthology.orchestra.run.smithi080.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-04-26T20:14:26.734 INFO:teuthology.orchestra.run.smithi080.stdout:(130/152): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-04-26T20:14:26.760 INFO:teuthology.orchestra.run.smithi080.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 326 kB/s | 46 kB 00:00 2024-04-26T20:14:26.785 INFO:teuthology.orchestra.run.smithi080.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 855 kB/s | 79 kB 00:00 2024-04-26T20:14:26.827 INFO:teuthology.orchestra.run.smithi080.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 626 kB/s | 58 kB 00:00 2024-04-26T20:14:26.877 INFO:teuthology.orchestra.run.smithi080.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-04-26T20:14:26.880 INFO:teuthology.orchestra.run.smithi098.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 578 kB/s | 1.6 MB 00:02 2024-04-26T20:14:26.927 INFO:teuthology.orchestra.run.smithi080.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-04-26T20:14:26.953 INFO:teuthology.orchestra.run.smithi080.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 716 kB/s | 90 kB 00:00 2024-04-26T20:14:26.978 INFO:teuthology.orchestra.run.smithi080.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-04-26T20:14:27.020 INFO:teuthology.orchestra.run.smithi080.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-04-26T20:14:27.062 INFO:teuthology.orchestra.run.smithi080.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-04-26T20:14:27.065 INFO:teuthology.orchestra.run.smithi070.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 2.2 MB/s | 1.3 MB 00:00 2024-04-26T20:14:27.087 INFO:teuthology.orchestra.run.smithi080.stdout:(140/152): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-04-26T20:14:27.121 INFO:teuthology.orchestra.run.smithi080.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2024-04-26T20:14:27.171 INFO:teuthology.orchestra.run.smithi080.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 469 kB/s | 51 kB 00:00 2024-04-26T20:14:27.230 INFO:teuthology.orchestra.run.smithi080.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 826 kB/s | 90 kB 00:00 2024-04-26T20:14:27.255 INFO:teuthology.orchestra.run.smithi080.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-04-26T20:14:27.289 INFO:teuthology.orchestra.run.smithi080.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-26T20:14:27.322 INFO:teuthology.orchestra.run.smithi080.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2024-04-26T20:14:27.389 INFO:teuthology.orchestra.run.smithi080.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-26T20:14:27.439 INFO:teuthology.orchestra.run.smithi080.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-26T20:14:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:(149/152): librados2-19.0.0-3306.gbc612ffb.el9. 11 MB/s | 3.4 MB 00:00 2024-04-26T20:14:27.673 INFO:teuthology.orchestra.run.smithi070.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-04-26T20:14:27.731 INFO:teuthology.orchestra.run.smithi070.stdout:(152/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 1.8 MB/s | 3.1 MB 00:01 2024-04-26T20:14:27.735 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:14:27.735 INFO:teuthology.orchestra.run.smithi070.stdout:Total 9.7 MB/s | 222 MB 00:22 2024-04-26T20:14:27.865 INFO:teuthology.orchestra.run.smithi080.stdout:(150/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 6.6 MB/s | 3.1 MB 00:00 2024-04-26T20:14:27.907 INFO:teuthology.orchestra.run.smithi080.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 3.1 MB/s | 1.3 MB 00:00 2024-04-26T20:14:28.241 INFO:teuthology.orchestra.run.smithi080.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 3.9 MB/s | 2.4 MB 00:00 2024-04-26T20:14:28.250 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:14:28.250 INFO:teuthology.orchestra.run.smithi080.stdout:Total 15 MB/s | 222 MB 00:15 2024-04-26T20:14:28.817 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-04-26T20:14:28.880 INFO:teuthology.orchestra.run.smithi098.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 456 kB/s | 911 kB 00:01 2024-04-26T20:14:28.961 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-04-26T20:14:28.961 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-04-26T20:14:29.370 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-04-26T20:14:29.515 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-04-26T20:14:29.515 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-04-26T20:14:29.555 INFO:teuthology.orchestra.run.smithi098.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 197 kB/s | 133 kB 00:00 2024-04-26T20:14:30.430 INFO:teuthology.orchestra.run.smithi098.stdout:(70/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 700 kB/s | 4.4 MB 00:06 2024-04-26T20:14:30.747 INFO:teuthology.orchestra.run.smithi098.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 700 kB/s | 4.7 MB 00:06 2024-04-26T20:14:30.806 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-04-26T20:14:30.807 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-04-26T20:14:31.285 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-04-26T20:14:31.285 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-04-26T20:14:31.514 INFO:teuthology.orchestra.run.smithi098.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 114 kB/s | 87 kB 00:00 2024-04-26T20:14:32.364 INFO:teuthology.orchestra.run.smithi098.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 534 kB/s | 1.0 MB 00:01 2024-04-26T20:14:33.172 INFO:teuthology.orchestra.run.smithi098.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 302 kB/s | 244 kB 00:00 2024-04-26T20:14:34.173 INFO:teuthology.orchestra.run.smithi098.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 248 kB/s | 248 kB 00:00 2024-04-26T20:14:34.714 INFO:teuthology.orchestra.run.smithi098.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 47 kB/s | 26 kB 00:00 2024-04-26T20:14:35.223 INFO:teuthology.orchestra.run.smithi098.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 38 kB/s | 19 kB 00:00 2024-04-26T20:14:35.965 INFO:teuthology.orchestra.run.smithi098.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 232 kB/s | 172 kB 00:00 2024-04-26T20:14:36.515 INFO:teuthology.orchestra.run.smithi098.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-04-26T20:14:36.665 INFO:teuthology.orchestra.run.smithi098.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 832 kB/s | 5.8 MB 00:07 2024-04-26T20:14:36.756 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-04-26T20:14:36.843 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T20:14:36.881 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T20:14:36.934 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T20:14:36.969 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T20:14:36.994 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T20:14:37.036 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T20:14:37.205 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-04-26T20:14:37.310 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T20:14:37.366 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T20:14:37.373 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T20:14:37.492 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T20:14:37.499 INFO:teuthology.orchestra.run.smithi098.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 301 kB/s | 250 kB 00:00 2024-04-26T20:14:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:14:37.545 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T20:14:37.570 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T20:14:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T20:14:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:14:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:14:37.762 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:14:37.792 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:14:37.943 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T20:14:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T20:14:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T20:14:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:14:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:14:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:14:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:14:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:14:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:14:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:14:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:14:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:14:38.274 INFO:teuthology.orchestra.run.smithi098.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 287 kB/s | 222 kB 00:00 2024-04-26T20:14:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:14:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:14:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:14:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:14:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T20:14:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T20:14:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T20:14:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:14:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T20:14:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T20:14:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:14:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:14:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T20:14:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:14:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:14:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T20:14:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:14:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T20:14:38.854 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T20:14:38.886 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T20:14:38.891 INFO:teuthology.orchestra.run.smithi098.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 125 kB/s | 77 kB 00:00 2024-04-26T20:14:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T20:14:38.975 INFO:teuthology.orchestra.run.smithi098.stdout:(84/152): python3-babel-2.9.1-2.el9.noarch.rpm 818 kB/s | 6.0 MB 00:07 2024-04-26T20:14:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:14:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T20:14:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:14:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T20:14:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T20:14:39.101 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T20:14:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T20:14:39.177 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T20:14:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T20:14:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T20:14:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T20:14:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T20:14:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T20:14:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T20:14:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T20:14:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T20:14:39.407 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T20:14:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T20:14:39.457 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T20:14:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T20:14:39.492 INFO:teuthology.orchestra.run.smithi098.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 70 kB/s | 42 kB 00:00 2024-04-26T20:14:39.497 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T20:14:39.534 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T20:14:39.602 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T20:14:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T20:14:39.656 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T20:14:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T20:14:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T20:14:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T20:14:39.807 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T20:14:39.842 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T20:14:39.884 INFO:teuthology.orchestra.run.smithi098.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 297 kB/s | 269 kB 00:00 2024-04-26T20:14:39.885 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T20:14:39.914 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T20:14:39.983 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T20:14:40.037 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T20:14:40.114 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T20:14:40.201 INFO:teuthology.orchestra.run.smithi098.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 224 kB/s | 159 kB 00:00 2024-04-26T20:14:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T20:14:40.246 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T20:14:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T20:14:40.299 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T20:14:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T20:14:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T20:14:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T20:14:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T20:14:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T20:14:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T20:14:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T20:14:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T20:14:40.809 INFO:teuthology.orchestra.run.smithi098.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 301 kB/s | 279 kB 00:00 2024-04-26T20:14:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T20:14:40.834 INFO:teuthology.orchestra.run.smithi098.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 81 kB/s | 51 kB 00:00 2024-04-26T20:14:40.851 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T20:14:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T20:14:40.901 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T20:14:40.937 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T20:14:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T20:14:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T20:14:40.981 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T20:14:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T20:14:41.023 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T20:14:41.046 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T20:14:41.088 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T20:14:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T20:14:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T20:14:41.241 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T20:14:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T20:14:41.283 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T20:14:41.308 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T20:14:41.363 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T20:14:41.377 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T20:14:41.416 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T20:14:41.435 INFO:teuthology.orchestra.run.smithi098.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 86 kB/s | 54 kB 00:00 2024-04-26T20:14:41.445 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T20:14:41.456 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T20:14:41.483 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T20:14:41.498 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T20:14:41.520 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T20:14:41.548 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T20:14:41.567 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T20:14:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T20:14:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T20:14:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T20:14:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T20:14:41.750 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T20:14:41.789 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T20:14:41.817 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T20:14:41.825 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T20:14:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T20:14:41.877 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T20:14:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T20:14:41.907 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T20:14:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T20:14:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T20:14:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T20:14:41.976 INFO:teuthology.orchestra.run.smithi098.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 77 kB/s | 42 kB 00:00 2024-04-26T20:14:41.986 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T20:14:42.019 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T20:14:42.060 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T20:14:42.061 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T20:14:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T20:14:42.091 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T20:14:42.131 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T20:14:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T20:14:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T20:14:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T20:14:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T20:14:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T20:14:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T20:14:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T20:14:42.384 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T20:14:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T20:14:42.414 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T20:14:42.450 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T20:14:42.526 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T20:14:42.577 INFO:teuthology.orchestra.run.smithi098.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 74 kB/s | 44 kB 00:00 2024-04-26T20:14:42.678 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T20:14:42.726 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T20:14:42.774 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T20:14:42.803 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T20:14:42.835 INFO:teuthology.orchestra.run.smithi098.stdout:(93/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 826 kB/s | 5.1 MB 00:06 2024-04-26T20:14:42.838 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T20:14:42.871 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T20:14:42.913 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T20:14:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T20:14:43.037 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T20:14:43.086 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T20:14:43.125 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T20:14:43.172 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T20:14:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T20:14:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T20:14:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T20:14:43.272 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T20:14:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T20:14:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T20:14:43.421 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T20:14:43.477 INFO:teuthology.orchestra.run.smithi098.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 58 kB/s | 36 kB 00:00 2024-04-26T20:14:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T20:14:43.536 INFO:teuthology.orchestra.run.smithi098.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 230 kB/s | 221 kB 00:00 2024-04-26T20:14:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T20:14:43.717 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T20:14:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T20:14:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T20:14:44.036 INFO:teuthology.orchestra.run.smithi098.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 85 kB/s | 47 kB 00:00 2024-04-26T20:14:44.044 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T20:14:44.091 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T20:14:44.125 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T20:14:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T20:14:44.283 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T20:14:44.370 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T20:14:44.402 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T20:14:44.428 INFO:teuthology.orchestra.run.smithi098.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 342 kB/s | 305 kB 00:00 2024-04-26T20:14:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T20:14:44.585 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T20:14:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T20:14:44.628 INFO:teuthology.orchestra.run.smithi098.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 98 kB/s | 58 kB 00:00 2024-04-26T20:14:44.850 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T20:14:44.937 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T20:14:45.079 INFO:teuthology.orchestra.run.smithi098.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 144 kB/s | 94 kB 00:00 2024-04-26T20:14:45.254 INFO:teuthology.orchestra.run.smithi098.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 106 kB/s | 64 kB 00:00 2024-04-26T20:14:45.591 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T20:14:45.646 INFO:teuthology.orchestra.run.smithi098.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-04-26T20:14:45.715 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T20:14:45.771 INFO:teuthology.orchestra.run.smithi098.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 43 kB/s | 22 kB 00:00 2024-04-26T20:14:45.809 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T20:14:45.909 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T20:14:45.930 INFO:teuthology.orchestra.run.smithi098.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 3.4 MB/s | 548 kB 00:00 2024-04-26T20:14:45.936 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T20:14:45.970 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T20:14:45.972 INFO:teuthology.orchestra.run.smithi098.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-04-26T20:14:46.014 INFO:teuthology.orchestra.run.smithi098.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 467 kB/s | 19 kB 00:00 2024-04-26T20:14:46.222 INFO:teuthology.orchestra.run.smithi098.stdout:(106/152): libarrow-9.0.0-11.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-04-26T20:14:46.256 INFO:teuthology.orchestra.run.smithi098.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 788 kB/s | 26 kB 00:00 2024-04-26T20:14:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T20:14:46.289 INFO:teuthology.orchestra.run.smithi098.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-04-26T20:14:46.316 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:14:46.331 INFO:teuthology.orchestra.run.smithi098.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-04-26T20:14:46.382 INFO:teuthology.orchestra.run.smithi098.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-04-26T20:14:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:14:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T20:14:46.457 INFO:teuthology.orchestra.run.smithi098.stdout:(111/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-04-26T20:14:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T20:14:46.508 INFO:teuthology.orchestra.run.smithi098.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-04-26T20:14:46.541 INFO:teuthology.orchestra.run.smithi098.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-04-26T20:14:46.575 INFO:teuthology.orchestra.run.smithi098.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 967 kB/s | 32 kB 00:00 2024-04-26T20:14:46.609 INFO:teuthology.orchestra.run.smithi098.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 451 kB/s | 15 kB 00:00 2024-04-26T20:14:46.651 INFO:teuthology.orchestra.run.smithi098.stdout:(116/152): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-04-26T20:14:46.701 INFO:teuthology.orchestra.run.smithi098.stdout:(117/152): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-04-26T20:14:46.751 INFO:teuthology.orchestra.run.smithi098.stdout:(118/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.0 MB/s | 303 kB 00:00 2024-04-26T20:14:46.784 INFO:teuthology.orchestra.run.smithi098.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 1.0 MB/s | 35 kB 00:00 2024-04-26T20:14:46.827 INFO:teuthology.orchestra.run.smithi098.stdout:(120/152): python3-google-auth-2.29.0-1.el9.noa 4.8 MB/s | 206 kB 00:00 2024-04-26T20:14:46.940 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T20:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T20:14:46.969 INFO:teuthology.orchestra.run.smithi098.stdout:(121/152): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-04-26T20:14:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:14:47.011 INFO:teuthology.orchestra.run.smithi098.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-04-26T20:14:47.030 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T20:14:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:14:47.044 INFO:teuthology.orchestra.run.smithi098.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 321 kB/s | 11 kB 00:00 2024-04-26T20:14:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T20:14:47.057 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T20:14:47.086 INFO:teuthology.orchestra.run.smithi098.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 423 kB/s | 18 kB 00:00 2024-04-26T20:14:47.090 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T20:14:47.128 INFO:teuthology.orchestra.run.smithi098.stdout:(125/152): python3-jaraco-collections-3.0.0-8.e 557 kB/s | 23 kB 00:00 2024-04-26T20:14:47.170 INFO:teuthology.orchestra.run.smithi098.stdout:(126/152): python3-jaraco-functools-3.5.0-2.el9 467 kB/s | 19 kB 00:00 2024-04-26T20:14:47.204 INFO:teuthology.orchestra.run.smithi098.stdout:(127/152): python3-jaraco-text-3.2.0-6.el9.noar 593 kB/s | 20 kB 00:00 2024-04-26T20:14:47.271 INFO:teuthology.orchestra.run.smithi098.stdout:(128/152): protobuf-compiler-3.14.0-13.el9.x86_ 531 kB/s | 863 kB 00:01 2024-04-26T20:14:47.305 INFO:teuthology.orchestra.run.smithi098.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-04-26T20:14:47.355 INFO:teuthology.orchestra.run.smithi098.stdout:(130/152): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-26T20:14:47.388 INFO:teuthology.orchestra.run.smithi098.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 396 kB/s | 46 kB 00:00 2024-04-26T20:14:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T20:14:47.414 INFO:teuthology.orchestra.run.smithi098.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 987 kB/s | 58 kB 00:00 2024-04-26T20:14:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:14:47.472 INFO:teuthology.orchestra.run.smithi098.stdout:(133/152): python3-portend-3.1.0-2.el9.noarch.r 282 kB/s | 16 kB 00:00 2024-04-26T20:14:47.536 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:14:47.539 INFO:teuthology.orchestra.run.smithi098.stdout:(134/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-26T20:14:47.564 INFO:teuthology.orchestra.run.smithi098.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-04-26T20:14:47.567 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T20:14:47.590 INFO:teuthology.orchestra.run.smithi098.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-04-26T20:14:47.655 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T20:14:47.656 INFO:teuthology.orchestra.run.smithi098.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-04-26T20:14:47.656 INFO:teuthology.orchestra.run.smithi098.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-04-26T20:14:47.666 INFO:teuthology.orchestra.run.smithi098.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-04-26T20:14:47.691 INFO:teuthology.orchestra.run.smithi098.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 707 kB/s | 36 kB 00:00 2024-04-26T20:14:47.716 INFO:teuthology.orchestra.run.smithi098.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-26T20:14:47.742 INFO:teuthology.orchestra.run.smithi098.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-04-26T20:14:47.767 INFO:teuthology.orchestra.run.smithi098.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-04-26T20:14:47.792 INFO:teuthology.orchestra.run.smithi098.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-04-26T20:14:47.818 INFO:teuthology.orchestra.run.smithi098.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-04-26T20:14:47.843 INFO:teuthology.orchestra.run.smithi098.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-04-26T20:14:47.918 INFO:teuthology.orchestra.run.smithi098.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-26T20:14:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T20:14:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:14:48.186 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:14:48.210 INFO:teuthology.orchestra.run.smithi098.stdout:(148/152): librados2-19.0.0-3306.gbc612ffb.el9. 9.3 MB/s | 3.4 MB 00:00 2024-04-26T20:14:48.217 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T20:14:48.260 INFO:teuthology.orchestra.run.smithi098.stdout:(149/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 9.2 MB/s | 3.1 MB 00:00 2024-04-26T20:14:48.611 INFO:teuthology.orchestra.run.smithi098.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 3.4 MB/s | 1.3 MB 00:00 2024-04-26T20:14:49.411 INFO:teuthology.orchestra.run.smithi098.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-04-26T20:14:49.644 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:14:49.683 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:14:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:14:50.270 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:14:50.361 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:14:50.361 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T20:14:50.361 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T20:14:50.361 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:14:50.396 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:14:50.490 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:14:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:14:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:14:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:14:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:14:51.220 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T20:14:51.220 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T20:14:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:14:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:15:00.502 INFO:teuthology.orchestra.run.smithi098.stdout:(152/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 846 kB/s | 16 MB 00:19 2024-04-26T20:15:00.506 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:15:00.506 INFO:teuthology.orchestra.run.smithi098.stdout:Total 4.1 MB/s | 222 MB 00:54 2024-04-26T20:15:01.614 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-04-26T20:15:01.757 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-04-26T20:15:01.757 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-04-26T20:15:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:15:01.817 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-04-26T20:15:01.817 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-04-26T20:15:01.817 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-04-26T20:15:01.817 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-04-26T20:15:01.817 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-04-26T20:15:01.817 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-04-26T20:15:01.817 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-04-26T20:15:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:15:01.997 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:15:01.997 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:01.997 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T20:15:01.998 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:02.830 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:15:02.830 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /sys 2024-04-26T20:15:02.830 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /proc 2024-04-26T20:15:02.830 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /mnt 2024-04-26T20:15:02.830 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /var/tmp 2024-04-26T20:15:02.830 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /home 2024-04-26T20:15:02.830 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /root 2024-04-26T20:15:02.830 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /tmp 2024-04-26T20:15:02.830 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:02.998 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:15:03.013 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:15:03.013 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:03.013 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T20:15:03.013 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:15:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:15:03.511 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:03.511 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T20:15:03.511 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:15:03.511 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:15:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:03.530 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-04-26T20:15:03.530 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-04-26T20:15:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:15:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:15:03.758 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:03.758 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T20:15:03.758 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:15:03.758 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:15:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:15:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:15:04.217 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:04.217 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T20:15:04.217 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:15:04.218 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:15:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T20:15:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T20:15:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T20:15:04.508 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:15:04.534 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:15:04.534 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:04.534 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T20:15:04.534 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:15:04.534 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:15:04.534 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:04.633 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T20:15:04.687 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T20:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T20:15:04.768 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:15:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:15:04.791 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:04.791 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T20:15:04.791 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:15:04.792 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:15:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:15:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:15:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T20:15:05.069 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T20:15:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T20:15:05.245 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:15:05.268 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:15:05.268 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:05.268 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T20:15:05.268 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:15:05.268 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:15:05.268 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:05.384 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T20:15:05.441 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T20:15:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:15:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T20:15:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:15:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T20:15:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T20:15:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:15:05.679 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T20:15:05.730 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T20:15:05.807 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T20:15:05.895 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:15:06.026 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:15:06.071 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T20:15:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T20:15:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T20:15:06.584 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:15:06.613 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:15:06.660 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T20:15:06.672 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:15:06.711 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:15:06.740 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T20:15:06.770 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:15:07.671 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:15:07.703 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:15:07.805 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:15:07.809 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:15:07.847 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:15:07.972 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T20:15:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:15:08.019 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:15:08.020 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:08.020 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T20:15:08.020 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:15:08.020 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:15:08.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:15:08.084 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:15:08.181 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T20:15:08.229 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T20:15:08.809 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:15:08.839 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:15:08.940 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:15:09.108 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T20:15:09.141 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T20:15:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:15:09.164 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:09.164 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T20:15:09.164 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:15:09.164 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:15:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:09.183 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:15:09.205 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:15:09.205 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:09.205 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T20:15:09.205 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:15:09.205 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:15:09.206 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:15:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:15:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:15:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:15:09.273 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:09.273 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T20:15:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:09.317 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T20:15:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:15:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:15:09.340 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:09.340 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T20:15:09.340 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:15:09.340 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:15:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:09.365 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T20:15:09.422 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-04-26T20:15:09.505 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T20:15:09.544 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T20:15:09.597 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T20:15:09.631 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T20:15:09.644 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:15:09.665 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T20:15:09.666 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:15:09.666 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:09.666 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T20:15:09.666 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:15:09.667 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:15:09.667 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:09.707 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T20:15:10.028 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T20:15:10.141 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:15:10.263 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:15:10.292 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:15:10.296 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T20:15:10.327 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:15:10.350 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:15:10.350 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:10.350 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T20:15:10.350 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:15:10.351 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:15:10.351 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:15:10.395 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:15:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:15:10.417 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:15:10.417 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:10.417 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T20:15:10.417 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:10.462 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:15:10.485 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:15:10.485 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:10.485 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T20:15:10.485 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:15:10.485 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:15:10.485 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:10.560 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T20:15:10.610 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T20:15:10.638 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:15:10.725 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:15:10.748 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:15:10.788 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:15:10.810 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:15:10.811 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:15:10.811 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:10.811 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T20:15:10.811 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:15:10.811 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:15:10.811 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:10.833 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:15:10.853 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:15:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:15:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:15:11.189 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T20:15:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T20:15:11.314 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T20:15:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T20:15:11.412 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T20:15:11.448 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T20:15:11.491 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T20:15:11.524 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T20:15:11.552 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T20:15:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T20:15:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T20:15:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T20:15:11.748 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T20:15:11.824 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T20:15:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T20:15:11.902 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T20:15:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T20:15:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T20:15:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T20:15:12.119 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T20:15:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T20:15:12.306 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T20:15:12.823 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T20:15:12.919 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T20:15:12.948 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T20:15:12.991 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T20:15:13.029 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T20:15:13.070 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T20:15:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T20:15:13.282 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T20:15:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T20:15:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T20:15:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T20:15:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T20:15:13.524 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T20:15:13.560 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T20:15:13.603 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T20:15:13.645 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T20:15:13.780 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T20:15:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T20:15:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T20:15:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T20:15:13.992 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T20:15:14.031 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T20:15:14.071 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T20:15:14.105 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T20:15:14.130 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T20:15:14.203 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T20:15:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T20:15:14.297 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T20:15:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T20:15:14.338 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T20:15:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T20:15:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T20:15:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T20:15:14.398 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T20:15:14.433 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T20:15:14.472 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T20:15:14.503 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T20:15:14.533 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T20:15:14.568 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T20:15:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T20:15:14.601 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T20:15:14.635 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T20:15:14.642 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T20:15:14.656 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T20:15:14.678 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T20:15:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T20:15:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T20:15:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T20:15:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T20:15:14.985 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T20:15:15.040 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T20:15:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:15:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:15:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:15:15.400 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T20:15:15.441 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T20:15:15.491 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T20:15:15.522 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T20:15:15.551 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T20:15:15.733 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T20:15:15.757 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T20:15:15.780 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T20:15:15.805 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T20:15:15.810 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T20:15:15.838 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T20:15:15.939 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T20:15:15.996 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T20:15:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T20:15:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T20:15:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T20:15:16.275 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T20:15:16.317 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T20:15:16.335 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:15:16.346 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T20:15:16.366 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:15:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:15:16.400 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T20:15:16.430 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T20:15:16.430 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:15:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T20:15:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:15:16.524 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T20:15:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:15:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:15:16.675 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:15:16.745 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:15:17.166 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T20:15:17.207 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T20:15:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T20:15:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T20:15:17.363 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T20:15:17.444 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T20:15:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T20:15:17.476 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:15:17.560 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:15:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:15:17.593 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:15:17.684 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:15:17.749 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:15:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T20:15:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T20:15:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T20:15:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T20:15:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T20:15:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:15:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:15:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T20:15:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T20:15:19.657 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T20:15:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:15:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:15:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T20:15:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:15:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:15:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:15:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T20:15:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T20:15:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T20:15:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T20:15:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T20:15:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T20:15:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T20:15:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T20:15:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T20:15:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T20:15:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T20:15:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T20:15:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T20:15:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T20:15:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T20:15:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T20:15:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T20:15:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T20:15:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T20:15:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T20:15:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T20:15:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T20:15:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T20:15:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T20:15:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T20:15:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T20:15:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T20:15:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T20:15:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T20:15:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:15:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T20:15:22.724 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:15:22.782 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:15:22.872 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:15:22.872 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T20:15:22.872 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T20:15:22.873 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:22.899 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:15:23.937 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T20:15:23.938 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T20:15:23.939 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T20:15:23.940 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T20:15:23.941 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T20:15:23.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T20:15:23.943 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T20:15:23.944 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T20:15:23.945 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T20:15:23.946 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T20:15:23.947 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T20:15:23.948 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T20:15:23.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T20:15:23.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:15:23.949 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T20:15:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:15:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:24.601 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-04-26T20:15:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T20:15:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T20:15:24.602 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-04-26T20:15:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T20:15:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T20:15:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T20:15:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T20:15:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T20:15:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T20:15:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T20:15:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T20:15:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T20:15:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T20:15:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T20:15:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T20:15:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T20:15:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T20:15:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T20:15:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T20:15:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T20:15:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T20:15:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T20:15:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T20:15:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T20:15:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T20:15:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T20:15:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T20:15:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T20:15:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T20:15:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T20:15:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T20:15:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T20:15:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T20:15:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T20:15:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T20:15:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T20:15:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T20:15:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T20:15:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T20:15:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T20:15:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T20:15:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T20:15:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T20:15:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T20:15:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T20:15:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T20:15:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T20:15:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T20:15:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T20:15:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T20:15:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T20:15:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T20:15:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T20:15:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T20:15:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:15:24.615 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-04-26T20:15:24.997 DEBUG:teuthology.parallel:result is None 2024-04-26T20:15:26.072 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:15:26.072 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:26.072 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-04-26T20:15:26.072 INFO:teuthology.orchestra.run.smithi080.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.073 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.073 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T20:15:26.073 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T20:15:26.073 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-04-26T20:15:26.073 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T20:15:26.073 INFO:teuthology.orchestra.run.smithi080.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T20:15:26.073 INFO:teuthology.orchestra.run.smithi080.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T20:15:26.073 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T20:15:26.073 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.073 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T20:15:26.075 INFO:teuthology.orchestra.run.smithi080.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T20:15:26.076 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T20:15:26.077 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T20:15:26.078 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T20:15:26.079 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T20:15:26.080 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T20:15:26.081 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T20:15:26.081 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T20:15:26.081 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T20:15:26.081 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T20:15:26.081 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T20:15:26.081 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T20:15:26.081 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T20:15:26.081 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T20:15:26.081 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T20:15:26.081 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T20:15:26.082 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T20:15:26.083 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T20:15:26.084 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.084 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.084 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:26.084 INFO:teuthology.orchestra.run.smithi080.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T20:15:26.084 INFO:teuthology.orchestra.run.smithi080.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T20:15:26.084 INFO:teuthology.orchestra.run.smithi080.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T20:15:26.084 INFO:teuthology.orchestra.run.smithi080.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T20:15:26.084 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T20:15:26.084 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T20:15:26.084 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T20:15:26.085 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T20:15:26.085 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-26T20:15:26.506 DEBUG:teuthology.parallel:result is None 2024-04-26T20:15:34.560 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:15:34.560 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-04-26T20:15:34.560 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-04-26T20:15:34.560 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-04-26T20:15:34.560 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-04-26T20:15:34.560 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-04-26T20:15:34.560 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-04-26T20:15:34.560 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-04-26T20:15:34.560 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:34.737 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:15:34.753 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:15:34.753 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:34.753 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T20:15:34.753 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:36.241 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:15:36.266 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:15:36.266 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:36.267 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T20:15:36.267 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:15:36.267 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:15:36.267 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:36.491 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:15:36.513 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:15:36.513 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:36.514 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T20:15:36.514 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:15:36.514 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:15:36.514 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:36.950 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:15:36.973 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:15:36.973 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:36.973 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T20:15:36.973 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:15:36.973 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:15:36.973 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:37.074 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T20:15:37.121 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T20:15:37.185 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T20:15:37.369 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T20:15:37.418 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T20:15:37.495 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T20:15:37.592 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:15:37.732 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:15:37.768 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T20:15:37.800 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T20:15:37.828 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T20:15:38.279 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:15:38.310 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:15:38.342 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T20:15:38.411 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T20:15:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:15:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:15:39.510 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:15:40.478 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:15:40.502 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:15:40.603 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:15:40.763 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T20:15:40.787 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:15:40.811 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:15:40.811 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:40.811 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T20:15:40.811 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:15:40.811 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:15:40.811 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:40.855 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:15:40.866 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:15:40.964 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T20:15:41.012 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T20:15:41.945 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T20:15:41.983 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:15:42.006 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:15:42.006 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:42.006 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T20:15:42.006 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:15:42.006 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:15:42.006 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:42.050 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:15:42.072 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:15:42.072 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:42.072 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T20:15:42.072 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:42.117 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:15:42.140 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:15:42.140 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:42.140 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T20:15:42.140 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:15:42.140 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:15:42.140 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:42.443 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:15:42.465 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:15:42.465 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:15:42.465 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T20:15:42.465 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:15:42.466 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:15:42.466 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:47.072 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T20:15:47.113 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T20:15:47.154 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T20:15:47.186 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T20:15:47.214 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T20:15:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T20:15:47.435 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T20:15:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T20:15:47.985 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:15:48.022 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:15:48.041 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:15:48.861 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T20:15:48.963 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T20:15:49.003 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T20:15:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T20:15:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T20:15:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:15:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:15:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:15:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:15:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:15:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:15:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:15:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T20:15:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T20:15:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T20:15:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T20:15:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T20:15:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T20:15:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T20:15:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:15:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:15:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T20:15:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T20:15:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T20:15:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T20:15:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T20:15:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T20:15:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T20:15:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T20:15:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T20:15:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T20:15:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T20:15:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:15:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T20:15:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T20:15:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T20:15:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T20:15:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T20:15:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T20:15:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T20:15:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T20:15:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:15:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T20:15:57.363 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:15:57.363 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:57.363 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-04-26T20:15:57.363 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.364 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.365 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T20:15:57.366 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T20:15:57.367 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T20:15:57.368 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T20:15:57.369 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T20:15:57.370 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T20:15:57.370 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T20:15:57.370 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T20:15:57.370 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.370 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.370 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.370 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T20:15:57.370 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T20:15:57.371 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T20:15:57.372 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T20:15:57.373 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T20:15:57.373 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T20:15:57.373 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T20:15:57.373 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T20:15:57.373 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T20:15:57.373 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T20:15:57.373 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T20:15:57.373 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T20:15:57.373 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T20:15:57.373 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T20:15:57.373 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T20:15:57.374 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.375 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:15:57.376 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T20:15:57.376 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T20:15:57.376 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T20:15:57.376 INFO:teuthology.orchestra.run.smithi098.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T20:15:57.376 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T20:15:57.376 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T20:15:57.376 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T20:15:57.376 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:15:57.377 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-04-26T20:15:57.774 DEBUG:teuthology.parallel:result is None 2024-04-26T20:15:57.775 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:15:58.168 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T20:15:58.195 INFO:teuthology.orchestra.run.smithi070.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T20:15:58.195 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T20:15:58.195 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T20:15:58.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:15:58.337 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T20:15:58.362 INFO:teuthology.orchestra.run.smithi080.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T20:15:58.362 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T20:15:58.362 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T20:15:58.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:15:58.511 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T20:15:58.534 INFO:teuthology.orchestra.run.smithi098.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T20:15:58.534 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T20:15:58.534 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T20:15:58.537 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T20:15:58.538 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:15:58.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:15:58.570 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T20:15:58.570 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:15:58.602 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T20:15:58.602 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:15:58.631 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T20:15:58.631 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:15:58.631 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:15:58.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:15:58.726 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T20:15:58.726 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:15:58.753 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:15:58.820 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T20:15:58.820 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:15:58.844 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:15:58.907 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T20:15:58.907 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:15:58.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:15:58.931 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:15:58.995 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T20:15:58.995 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:15:59.023 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:15:59.089 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T20:15:59.089 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:15:59.113 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:15:59.178 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T20:15:59.178 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:15:59.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:15:59.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:15:59.278 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T20:15:59.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:15:59.302 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:15:59.368 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T20:15:59.368 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:15:59.392 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:15:59.455 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-26T20:15:59.561 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-04-26T20:15:59.561 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:15:59.562 INFO:tasks.cephadm:Cluster fsid is cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:15:59.562 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-26T20:15:59.562 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.70', 'mon.b': '172.21.15.80', 'mon.c': '172.21.15.98'} 2024-04-26T20:15:59.562 INFO:tasks.cephadm:First mon is mon.a on smithi070 2024-04-26T20:15:59.563 INFO:tasks.cephadm:First mgr is x 2024-04-26T20:15:59.563 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-26T20:15:59.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname $(hostname -s) 2024-04-26T20:15:59.587 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname $(hostname -s) 2024-04-26T20:15:59.610 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname $(hostname -s) 2024-04-26T20:15:59.635 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-26T20:15:59.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:15:59.772 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78918/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3306-gbc612ffb', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3306.gbc612ffb'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-26 13:02:42.256491', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240426.111959', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-04-26T20:15:59.911 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240426.111959, sha1 bc612ffb9c1d5bc27536bc917a705262a36d4387 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:15:59.913 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/x86_64/flavors/default/cephadm 2024-04-26T20:15:59.913 DEBUG:teuthology.orchestra.run.smithi070:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T20:16:00.361 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r--. 1 ubuntu ubuntu 781514 Apr 26 20:16 /home/ubuntu/cephtest/cephadm 2024-04-26T20:16:00.362 DEBUG:teuthology.orchestra.run.smithi080:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T20:16:00.928 INFO:teuthology.orchestra.run.smithi080.stdout:-rw-r--r--. 1 ubuntu ubuntu 781514 Apr 26 20:16 /home/ubuntu/cephtest/cephadm 2024-04-26T20:16:00.929 DEBUG:teuthology.orchestra.run.smithi098:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T20:16:01.504 INFO:teuthology.orchestra.run.smithi098.stdout:-rw-r--r--. 1 ubuntu ubuntu 781514 Apr 26 20:16 /home/ubuntu/cephtest/cephadm 2024-04-26T20:16:01.504 DEBUG:teuthology.orchestra.run.smithi070:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T20:16:01.523 DEBUG:teuthology.orchestra.run.smithi080:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T20:16:01.541 DEBUG:teuthology.orchestra.run.smithi098:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T20:16:01.598 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 on all hosts... 2024-04-26T20:16:01.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 pull 2024-04-26T20:16:01.601 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 pull 2024-04-26T20:16:01.604 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 pull 2024-04-26T20:16:03.178 INFO:teuthology.orchestra.run.smithi070.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387... 2024-04-26T20:16:03.210 INFO:teuthology.orchestra.run.smithi098.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387... 2024-04-26T20:16:03.319 INFO:teuthology.orchestra.run.smithi080.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387... 2024-04-26T20:16:30.624 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T20:16:30.624 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T20:16:30.624 INFO:teuthology.orchestra.run.smithi098.stdout: "image_id": "55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07", 2024-04-26T20:16:30.624 INFO:teuthology.orchestra.run.smithi098.stdout: "repo_digests": [ 2024-04-26T20:16:30.624 INFO:teuthology.orchestra.run.smithi098.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2" 2024-04-26T20:16:30.624 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T20:16:30.624 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T20:16:56.374 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T20:16:56.374 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T20:16:56.374 INFO:teuthology.orchestra.run.smithi080.stdout: "image_id": "55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07", 2024-04-26T20:16:56.375 INFO:teuthology.orchestra.run.smithi080.stdout: "repo_digests": [ 2024-04-26T20:16:56.375 INFO:teuthology.orchestra.run.smithi080.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2" 2024-04-26T20:16:56.375 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T20:16:56.375 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T20:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T20:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "image_id": "55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07", 2024-04-26T20:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "repo_digests": [ 2024-04-26T20:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2" 2024-04-26T20:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:16:58.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph 2024-04-26T20:16:58.644 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph 2024-04-26T20:16:58.675 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph 2024-04-26T20:16:58.705 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /etc/ceph 2024-04-26T20:16:58.729 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /etc/ceph 2024-04-26T20:16:58.756 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /etc/ceph 2024-04-26T20:16:58.782 INFO:tasks.cephadm:Writing seed config... 2024-04-26T20:16:58.783 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-04-26T20:16:58.783 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-26T20:16:58.784 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-26T20:16:58.785 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-26T20:16:58.786 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-26T20:16:58.787 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-26T20:16:58.787 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-26T20:16:58.787 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-26T20:16:58.787 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-26T20:16:58.787 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-04-26T20:16:58.788 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:16:58.788 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-26T20:16:58.803 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = cc0136ee-0409-11ef-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-26T20:16:58.804 DEBUG:teuthology.orchestra.run.smithi070:mon.a> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.a.service 2024-04-26T20:16:58.846 DEBUG:teuthology.orchestra.run.smithi070:mgr.x> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.x.service 2024-04-26T20:16:58.890 INFO:tasks.cephadm:Bootstrapping... 2024-04-26T20:16:58.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 -v bootstrap --fsid cc0136ee-0409-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.70 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:16:59.081 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:16:59.081 INFO:teuthology.orchestra.run.smithi070.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387', '-v', 'bootstrap', '--fsid', 'cc0136ee-0409-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.70', '--skip-admin-label'] 2024-04-26T20:16:59.081 INFO:teuthology.orchestra.run.smithi070.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-26T20:16:59.082 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying podman|docker is present... 2024-04-26T20:16:59.106 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T20:16:59.106 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying lvm2 is present... 2024-04-26T20:16:59.106 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying time synchronization is in place... 2024-04-26T20:16:59.113 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T20:16:59.113 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T20:16:59.119 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T20:16:59.119 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-04-26T20:16:59.125 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2024-04-26T20:16:59.131 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2024-04-26T20:16:59.131 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2024-04-26T20:16:59.131 INFO:teuthology.orchestra.run.smithi070.stdout:Repeating the final host check... 2024-04-26T20:16:59.308 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T20:16:59.308 INFO:teuthology.orchestra.run.smithi070.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-26T20:16:59.308 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl is present 2024-04-26T20:16:59.308 INFO:teuthology.orchestra.run.smithi070.stdout:lvcreate is present 2024-04-26T20:16:59.314 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T20:16:59.315 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T20:16:59.321 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T20:16:59.321 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-04-26T20:16:59.327 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2024-04-26T20:16:59.333 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2024-04-26T20:16:59.333 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2024-04-26T20:16:59.333 INFO:teuthology.orchestra.run.smithi070.stdout:Host looks OK 2024-04-26T20:16:59.333 INFO:teuthology.orchestra.run.smithi070.stdout:Cluster fsid: cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:16:59.333 INFO:teuthology.orchestra.run.smithi070.stdout:Acquiring lock 140195840834720 on /run/cephadm/cc0136ee-0409-11ef-bc93-c7b262605968.lock 2024-04-26T20:16:59.333 INFO:teuthology.orchestra.run.smithi070.stdout:Lock 140195840834720 acquired on /run/cephadm/cc0136ee-0409-11ef-bc93-c7b262605968.lock 2024-04-26T20:16:59.334 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 3300 ... 2024-04-26T20:16:59.334 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 6789 ... 2024-04-26T20:16:59.334 INFO:teuthology.orchestra.run.smithi070.stdout:Base mon IP(s) is [172.21.15.70:3300, 172.21.15.70:6789], mon addrv is [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-04-26T20:16:59.337 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.70 metric 100 2024-04-26T20:16:59.337 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.70 metric 100 2024-04-26T20:16:59.340 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-26T20:16:59.340 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-04-26T20:16:59.340 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-04-26T20:16:59.342 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-26T20:16:59.342 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-26T20:16:59.342 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T20:16:59.342 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-26T20:16:59.342 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 fe80::2ea7:886d:22e:bb6f/64 scope link noprefixroute 2024-04-26T20:16:59.342 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T20:16:59.343 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2024-04-26T20:16:59.343 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2024-04-26T20:16:59.344 INFO:teuthology.orchestra.run.smithi070.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-26T20:16:59.344 INFO:teuthology.orchestra.run.smithi070.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-26T20:16:59.344 INFO:teuthology.orchestra.run.smithi070.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387... 2024-04-26T20:17:02.422 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 2024-04-26T20:17:02.422 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387... 2024-04-26T20:17:02.422 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Getting image source signatures 2024-04-26T20:17:02.422 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-26T20:17:02.422 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:f340d36a00bce3feed0ad509aeafc9092c1c625bf553b8a613c380a79149b87e 2024-04-26T20:17:02.422 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying config sha256:55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 2024-04-26T20:17:02.422 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-26T20:17:03.595 INFO:teuthology.orchestra.run.smithi070.stdout:ceph: stdout ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev) 2024-04-26T20:17:03.595 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph version: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev) 2024-04-26T20:17:03.595 INFO:teuthology.orchestra.run.smithi070.stdout:Extracting ceph user uid/gid from container image... 2024-04-26T20:17:04.561 INFO:teuthology.orchestra.run.smithi070.stdout:stat: stdout 167 167 2024-04-26T20:17:04.561 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial keys... 2024-04-26T20:17:05.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDACyxmN8DNNBAA8QYJ+lztoBSs95Vlv8fknw== 2024-04-26T20:17:06.416 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDBCyxmqA9HNBAA6Eoq64AsHkveWR/47Uyz3g== 2024-04-26T20:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDCCyxmFGFdLBAAd9ilfCVFhAtHkP8F61xH7w== 2024-04-26T20:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial monmap... 2024-04-26T20:17:10.376 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T20:17:10.376 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-26T20:17:10.376 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:17:10.376 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T20:17:10.376 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool for a [v2:172.21.15.70:3300,v1:172.21.15.70:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T20:17:10.376 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-04-26T20:17:10.376 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: set fsid to cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:17:10.377 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T20:17:10.377 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:17:10.377 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mon... 2024-04-26T20:17:11.315 INFO:teuthology.orchestra.run.smithi070.stdout:create mon.a on 2024-04-26T20:17:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-26T20:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-26T20:17:11.852 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-cc0136ee-0409-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-cc0136ee-0409-11ef-bc93-c7b262605968.target. 2024-04-26T20:17:11.853 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-cc0136ee-0409-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-cc0136ee-0409-11ef-bc93-c7b262605968.target. 2024-04-26T20:17:12.063 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.a 2024-04-26T20:17:12.063 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-26T20:17:12.221 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-cc0136ee-0409-11ef-bc93-c7b262605968.target.wants/ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-cc0136ee-0409-11ef-bc93-c7b262605968@.service. 2024-04-26T20:17:12.782 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:17:12.782 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-04-26T20:17:12.788 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:17:12.789 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-04-26T20:17:12.789 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-04-26T20:17:12.789 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T20:17:12.789 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon to start... 2024-04-26T20:17:12.789 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon... 2024-04-26T20:17:13.870 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout cluster: 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout id: cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout services: 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.606782s) 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout data: 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-26T20:17:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pgs: 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.245+0000 7fee788ea700 1 Processor -- start 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.245+0000 7fee788ea700 1 -- start start 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.246+0000 7fee788ea700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee741092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.246+0000 7fee788ea700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fee74109820 con 0x7fee74108ec0 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.246+0000 7fee7259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee741092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.246+0000 7fee7259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee741092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43204/0 (socket says 172.21.15.70:43204) 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.246+0000 7fee7259c700 1 -- 172.21.15.70:0/1955067316 learned_addr learned my addr 172.21.15.70:0/1955067316 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.246+0000 7fee7259c700 1 -- 172.21.15.70:0/1955067316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7410a060 con 0x7fee74108ec0 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.246+0000 7fee7259c700 1 --2- 172.21.15.70:0/1955067316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee741092e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fee680098a0 tx=0x7fee68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92e95c35e1d2027 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:13.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.246+0000 7fee7159a700 1 -- 172.21.15.70:0/1955067316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee68004160 con 0x7fee74108ec0 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.246+0000 7fee7159a700 1 -- 172.21.15.70:0/1955067316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee68004300 con 0x7fee74108ec0 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.247+0000 7fee7159a700 1 -- 172.21.15.70:0/1955067316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee680036a0 con 0x7fee74108ec0 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.247+0000 7fee788ea700 1 -- 172.21.15.70:0/1955067316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 msgr2=0x7fee741092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.247+0000 7fee788ea700 1 --2- 172.21.15.70:0/1955067316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee741092e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fee680098a0 tx=0x7fee68009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.247+0000 7fee788ea700 1 -- 172.21.15.70:0/1955067316 shutdown_connections 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.247+0000 7fee788ea700 1 --2- 172.21.15.70:0/1955067316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee741092e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.247+0000 7fee788ea700 1 -- 172.21.15.70:0/1955067316 >> 172.21.15.70:0/1955067316 conn(0x7fee741044f0 msgr2=0x7fee74106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.247+0000 7fee788ea700 1 -- 172.21.15.70:0/1955067316 shutdown_connections 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.247+0000 7fee788ea700 1 -- 172.21.15.70:0/1955067316 wait complete. 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.248+0000 7fee788ea700 1 Processor -- start 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.248+0000 7fee788ea700 1 -- start start 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.248+0000 7fee788ea700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee7407f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.248+0000 7fee788ea700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fee7410a530 con 0x7fee74108ec0 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.248+0000 7fee7259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee7407f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.248+0000 7fee7259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee7407f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43216/0 (socket says 172.21.15.70:43216) 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.248+0000 7fee7259c700 1 -- 172.21.15.70:0/3667790831 learned_addr learned my addr 172.21.15.70:0/3667790831 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.248+0000 7fee7259c700 1 -- 172.21.15.70:0/3667790831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7407f930 con 0x7fee74108ec0 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.249+0000 7fee7259c700 1 --2- 172.21.15.70:0/3667790831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee7407f3f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fee68000c00 tx=0x7fee68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.249+0000 7fee637fe700 1 -- 172.21.15.70:0/3667790831 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee68003db0 con 0x7fee74108ec0 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.249+0000 7fee637fe700 1 -- 172.21.15.70:0/3667790831 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee68011630 con 0x7fee74108ec0 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.249+0000 7fee788ea700 1 -- 172.21.15.70:0/3667790831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7407db20 con 0x7fee74108ec0 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.249+0000 7fee637fe700 1 -- 172.21.15.70:0/3667790831 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee68011950 con 0x7fee74108ec0 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.249+0000 7fee788ea700 1 -- 172.21.15.70:0/3667790831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7407e060 con 0x7fee74108ec0 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.249+0000 7fee637fe700 1 -- 172.21.15.70:0/3667790831 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee6801a460 con 0x7fee74108ec0 2024-04-26T20:17:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.249+0000 7fee637fe700 1 -- 172.21.15.70:0/3667790831 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fee6801b780 con 0x7fee74108ec0 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.250+0000 7fee788ea700 1 -- 172.21.15.70:0/3667790831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee74064a80 con 0x7fee74108ec0 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.252+0000 7fee637fe700 1 -- 172.21.15.70:0/3667790831 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fee68031020 con 0x7fee74108ec0 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.323+0000 7fee788ea700 1 -- 172.21.15.70:0/3667790831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fee74195ec0 con 0x7fee74108ec0 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.323+0000 7fee637fe700 1 -- 172.21.15.70:0/3667790831 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fee6801b9d0 con 0x7fee74108ec0 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.324+0000 7fee788ea700 1 -- 172.21.15.70:0/3667790831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 msgr2=0x7fee7407f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.324+0000 7fee788ea700 1 --2- 172.21.15.70:0/3667790831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee7407f3f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fee68000c00 tx=0x7fee68004750 comp rx=0 tx=0).stop 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.324+0000 7fee788ea700 1 -- 172.21.15.70:0/3667790831 shutdown_connections 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.324+0000 7fee788ea700 1 --2- 172.21.15.70:0/3667790831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee74108ec0 0x7fee7407f3f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.324+0000 7fee788ea700 1 -- 172.21.15.70:0/3667790831 >> 172.21.15.70:0/3667790831 conn(0x7fee741044f0 msgr2=0x7fee74193200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.324+0000 7fee788ea700 1 -- 172.21.15.70:0/3667790831 shutdown_connections 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:13.324+0000 7fee788ea700 1 -- 172.21.15.70:0/3667790831 wait complete. 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:mon is available 2024-04-26T20:17:13.875 INFO:teuthology.orchestra.run.smithi070.stdout:Assimilating anything we can from ceph.conf... 2024-04-26T20:17:14.954 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:14 smithi070 ceph-mon[28753]: from='client.? 172.21.15.70:0/4097332103' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-26T20:17:14.965 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:14.966 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T20:17:14.966 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:17:14.966 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-26T20:17:14.966 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-04-26T20:17:14.966 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T20:17:14.966 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T20:17:14.966 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T20:17:14.966 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T20:17:14.966 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:14.966 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.295+0000 7f4616941700 1 Processor -- start 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.295+0000 7f4616941700 1 -- start start 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.295+0000 7f4616941700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461010bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.295+0000 7f4616941700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f461007d6d0 con 0x7f46101099a0 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.295+0000 7f460ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461010bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.295+0000 7f460ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461010bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43224/0 (socket says 172.21.15.70:43224) 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.295+0000 7f460ffff700 1 -- 172.21.15.70:0/3560130489 learned_addr learned my addr 172.21.15.70:0/3560130489 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.295+0000 7f460ffff700 1 -- 172.21.15.70:0/3560130489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461010c2d0 con 0x7f46101099a0 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.295+0000 7f460ffff700 1 --2- 172.21.15.70:0/3560130489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461010bd90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f46040098a0 tx=0x7f4604009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e723716573497711 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.295+0000 7f460effd700 1 -- 172.21.15.70:0/3560130489 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4604004160 con 0x7f46101099a0 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.296+0000 7f460effd700 1 -- 172.21.15.70:0/3560130489 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4604004300 con 0x7f46101099a0 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.296+0000 7f460effd700 1 -- 172.21.15.70:0/3560130489 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46040036a0 con 0x7f46101099a0 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.296+0000 7f4616941700 1 -- 172.21.15.70:0/3560130489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 msgr2=0x7f461010bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.296+0000 7f4616941700 1 --2- 172.21.15.70:0/3560130489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461010bd90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f46040098a0 tx=0x7f4604009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.296+0000 7f4616941700 1 -- 172.21.15.70:0/3560130489 shutdown_connections 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.296+0000 7f4616941700 1 --2- 172.21.15.70:0/3560130489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461010bd90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.296+0000 7f4616941700 1 -- 172.21.15.70:0/3560130489 >> 172.21.15.70:0/3560130489 conn(0x7f4610103350 msgr2=0x7f46101057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:14.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.296+0000 7f4616941700 1 -- 172.21.15.70:0/3560130489 shutdown_connections 2024-04-26T20:17:14.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.296+0000 7f4616941700 1 -- 172.21.15.70:0/3560130489 wait complete. 2024-04-26T20:17:14.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.297+0000 7f4616941700 1 Processor -- start 2024-04-26T20:17:14.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.297+0000 7f4616941700 1 -- start start 2024-04-26T20:17:14.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.297+0000 7f4616941700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:14.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.297+0000 7f4616941700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f461010c740 con 0x7f46101099a0 2024-04-26T20:17:14.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.297+0000 7f460ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:14.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.297+0000 7f460ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461019c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43238/0 (socket says 172.21.15.70:43238) 2024-04-26T20:17:14.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.297+0000 7f460ffff700 1 -- 172.21.15.70:0/4097332103 learned_addr learned my addr 172.21.15.70:0/4097332103 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:14.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.297+0000 7f460ffff700 1 -- 172.21.15.70:0/4097332103 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461019cb50 con 0x7f46101099a0 2024-04-26T20:17:14.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.298+0000 7f460ffff700 1 --2- 172.21.15.70:0/4097332103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461019c610 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4604000c00 tx=0x7f4604004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:14.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.298+0000 7f460d7fa700 1 -- 172.21.15.70:0/4097332103 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4604003db0 con 0x7f46101099a0 2024-04-26T20:17:14.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.298+0000 7f460d7fa700 1 -- 172.21.15.70:0/4097332103 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4604011630 con 0x7f46101099a0 2024-04-26T20:17:14.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.298+0000 7f460d7fa700 1 -- 172.21.15.70:0/4097332103 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4604011950 con 0x7f46101099a0 2024-04-26T20:17:14.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.298+0000 7f4616941700 1 -- 172.21.15.70:0/4097332103 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461019cde0 con 0x7f46101099a0 2024-04-26T20:17:14.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.298+0000 7f4616941700 1 -- 172.21.15.70:0/4097332103 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461019fad0 con 0x7f46101099a0 2024-04-26T20:17:14.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.298+0000 7f460d7fa700 1 -- 172.21.15.70:0/4097332103 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f460401a460 con 0x7f46101099a0 2024-04-26T20:17:14.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.298+0000 7f460d7fa700 1 -- 172.21.15.70:0/4097332103 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f460401b780 con 0x7f46101099a0 2024-04-26T20:17:14.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.299+0000 7f4616941700 1 -- 172.21.15.70:0/4097332103 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4610064a80 con 0x7f46101099a0 2024-04-26T20:17:14.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.301+0000 7f460d7fa700 1 -- 172.21.15.70:0/4097332103 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f460401b980 con 0x7f46101099a0 2024-04-26T20:17:14.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.368+0000 7f4616941700 1 -- 172.21.15.70:0/4097332103 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f461002e790 con 0x7f46101099a0 2024-04-26T20:17:14.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.371+0000 7f460d7fa700 1 -- 172.21.15.70:0/4097332103 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f460401bb60 con 0x7f46101099a0 2024-04-26T20:17:14.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.372+0000 7f460d7fa700 1 -- 172.21.15.70:0/4097332103 <== mon.0 v2:172.21.15.70:3300/0 8 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f460401bd40 con 0x7f46101099a0 2024-04-26T20:17:14.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.372+0000 7f4616941700 1 -- 172.21.15.70:0/4097332103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 msgr2=0x7f461019c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:14.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.372+0000 7f4616941700 1 --2- 172.21.15.70:0/4097332103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461019c610 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4604000c00 tx=0x7f4604004750 comp rx=0 tx=0).stop 2024-04-26T20:17:14.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.372+0000 7f4616941700 1 -- 172.21.15.70:0/4097332103 shutdown_connections 2024-04-26T20:17:14.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.372+0000 7f4616941700 1 --2- 172.21.15.70:0/4097332103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46101099a0 0x7f461019c610 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.372+0000 7f4616941700 1 -- 172.21.15.70:0/4097332103 >> 172.21.15.70:0/4097332103 conn(0x7f4610103350 msgr2=0x7f4610105660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:14.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.373+0000 7f4616941700 1 -- 172.21.15.70:0/4097332103 shutdown_connections 2024-04-26T20:17:14.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:14.373+0000 7f4616941700 1 -- 172.21.15.70:0/4097332103 wait complete. 2024-04-26T20:17:14.972 INFO:teuthology.orchestra.run.smithi070.stdout:Generating new minimal ceph.conf... 2024-04-26T20:17:15.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:15 smithi070 ceph-mon[28753]: from='client.? 172.21.15.70:0/2404411760' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.401+0000 7f3f48692700 1 Processor -- start 2024-04-26T20:17:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.401+0000 7f3f48692700 1 -- start start 2024-04-26T20:17:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.402+0000 7f3f48692700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f401092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.402+0000 7f3f48692700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f40109820 con 0x7f3f40108ec0 2024-04-26T20:17:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.402+0000 7f3f4642e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f401092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.402+0000 7f3f4642e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f401092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43240/0 (socket says 172.21.15.70:43240) 2024-04-26T20:17:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.402+0000 7f3f4642e700 1 -- 172.21.15.70:0/2346587753 learned_addr learned my addr 172.21.15.70:0/2346587753 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.402+0000 7f3f4642e700 1 -- 172.21.15.70:0/2346587753 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4010a060 con 0x7f3f40108ec0 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.403+0000 7f3f4642e700 1 --2- 172.21.15.70:0/2346587753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f401092e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009e80 tx=0x7f3f3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc09921ac08be178 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.403+0000 7f3f4542c700 1 -- 172.21.15.70:0/2346587753 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38017070 con 0x7f3f40108ec0 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.403+0000 7f3f4542c700 1 -- 172.21.15.70:0/2346587753 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f3f3800b8c0 con 0x7f3f40108ec0 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.403+0000 7f3f4542c700 1 -- 172.21.15.70:0/2346587753 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f380045c0 con 0x7f3f40108ec0 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.403+0000 7f3f48692700 1 -- 172.21.15.70:0/2346587753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 msgr2=0x7f3f401092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.403+0000 7f3f48692700 1 --2- 172.21.15.70:0/2346587753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f401092e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009e80 tx=0x7f3f3800b330 comp rx=0 tx=0).stop 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.403+0000 7f3f48692700 1 -- 172.21.15.70:0/2346587753 shutdown_connections 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.403+0000 7f3f48692700 1 --2- 172.21.15.70:0/2346587753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f401092e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.403+0000 7f3f48692700 1 -- 172.21.15.70:0/2346587753 >> 172.21.15.70:0/2346587753 conn(0x7f3f401044f0 msgr2=0x7f3f40106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.403+0000 7f3f48692700 1 -- 172.21.15.70:0/2346587753 shutdown_connections 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.403+0000 7f3f48692700 1 -- 172.21.15.70:0/2346587753 wait complete. 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.404+0000 7f3f48692700 1 Processor -- start 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.404+0000 7f3f48692700 1 -- start start 2024-04-26T20:17:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.404+0000 7f3f48692700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f4019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.404+0000 7f3f48692700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4010d320 con 0x7f3f40108ec0 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.404+0000 7f3f4642e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f4019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.404+0000 7f3f4642e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f4019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43244/0 (socket says 172.21.15.70:43244) 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.404+0000 7f3f4642e700 1 -- 172.21.15.70:0/2404411760 learned_addr learned my addr 172.21.15.70:0/2404411760 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.405+0000 7f3f4642e700 1 -- 172.21.15.70:0/2404411760 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4019d390 con 0x7f3f40108ec0 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.405+0000 7f3f4642e700 1 --2- 172.21.15.70:0/2404411760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f4019ce50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009e50 tx=0x7f3f3800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.405+0000 7f3f3f7fe700 1 -- 172.21.15.70:0/2404411760 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38017070 con 0x7f3f40108ec0 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.405+0000 7f3f3f7fe700 1 -- 172.21.15.70:0/2404411760 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f3f38022070 con 0x7f3f40108ec0 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.405+0000 7f3f48692700 1 -- 172.21.15.70:0/2404411760 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4019d620 con 0x7f3f40108ec0 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.405+0000 7f3f3f7fe700 1 -- 172.21.15.70:0/2404411760 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3801d690 con 0x7f3f40108ec0 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.405+0000 7f3f48692700 1 -- 172.21.15.70:0/2404411760 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f401a0310 con 0x7f3f40108ec0 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.405+0000 7f3f3f7fe700 1 -- 172.21.15.70:0/2404411760 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3f3801d900 con 0x7f3f40108ec0 2024-04-26T20:17:16.245 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.405+0000 7f3f3f7fe700 1 -- 172.21.15.70:0/2404411760 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3f3800f050 con 0x7f3f40108ec0 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.406+0000 7f3f48692700 1 -- 172.21.15.70:0/2404411760 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4010d4a0 con 0x7f3f40108ec0 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.408+0000 7f3f3f7fe700 1 -- 172.21.15.70:0/2404411760 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3f38003d60 con 0x7f3f40108ec0 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.475+0000 7f3f48692700 1 -- 172.21.15.70:0/2404411760 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f3f40064a80 con 0x7f3f40108ec0 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.475+0000 7f3f3f7fe700 1 -- 172.21.15.70:0/2404411760 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f3f38027460 con 0x7f3f40108ec0 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.476+0000 7f3f48692700 1 -- 172.21.15.70:0/2404411760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 msgr2=0x7f3f4019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.476+0000 7f3f48692700 1 --2- 172.21.15.70:0/2404411760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f4019ce50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009e50 tx=0x7f3f3800bd50 comp rx=0 tx=0).stop 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.476+0000 7f3f48692700 1 -- 172.21.15.70:0/2404411760 shutdown_connections 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.476+0000 7f3f48692700 1 --2- 172.21.15.70:0/2404411760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f40108ec0 0x7f3f4019ce50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.476+0000 7f3f48692700 1 -- 172.21.15.70:0/2404411760 >> 172.21.15.70:0/2404411760 conn(0x7f3f401044f0 msgr2=0x7f3f40104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.476+0000 7f3f48692700 1 -- 172.21.15.70:0/2404411760 shutdown_connections 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:15.476+0000 7f3f48692700 1 -- 172.21.15.70:0/2404411760 wait complete. 2024-04-26T20:17:16.246 INFO:teuthology.orchestra.run.smithi070.stdout:Restarting the monitor... 2024-04-26T20:17:16.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:16 smithi070 systemd[1]: Stopping Ceph mon.a for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:17:16.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:16 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a[28749]: 2024-04-26T20:17:16.520+0000 7f6fb4f8c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:17:16.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:16 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a[28749]: 2024-04-26T20:17:16.520+0000 7f6fb4f8c700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-26T20:17:16.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:16 smithi070 podman[28998]: 2024-04-26 20:17:16.685600634 +0000 UTC m=+0.275259282 container died 9529e6675e917212e5fabe86f27eb10d750c49f1504fd022ec1745ceb949529a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-26T20:17:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 podman[28998]: 2024-04-26 20:17:17.046627621 +0000 UTC m=+0.636286252 container cleanup 9529e6675e917212e5fabe86f27eb10d750c49f1504fd022ec1745ceb949529a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:17:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 bash[28998]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a 2024-04-26T20:17:17.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 podman[29012]: 2024-04-26 20:17:17.29743062 +0000 UTC m=+0.608614725 container remove 9529e6675e917212e5fabe86f27eb10d750c49f1504fd022ec1745ceb949529a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:17:17.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 systemd[1]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-26T20:17:17.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 systemd[1]: Stopped Ceph mon.a for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:17:17.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 systemd[1]: Starting Ceph mon.a for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:17:17.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 podman[29104]: 2024-04-26 20:17:17.640048695 +0000 UTC m=+0.085384886 container create add84205b42ce68c4672f0303eaf68c11c16d818f5d0887cdd7c970fd225e35a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:17:17.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 podman[29104]: 2024-04-26 20:17:17.572942393 +0000 UTC m=+0.018278603 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:17:17.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 podman[29104]: 2024-04-26 20:17:17.859161374 +0000 UTC m=+0.304497567 container init add84205b42ce68c4672f0303eaf68c11c16d818f5d0887cdd7c970fd225e35a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-26T20:17:17.939 INFO:teuthology.orchestra.run.smithi070.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-26T20:17:18.189 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 podman[29104]: 2024-04-26 20:17:17.861983346 +0000 UTC m=+0.307319541 container start add84205b42ce68c4672f0303eaf68c11c16d818f5d0887cdd7c970fd225e35a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True) 2024-04-26T20:17:18.189 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T20:17:18.189 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev), process ceph-mon, pid 2 2024-04-26T20:17:18.189 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: pidfile_write: ignore empty --pid-file 2024-04-26T20:17:18.189 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: load: jerasure load: lrc 2024-04-26T20:17:18.189 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: RocksDB version: 7.9.2 2024-04-26T20:17:18.189 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Git sha 0 2024-04-26T20:17:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Compile date 2024-04-26 11:39:23 2024-04-26T20:17:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: DB SUMMARY 2024-04-26T20:17:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: DB Session ID: P78PRY383LRVGIBUYH0Q 2024-04-26T20:17:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: CURRENT file: CURRENT 2024-04-26T20:17:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T20:17:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-26T20:17:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-26T20:17:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105020 ; 2024-04-26T20:17:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.error_if_exists: 0 2024-04-26T20:17:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.create_if_missing: 0 2024-04-26T20:17:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.paranoid_checks: 1 2024-04-26T20:17:18.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T20:17:18.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T20:17:18.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T20:17:18.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.env: 0x564fdedc7cc0 2024-04-26T20:17:18.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T20:17:18.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.info_log: 0x564fe0875d80 2024-04-26T20:17:18.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T20:17:18.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.statistics: (nil) 2024-04-26T20:17:18.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.use_fsync: 0 2024-04-26T20:17:18.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_log_file_size: 0 2024-04-26T20:17:18.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T20:17:18.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T20:17:18.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T20:17:18.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T20:17:18.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.allow_fallocate: 1 2024-04-26T20:17:18.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T20:17:18.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T20:17:18.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.use_direct_reads: 0 2024-04-26T20:17:18.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T20:17:18.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T20:17:18.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.db_log_dir: 2024-04-26T20:17:18.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.wal_dir: 2024-04-26T20:17:18.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T20:17:18.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T20:17:18.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T20:17:18.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T20:17:18.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T20:17:18.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T20:17:18.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.write_buffer_manager: 0x564fe08470e0 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.unordered_write: 0 2024-04-26T20:17:18.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.row_cache: None 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.wal_filter: None 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.two_write_queues: 0 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.wal_compression: 0 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.atomic_flush: 0 2024-04-26T20:17:18.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T20:17:18.196 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T20:17:18.196 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T20:17:18.197 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.log_readahead_size: 0 2024-04-26T20:17:18.197 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T20:17:18.197 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T20:17:18.197 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T20:17:18.197 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T20:17:18.197 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T20:17:18.197 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T20:17:18.198 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T20:17:18.198 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_background_jobs: 2 2024-04-26T20:17:18.198 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_background_compactions: -1 2024-04-26T20:17:18.198 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_subcompactions: 1 2024-04-26T20:17:18.198 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T20:17:18.198 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T20:17:18.198 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T20:17:18.198 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T20:17:18.198 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T20:17:18.198 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T20:17:18.199 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T20:17:18.199 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T20:17:18.199 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_open_files: -1 2024-04-26T20:17:18.199 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T20:17:18.199 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T20:17:18.199 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T20:17:18.199 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T20:17:18.199 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_background_flushes: -1 2024-04-26T20:17:18.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Compression algorithms supported: 2024-04-26T20:17:18.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T20:17:18.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: kZSTD supported: 0 2024-04-26T20:17:18.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: kXpressCompression supported: 0 2024-04-26T20:17:18.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T20:17:18.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: kZlibCompression supported: 1 2024-04-26T20:17:18.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: kSnappyCompression supported: 1 2024-04-26T20:17:18.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: kLZ4Compression supported: 1 2024-04-26T20:17:18.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: kBZip2Compression supported: 0 2024-04-26T20:17:18.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T20:17:18.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.merge_operator: 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_filter: None 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564fe0875f40) 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks: 1 2024-04-26T20:17:18.201 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T20:17:18.202 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T20:17:18.202 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_top_level_index_and_filter: 1 2024-04-26T20:17:18.202 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_type: 0 2024-04-26T20:17:18.202 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_index_type: 0 2024-04-26T20:17:18.202 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_shortening: 1 2024-04-26T20:17:18.202 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T20:17:18.202 INFO:journalctl@ceph.mon.a.smithi070.stdout: checksum: 4 2024-04-26T20:17:18.202 INFO:journalctl@ceph.mon.a.smithi070.stdout: no_block_cache: 0 2024-04-26T20:17:18.202 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache: 0x564fe08791f0 2024-04-26T20:17:18.202 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_name: BinnedLRUCache 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_options: 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: capacity : 536870912 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_shard_bits : 4 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: strict_capacity_limit : 0 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: high_pri_pool_ratio: 0.000 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_compressed: (nil) 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: persistent_cache: (nil) 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size: 4096 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size_deviation: 10 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_restart_interval: 16 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_block_restart_interval: 1 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: metadata_block_size: 4096 2024-04-26T20:17:18.203 INFO:journalctl@ceph.mon.a.smithi070.stdout: partition_filters: 0 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: use_delta_encoding: 1 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: filter_policy: bloomfilter 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: whole_key_filtering: 1 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: verify_compression: 0 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: read_amp_bytes_per_bit: 0 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: format_version: 5 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_index_compression: 1 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_align: 0 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: max_auto_readahead_size: 262144 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: prepopulate_block_cache: 0 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: initial_auto_readahead_size: 8192 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T20:17:18.204 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compression: NoCompression 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.num_levels: 7 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T20:17:18.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:17:18.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T20:17:18.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T20:17:18.208 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T20:17:18.208 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T20:17:18.208 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T20:17:18.208 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T20:17:18.208 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T20:17:18.208 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T20:17:18.208 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T20:17:18.208 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T20:17:18.208 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T20:17:18.208 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T20:17:18.208 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T20:17:18.209 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T20:17:18.209 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T20:17:18.209 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T20:17:18.209 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T20:17:18.209 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T20:17:18.209 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T20:17:18.209 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T20:17:18.209 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T20:17:18.209 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T20:17:18.210 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T20:17:18.210 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T20:17:18.210 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.inplace_update_support: 0 2024-04-26T20:17:18.210 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T20:17:18.210 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T20:17:18.210 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T20:17:18.210 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T20:17:18.210 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.bloom_locality: 0 2024-04-26T20:17:18.210 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.max_successive_merges: 0 2024-04-26T20:17:18.213 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T20:17:18.213 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T20:17:18.213 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T20:17:18.213 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T20:17:18.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.ttl: 2592000 2024-04-26T20:17:18.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T20:17:18.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T20:17:18.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T20:17:18.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.enable_blob_files: false 2024-04-26T20:17:18.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.min_blob_size: 0 2024-04-26T20:17:18.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T20:17:18.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T20:17:18.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T20:17:18.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T20:17:18.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T20:17:18.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T20:17:18.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T20:17:18.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T20:17:18.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-26T20:17:18.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-26T20:17:18.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c6c5bf1c-451d-405b-a378-571a88ad5e1a 2024-04-26T20:17:18.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162637890726, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-26T20:17:18.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-26T20:17:18.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162637891695, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100183, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 98065, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14155, "raw_average_key_size": 49, "raw_value_size": 90370, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714162637, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c6c5bf1c-451d-405b-a378-571a88ad5e1a", "db_session_id": "P78PRY383LRVGIBUYH0Q", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-26T20:17:18.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162637891779, "job": 1, "event": "recovery_finished"} 2024-04-26T20:17:18.216 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-26T20:17:18.216 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T20:17:18.216 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564fe0996000 2024-04-26T20:17:18.216 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: DB pointer 0x564fe0982000 2024-04-26T20:17:18.216 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T20:17:18.216 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T20:17:18.216 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** DB Stats ** 2024-04-26T20:17:18.216 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:17:18.217 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T20:17:18.217 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:17:18.217 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:17:18.217 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T20:17:18.217 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:17:18.217 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:17:18.217 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-04-26T20:17:18.217 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2024-04-26T20:17:18.217 INFO:journalctl@ceph.mon.a.smithi070.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:17:18.217 INFO:journalctl@ceph.mon.a.smithi070.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T20:17:18.217 INFO:journalctl@ceph.mon.a.smithi070.stdout: L0 2/0 99.70 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:17:18.218 INFO:journalctl@ceph.mon.a.smithi070.stdout: Sum 2/0 99.70 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:17:18.218 INFO:journalctl@ceph.mon.a.smithi070.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:17:18.218 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-04-26T20:17:18.218 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2024-04-26T20:17:18.218 INFO:journalctl@ceph.mon.a.smithi070.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:17:18.218 INFO:journalctl@ceph.mon.a.smithi070.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T20:17:18.218 INFO:journalctl@ceph.mon.a.smithi070.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 161.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:17:18.218 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-04-26T20:17:18.218 INFO:journalctl@ceph.mon.a.smithi070.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T20:17:18.219 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-04-26T20:17:18.219 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:17:18.219 INFO:journalctl@ceph.mon.a.smithi070.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T20:17:18.219 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T20:17:18.219 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T20:17:18.219 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T20:17:18.219 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T20:17:18.219 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative compaction: 0.00 GB write, 32.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:17:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval compaction: 0.00 GB write, 32.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:17:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T20:17:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache BinnedLRUCache@0x564fe08791f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-04-26T20:17:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-26T20:17:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-04-26T20:17:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T20:17:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: starting mon.a rank 0 at public addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] at bind addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:17:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: mon.a@-1(???) e1 preinit fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:17:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: mon.a@-1(???).mds e1 new map 2024-04-26T20:17:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: mon.a@-1(???).mds e1 print_map 2024-04-26T20:17:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout: e1 2024-04-26T20:17:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T20:17:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T20:17:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout: legacy client fscid: -1 2024-04-26T20:17:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-04-26T20:17:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout: No filesystems configured 2024-04-26T20:17:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T20:17:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:17:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:17:18.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:17:18.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 ceph-mon[29124]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-26T20:17:18.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 bash[29104]: add84205b42ce68c4672f0303eaf68c11c16d818f5d0887cdd7c970fd225e35a 2024-04-26T20:17:18.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:17 smithi070 systemd[1]: Started Ceph mon.a for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:17:19.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T20:17:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: monmap epoch 1 2024-04-26T20:17:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:17:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: last_changed 2024-04-26T20:17:07.726728+0000 2024-04-26T20:17:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: created 2024-04-26T20:17:07.726728+0000 2024-04-26T20:17:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: min_mon_release 19 (squid) 2024-04-26T20:17:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: election_strategy: 1 2024-04-26T20:17:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-04-26T20:17:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: fsmap 2024-04-26T20:17:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T20:17:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: mgrmap e1: no daemons active 2024-04-26T20:17:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:18 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1003947025' entity='client.admin' 2024-04-26T20:17:19.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.397+0000 7f06dc26a700 1 Processor -- start 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.397+0000 7f06dc26a700 1 -- start start 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.397+0000 7f06dc26a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d410bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.397+0000 7f06dc26a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06d407d6d0 con 0x7f06d41099a0 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.398+0000 7f06da006700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d410bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.398+0000 7f06da006700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d410bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43248/0 (socket says 172.21.15.70:43248) 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.398+0000 7f06da006700 1 -- 172.21.15.70:0/3334947155 learned_addr learned my addr 172.21.15.70:0/3334947155 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.398+0000 7f06da006700 1 -- 172.21.15.70:0/3334947155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d410c2d0 con 0x7f06d41099a0 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.398+0000 7f06da006700 1 --2- 172.21.15.70:0/3334947155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d410bd90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f06d00098a0 tx=0x7f06d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f466fc925907c6ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.398+0000 7f06d9004700 1 -- 172.21.15.70:0/3334947155 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d0004160 con 0x7f06d41099a0 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.398+0000 7f06d9004700 1 -- 172.21.15.70:0/3334947155 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f06d0004300 con 0x7f06d41099a0 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.398+0000 7f06d9004700 1 -- 172.21.15.70:0/3334947155 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d0011b20 con 0x7f06d41099a0 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.399+0000 7f06dc26a700 1 -- 172.21.15.70:0/3334947155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 msgr2=0x7f06d410bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:19.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.399+0000 7f06dc26a700 1 --2- 172.21.15.70:0/3334947155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d410bd90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f06d00098a0 tx=0x7f06d0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.399+0000 7f06dc26a700 1 -- 172.21.15.70:0/3334947155 shutdown_connections 2024-04-26T20:17:19.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.399+0000 7f06dc26a700 1 --2- 172.21.15.70:0/3334947155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d410bd90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.399+0000 7f06dc26a700 1 -- 172.21.15.70:0/3334947155 >> 172.21.15.70:0/3334947155 conn(0x7f06d4103350 msgr2=0x7f06d41057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:19.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.399+0000 7f06dc26a700 1 -- 172.21.15.70:0/3334947155 shutdown_connections 2024-04-26T20:17:19.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.399+0000 7f06dc26a700 1 -- 172.21.15.70:0/3334947155 wait complete. 2024-04-26T20:17:19.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.400+0000 7f06dc26a700 1 Processor -- start 2024-04-26T20:17:19.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.400+0000 7f06dc26a700 1 -- start start 2024-04-26T20:17:19.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.400+0000 7f06dc26a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d4109220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:19.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.400+0000 7f06dc26a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06d410d2a0 con 0x7f06d41099a0 2024-04-26T20:17:19.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.400+0000 7f06da006700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d4109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:19.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.400+0000 7f06da006700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d4109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43256/0 (socket says 172.21.15.70:43256) 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.400+0000 7f06da006700 1 -- 172.21.15.70:0/1003947025 learned_addr learned my addr 172.21.15.70:0/1003947025 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.400+0000 7f06da006700 1 -- 172.21.15.70:0/1003947025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d4109760 con 0x7f06d41099a0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.400+0000 7f06da006700 1 --2- 172.21.15.70:0/1003947025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d4109220 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f06d00116a0 tx=0x7f06d0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.400+0000 7f06cb7fe700 1 -- 172.21.15.70:0/1003947025 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d0003ab0 con 0x7f06d41099a0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.400+0000 7f06cb7fe700 1 -- 172.21.15.70:0/1003947025 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f06d0003c50 con 0x7f06d41099a0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.401+0000 7f06cb7fe700 1 -- 172.21.15.70:0/1003947025 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d0019870 con 0x7f06d41099a0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.401+0000 7f06dc26a700 1 -- 172.21.15.70:0/1003947025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d4107950 con 0x7f06d41099a0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.401+0000 7f06dc26a700 1 -- 172.21.15.70:0/1003947025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d4107e10 con 0x7f06d41099a0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.401+0000 7f06cb7fe700 1 -- 172.21.15.70:0/1003947025 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f06d002d430 con 0x7f06d41099a0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.401+0000 7f06cb7fe700 1 -- 172.21.15.70:0/1003947025 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f06d0024780 con 0x7f06d41099a0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.403+0000 7f06dc26a700 1 -- 172.21.15.70:0/1003947025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d4064a80 con 0x7f06d41099a0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.404+0000 7f06cb7fe700 1 -- 172.21.15.70:0/1003947025 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f06d0011e20 con 0x7f06d41099a0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.473+0000 7f06dc26a700 1 -- 172.21.15.70:0/1003947025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f06d41080c0 con 0x7f06d41099a0 2024-04-26T20:17:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.475+0000 7f06cb7fe700 1 -- 172.21.15.70:0/1003947025 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f06d001ac00 con 0x7f06d41099a0 2024-04-26T20:17:19.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.476+0000 7f06dc26a700 1 -- 172.21.15.70:0/1003947025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 msgr2=0x7f06d4109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:19.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.476+0000 7f06dc26a700 1 --2- 172.21.15.70:0/1003947025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d4109220 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f06d00116a0 tx=0x7f06d0011ce0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.476+0000 7f06dc26a700 1 -- 172.21.15.70:0/1003947025 shutdown_connections 2024-04-26T20:17:19.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.476+0000 7f06dc26a700 1 --2- 172.21.15.70:0/1003947025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d41099a0 0x7f06d4109220 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.476+0000 7f06dc26a700 1 -- 172.21.15.70:0/1003947025 >> 172.21.15.70:0/1003947025 conn(0x7f06d4103350 msgr2=0x7f06d4103de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:19.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.476+0000 7f06dc26a700 1 -- 172.21.15.70:0/1003947025 shutdown_connections 2024-04-26T20:17:19.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:18.476+0000 7f06dc26a700 1 -- 172.21.15.70:0/1003947025 wait complete. 2024-04-26T20:17:19.075 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-26T20:17:19.090 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:17:19.090 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mgr... 2024-04-26T20:17:19.091 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-26T20:17:19.091 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-26T20:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.x 2024-04-26T20:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-26T20:17:19.475 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-cc0136ee-0409-11ef-bc93-c7b262605968.target.wants/ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-cc0136ee-0409-11ef-bc93-c7b262605968@.service. 2024-04-26T20:17:19.709 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:19 smithi070 systemd[1]: Starting Ceph mgr.x for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:17:20.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:19 smithi070 podman[29341]: 2024-04-26 20:17:19.61109756 +0000 UTC m=+0.018195898 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:17:20.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:19 smithi070 podman[29341]: 2024-04-26 20:17:19.718060272 +0000 UTC m=+0.125158576 container create 9c91667f298040849b2512114f964a4b0787d5de81b8b4309e7b3b32640338b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:17:20.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:19 smithi070 podman[29341]: 2024-04-26 20:17:19.95403951 +0000 UTC m=+0.361137814 container init 9c91667f298040849b2512114f964a4b0787d5de81b8b4309e7b3b32640338b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T20:17:20.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:19 smithi070 podman[29341]: 2024-04-26 20:17:19.956581367 +0000 UTC m=+0.363679671 container start 9c91667f298040849b2512114f964a4b0787d5de81b8b4309e7b3b32640338b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-26T20:17:20.052 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:17:20.052 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-04-26T20:17:20.060 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:17:20.060 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-04-26T20:17:20.060 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-04-26T20:17:20.060 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T20:17:20.070 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:17:20.070 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-04-26T20:17:20.079 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:17:20.079 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-04-26T20:17:20.079 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-04-26T20:17:20.079 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-26T20:17:20.079 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr to start... 2024-04-26T20:17:20.079 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr... 2024-04-26T20:17:20.301 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:20 smithi070 bash[29341]: 9c91667f298040849b2512114f964a4b0787d5de81b8b4309e7b3b32640338b3 2024-04-26T20:17:20.301 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:20 smithi070 systemd[1]: Started Ceph mgr.x for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:17:20.301 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:20.117+0000 7f55db2f6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:17:20.302 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:20.300+0000 7f55db2f6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:17:20.623 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:20.407+0000 7f55db2f6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:17:20.935 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:20 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/4132377272' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:17:20.935 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:20.732+0000 7f55db2f6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:17:20.935 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:20.815+0000 7f55db2f6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:17:21.229 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:21.229 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T20:17:21.230 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:17:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:17:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:17:12.718610+0000", 2024-04-26T20:17:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.539+0000 7f948f652700 1 Processor -- start 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.540+0000 7f948f652700 1 -- start start 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.540+0000 7f948f652700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948810bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.540+0000 7f948f652700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f948807d730 con 0x7f9488109940 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.540+0000 7f948d3ee700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948810bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.540+0000 7f948d3ee700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948810bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38214/0 (socket says 172.21.15.70:38214) 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.540+0000 7f948d3ee700 1 -- 172.21.15.70:0/107439498 learned_addr learned my addr 172.21.15.70:0/107439498 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.541+0000 7f948d3ee700 1 -- 172.21.15.70:0/107439498 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948810c270 con 0x7f9488109940 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.541+0000 7f948d3ee700 1 --2- 172.21.15.70:0/107439498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948810bd30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f94840098a0 tx=0x7f9484009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cba0a12c0f06aad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.541+0000 7f947ffff700 1 -- 172.21.15.70:0/107439498 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9484004160 con 0x7f9488109940 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.541+0000 7f947ffff700 1 -- 172.21.15.70:0/107439498 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f9484004300 con 0x7f9488109940 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.541+0000 7f947ffff700 1 -- 172.21.15.70:0/107439498 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9484011b20 con 0x7f9488109940 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.542+0000 7f948f652700 1 -- 172.21.15.70:0/107439498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 msgr2=0x7f948810bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.542+0000 7f948f652700 1 --2- 172.21.15.70:0/107439498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948810bd30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f94840098a0 tx=0x7f9484009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.542+0000 7f948f652700 1 -- 172.21.15.70:0/107439498 shutdown_connections 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.542+0000 7f948f652700 1 --2- 172.21.15.70:0/107439498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948810bd30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.542+0000 7f948f652700 1 -- 172.21.15.70:0/107439498 >> 172.21.15.70:0/107439498 conn(0x7f9488103350 msgr2=0x7f94881057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.542+0000 7f948f652700 1 -- 172.21.15.70:0/107439498 shutdown_connections 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.542+0000 7f948f652700 1 -- 172.21.15.70:0/107439498 wait complete. 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.542+0000 7f948f652700 1 Processor -- start 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.542+0000 7f948f652700 1 -- start start 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f948f652700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f948f652700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f948810d2a0 con 0x7f9488109940 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f948d3ee700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:21.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f948d3ee700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948819ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38224/0 (socket says 172.21.15.70:38224) 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f948d3ee700 1 -- 172.21.15.70:0/4132377272 learned_addr learned my addr 172.21.15.70:0/4132377272 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f948d3ee700 1 -- 172.21.15.70:0/4132377272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948819d380 con 0x7f9488109940 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f948d3ee700 1 --2- 172.21.15.70:0/4132377272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948819ce40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f94840116a0 tx=0x7f9484011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f947e7fc700 1 -- 172.21.15.70:0/4132377272 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9484003ab0 con 0x7f9488109940 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f947e7fc700 1 -- 172.21.15.70:0/4132377272 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f9484003c50 con 0x7f9488109940 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f947e7fc700 1 -- 172.21.15.70:0/4132377272 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9484019870 con 0x7f9488109940 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f948f652700 1 -- 172.21.15.70:0/4132377272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948819d610 con 0x7f9488109940 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.543+0000 7f948f652700 1 -- 172.21.15.70:0/4132377272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948819da70 con 0x7f9488109940 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.544+0000 7f947e7fc700 1 -- 172.21.15.70:0/4132377272 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f948402d430 con 0x7f9488109940 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.544+0000 7f947e7fc700 1 -- 172.21.15.70:0/4132377272 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9484024770 con 0x7f9488109940 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.544+0000 7f948f652700 1 -- 172.21.15.70:0/4132377272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9488064a80 con 0x7f9488109940 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.548+0000 7f947e7fc700 1 -- 172.21.15.70:0/4132377272 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9484011e20 con 0x7f9488109940 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.622+0000 7f948f652700 1 -- 172.21.15.70:0/4132377272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f94881a0820 con 0x7f9488109940 2024-04-26T20:17:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.622+0000 7f947e7fc700 1 -- 172.21.15.70:0/4132377272 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f948401ac00 con 0x7f9488109940 2024-04-26T20:17:21.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.623+0000 7f948f652700 1 -- 172.21.15.70:0/4132377272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 msgr2=0x7f948819ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:21.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.623+0000 7f948f652700 1 --2- 172.21.15.70:0/4132377272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948819ce40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f94840116a0 tx=0x7f9484011ce0 comp rx=0 tx=0).stop 2024-04-26T20:17:21.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.623+0000 7f948f652700 1 -- 172.21.15.70:0/4132377272 shutdown_connections 2024-04-26T20:17:21.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.623+0000 7f948f652700 1 --2- 172.21.15.70:0/4132377272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9488109940 0x7f948819ce40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:21.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.623+0000 7f948f652700 1 -- 172.21.15.70:0/4132377272 >> 172.21.15.70:0/4132377272 conn(0x7f9488103350 msgr2=0x7f9488103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:21.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.624+0000 7f948f652700 1 -- 172.21.15.70:0/4132377272 shutdown_connections 2024-04-26T20:17:21.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:20.624+0000 7f948f652700 1 -- 172.21.15.70:0/4132377272 wait complete. 2024-04-26T20:17:21.237 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (1/15)... 2024-04-26T20:17:22.192 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:22 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:22.024+0000 7f55db2f6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:17:22.192 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:22 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:22.190+0000 7f55db2f6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:17:22.534 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:22 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:22.359+0000 7f55db2f6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:17:22.937 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:22 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:22.642+0000 7f55db2f6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:17:22.938 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:22 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:22.734+0000 7f55db2f6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:17:22.938 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:22 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:22.936+0000 7f55db2f6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:17:23.196 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:23 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:23.136+0000 7f55db2f6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:17:24.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:23 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/781296209' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:17:24.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:23 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:23.769+0000 7f55db2f6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:17:24.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:24.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:17:24.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:17:24.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:17:24.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:17:24.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:17:24.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:17:24.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:17:24.330 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:17:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:17:24.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:17:12.718610+0000", 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.693+0000 7fe158e26700 1 Processor -- start 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.693+0000 7fe158e26700 1 -- start start 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.693+0000 7fe158e26700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15410bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:24.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.693+0000 7fe158e26700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe15407d6a0 con 0x7fe154109970 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.693+0000 7fe15259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15410bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.693+0000 7fe15259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15410bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38234/0 (socket says 172.21.15.70:38234) 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.693+0000 7fe15259c700 1 -- 172.21.15.70:0/1163139005 learned_addr learned my addr 172.21.15.70:0/1163139005 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.694+0000 7fe15259c700 1 -- 172.21.15.70:0/1163139005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15410c2a0 con 0x7fe154109970 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.694+0000 7fe15259c700 1 --2- 172.21.15.70:0/1163139005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15410bd60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1440098a0 tx=0x7fe144009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace36439d607654c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.694+0000 7fe15159a700 1 -- 172.21.15.70:0/1163139005 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe144004160 con 0x7fe154109970 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.694+0000 7fe15159a700 1 -- 172.21.15.70:0/1163139005 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fe144004300 con 0x7fe154109970 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.694+0000 7fe15159a700 1 -- 172.21.15.70:0/1163139005 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe144011b20 con 0x7fe154109970 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.695+0000 7fe158e26700 1 -- 172.21.15.70:0/1163139005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 msgr2=0x7fe15410bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.695+0000 7fe158e26700 1 --2- 172.21.15.70:0/1163139005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15410bd60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1440098a0 tx=0x7fe144009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.695+0000 7fe158e26700 1 -- 172.21.15.70:0/1163139005 shutdown_connections 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.695+0000 7fe158e26700 1 --2- 172.21.15.70:0/1163139005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15410bd60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:24.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.695+0000 7fe158e26700 1 -- 172.21.15.70:0/1163139005 >> 172.21.15.70:0/1163139005 conn(0x7fe154103360 msgr2=0x7fe1541057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:24.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.695+0000 7fe158e26700 1 -- 172.21.15.70:0/1163139005 shutdown_connections 2024-04-26T20:17:24.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.695+0000 7fe158e26700 1 -- 172.21.15.70:0/1163139005 wait complete. 2024-04-26T20:17:24.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.696+0000 7fe158e26700 1 Processor -- start 2024-04-26T20:17:24.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.696+0000 7fe158e26700 1 -- start start 2024-04-26T20:17:24.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.696+0000 7fe158e26700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:24.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.696+0000 7fe158e26700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe15410d260 con 0x7fe154109970 2024-04-26T20:17:24.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.696+0000 7fe15259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:24.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.696+0000 7fe15259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15419cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38246/0 (socket says 172.21.15.70:38246) 2024-04-26T20:17:24.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.696+0000 7fe15259c700 1 -- 172.21.15.70:0/781296209 learned_addr learned my addr 172.21.15.70:0/781296209 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:24.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.697+0000 7fe15259c700 1 -- 172.21.15.70:0/781296209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15419d2f0 con 0x7fe154109970 2024-04-26T20:17:24.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.697+0000 7fe15259c700 1 --2- 172.21.15.70:0/781296209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15419cdb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe144006af0 tx=0x7fe144011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:24.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.697+0000 7fe1437fe700 1 -- 172.21.15.70:0/781296209 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1440039a0 con 0x7fe154109970 2024-04-26T20:17:24.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.697+0000 7fe1437fe700 1 -- 172.21.15.70:0/781296209 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fe144003b40 con 0x7fe154109970 2024-04-26T20:17:24.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.697+0000 7fe158e26700 1 -- 172.21.15.70:0/781296209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15419d580 con 0x7fe154109970 2024-04-26T20:17:24.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.697+0000 7fe1437fe700 1 -- 172.21.15.70:0/781296209 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe144019670 con 0x7fe154109970 2024-04-26T20:17:24.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.697+0000 7fe158e26700 1 -- 172.21.15.70:0/781296209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15419d9e0 con 0x7fe154109970 2024-04-26T20:17:24.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.697+0000 7fe1437fe700 1 -- 172.21.15.70:0/781296209 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe144019ce0 con 0x7fe154109970 2024-04-26T20:17:24.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.697+0000 7fe1437fe700 1 -- 172.21.15.70:0/781296209 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe1440247c0 con 0x7fe154109970 2024-04-26T20:17:24.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.698+0000 7fe158e26700 1 -- 172.21.15.70:0/781296209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe154064a80 con 0x7fe154109970 2024-04-26T20:17:24.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.700+0000 7fe1437fe700 1 -- 172.21.15.70:0/781296209 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe144043ec0 con 0x7fe154109970 2024-04-26T20:17:24.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.776+0000 7fe158e26700 1 -- 172.21.15.70:0/781296209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe1541078a0 con 0x7fe154109970 2024-04-26T20:17:24.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.776+0000 7fe1437fe700 1 -- 172.21.15.70:0/781296209 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fe144032020 con 0x7fe154109970 2024-04-26T20:17:24.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.777+0000 7fe158e26700 1 -- 172.21.15.70:0/781296209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 msgr2=0x7fe15419cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:24.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.777+0000 7fe158e26700 1 --2- 172.21.15.70:0/781296209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15419cdb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe144006af0 tx=0x7fe144011ce0 comp rx=0 tx=0).stop 2024-04-26T20:17:24.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.777+0000 7fe158e26700 1 -- 172.21.15.70:0/781296209 shutdown_connections 2024-04-26T20:17:24.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.777+0000 7fe158e26700 1 --2- 172.21.15.70:0/781296209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154109970 0x7fe15419cdb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:24.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.777+0000 7fe158e26700 1 -- 172.21.15.70:0/781296209 >> 172.21.15.70:0/781296209 conn(0x7fe154103360 msgr2=0x7fe154103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:24.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.778+0000 7fe158e26700 1 -- 172.21.15.70:0/781296209 shutdown_connections 2024-04-26T20:17:24.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:23.778+0000 7fe158e26700 1 -- 172.21.15.70:0/781296209 wait complete. 2024-04-26T20:17:24.337 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (2/15)... 2024-04-26T20:17:24.516 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:24 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:24.213+0000 7f55db2f6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:17:24.516 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:24 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:24.311+0000 7f55db2f6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:17:24.516 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:24 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:24.515+0000 7f55db2f6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:17:25.382 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:25.045+0000 7f55db2f6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:17:25.382 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:25.138+0000 7f55db2f6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:17:25.723 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:25.380+0000 7f55db2f6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:17:25.723 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:25.512+0000 7f55db2f6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:17:25.723 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:25.607+0000 7f55db2f6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:17:25.723 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:25.722+0000 7f55db2f6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:17:26.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:26.027+0000 7f55db2f6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:17:26.744 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:26.642+0000 7f55db2f6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:17:27.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:26.866+0000 7f55db2f6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:17:27.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/239912071' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:17:27.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-mon[29124]: Activating manager daemon x 2024-04-26T20:17:27.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-mon[29124]: mgrmap e2: x(active, starting, since 0.00365903s) 2024-04-26T20:17:27.038 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-mon[29124]: from='mgr.14100 172.21.15.70:0/2617963818' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:17:27.038 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-mon[29124]: from='mgr.14100 172.21.15.70:0/2617963818' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:17:27.038 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-mon[29124]: from='mgr.14100 172.21.15.70:0/2617963818' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:17:27.038 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-mon[29124]: from='mgr.14100 172.21.15.70:0/2617963818' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:17:27.038 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-mon[29124]: from='mgr.14100 172.21.15.70:0/2617963818' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T20:17:27.038 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-mon[29124]: Manager daemon x is now available 2024-04-26T20:17:27.038 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:26 smithi070 ceph-mon[29124]: from='mgr.14100 172.21.15.70:0/2617963818' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:17:27.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:27.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:17:27.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:17:27.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:17:27.461 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:27.462 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:17:27.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:17:12.718610+0000", 2024-04-26T20:17:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.759+0000 7fd3b7ecf700 1 Processor -- start 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.759+0000 7fd3b7ecf700 1 -- start start 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.760+0000 7fd3b7ecf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b010bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.760+0000 7fd3b7ecf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b007d730 con 0x7fd3b0109940 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.760+0000 7fd3b5c6b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b010bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.760+0000 7fd3b5c6b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b010bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38258/0 (socket says 172.21.15.70:38258) 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.760+0000 7fd3b5c6b700 1 -- 172.21.15.70:0/293227246 learned_addr learned my addr 172.21.15.70:0/293227246 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.760+0000 7fd3b5c6b700 1 -- 172.21.15.70:0/293227246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b010c270 con 0x7fd3b0109940 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.760+0000 7fd3b5c6b700 1 --2- 172.21.15.70:0/293227246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b010bd30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0098a0 tx=0x7fd3ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98d43504c4b26d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.760+0000 7fd3b4c69700 1 -- 172.21.15.70:0/293227246 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac004160 con 0x7fd3b0109940 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.761+0000 7fd3b4c69700 1 -- 172.21.15.70:0/293227246 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fd3ac004300 con 0x7fd3b0109940 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.761+0000 7fd3b4c69700 1 -- 172.21.15.70:0/293227246 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac011b20 con 0x7fd3b0109940 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.761+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/293227246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 msgr2=0x7fd3b010bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.761+0000 7fd3b7ecf700 1 --2- 172.21.15.70:0/293227246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b010bd30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0098a0 tx=0x7fd3ac009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.761+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/293227246 shutdown_connections 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.761+0000 7fd3b7ecf700 1 --2- 172.21.15.70:0/293227246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b010bd30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.761+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/293227246 >> 172.21.15.70:0/293227246 conn(0x7fd3b0103350 msgr2=0x7fd3b01057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.761+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/293227246 shutdown_connections 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.761+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/293227246 wait complete. 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.762+0000 7fd3b7ecf700 1 Processor -- start 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.762+0000 7fd3b7ecf700 1 -- start start 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.762+0000 7fd3b7ecf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b01091c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.762+0000 7fd3b7ecf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b010d2a0 con 0x7fd3b0109940 2024-04-26T20:17:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.762+0000 7fd3b5c6b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b01091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.762+0000 7fd3b5c6b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b01091c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38268/0 (socket says 172.21.15.70:38268) 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.762+0000 7fd3b5c6b700 1 -- 172.21.15.70:0/239912071 learned_addr learned my addr 172.21.15.70:0/239912071 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.763+0000 7fd3b5c6b700 1 -- 172.21.15.70:0/239912071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b0109700 con 0x7fd3b0109940 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.763+0000 7fd3b5c6b700 1 --2- 172.21.15.70:0/239912071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b01091c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac006af0 tx=0x7fd3ac011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.763+0000 7fd3a6ffd700 1 -- 172.21.15.70:0/239912071 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac003b90 con 0x7fd3b0109940 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.763+0000 7fd3a6ffd700 1 -- 172.21.15.70:0/239912071 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fd3ac003d30 con 0x7fd3b0109940 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.763+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/239912071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b01078f0 con 0x7fd3b0109940 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.763+0000 7fd3a6ffd700 1 -- 172.21.15.70:0/239912071 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0197c0 con 0x7fd3b0109940 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.763+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/239912071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b0107db0 con 0x7fd3b0109940 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.763+0000 7fd3a6ffd700 1 -- 172.21.15.70:0/239912071 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd3ac022020 con 0x7fd3b0109940 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.763+0000 7fd3a6ffd700 1 -- 172.21.15.70:0/239912071 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd3ac02c3a0 con 0x7fd3b0109940 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.764+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/239912071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b0064a80 con 0x7fd3b0109940 2024-04-26T20:17:27.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.766+0000 7fd3a6ffd700 1 -- 172.21.15.70:0/239912071 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd3ac0042a0 con 0x7fd3b0109940 2024-04-26T20:17:27.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.839+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/239912071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd3b01082e0 con 0x7fd3b0109940 2024-04-26T20:17:27.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.839+0000 7fd3a6ffd700 1 -- 172.21.15.70:0/239912071 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fd3ac01ac50 con 0x7fd3b0109940 2024-04-26T20:17:27.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.840+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/239912071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 msgr2=0x7fd3b01091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:27.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.840+0000 7fd3b7ecf700 1 --2- 172.21.15.70:0/239912071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b01091c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac006af0 tx=0x7fd3ac011ce0 comp rx=0 tx=0).stop 2024-04-26T20:17:27.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.840+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/239912071 shutdown_connections 2024-04-26T20:17:27.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.840+0000 7fd3b7ecf700 1 --2- 172.21.15.70:0/239912071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3b0109940 0x7fd3b01091c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:27.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.840+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/239912071 >> 172.21.15.70:0/239912071 conn(0x7fd3b0103350 msgr2=0x7fd3b0103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:27.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.840+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/239912071 shutdown_connections 2024-04-26T20:17:27.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:26.840+0000 7fd3b7ecf700 1 -- 172.21.15.70:0/239912071 wait complete. 2024-04-26T20:17:27.468 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (3/15)... 2024-04-26T20:17:28.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:27 smithi070 ceph-mon[29124]: from='mgr.14100 172.21.15.70:0/2617963818' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:17:28.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:27 smithi070 ceph-mon[29124]: from='mgr.14100 172.21.15.70:0/2617963818' entity='mgr.x' 2024-04-26T20:17:28.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:27 smithi070 ceph-mon[29124]: from='mgr.14100 172.21.15.70:0/2617963818' entity='mgr.x' 2024-04-26T20:17:28.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:27 smithi070 ceph-mon[29124]: from='mgr.14100 172.21.15.70:0/2617963818' entity='mgr.x' 2024-04-26T20:17:28.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:27 smithi070 ceph-mon[29124]: mgrmap e3: x(active, since 1.0075s) 2024-04-26T20:17:30.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:29 smithi070 ceph-mon[29124]: mgrmap e4: x(active, since 2s) 2024-04-26T20:17:30.992 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:30.992 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:30.993 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-04-26T20:17:30.994 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:17:30.994 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:30.994 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T20:17:30.994 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:17:30.994 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:30.994 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:17:30.994 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:30.994 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:17:30.994 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:17:30.994 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:17:31.003 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:17:31.003 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:17:31.003 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:17:31.003 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:31.003 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:17:31.003 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:17:31.003 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:17:31.003 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T20:17:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:17:12.718610+0000", 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:17:31.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.115+0000 7fc24f536700 1 Processor -- start 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.115+0000 7fc24f536700 1 -- start start 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.115+0000 7fc24f536700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc2481092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.115+0000 7fc24f536700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc248109820 con 0x7fc248108ec0 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.116+0000 7fc24d2d2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc2481092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.116+0000 7fc24d2d2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc2481092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55090/0 (socket says 172.21.15.70:55090) 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.116+0000 7fc24d2d2700 1 -- 172.21.15.70:0/2623019275 learned_addr learned my addr 172.21.15.70:0/2623019275 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.116+0000 7fc24d2d2700 1 -- 172.21.15.70:0/2623019275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24810a060 con 0x7fc248108ec0 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.116+0000 7fc24d2d2700 1 --2- 172.21.15.70:0/2623019275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc2481092e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc240009e80 tx=0x7fc24000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33430b38201f9e11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.116+0000 7fc247fff700 1 -- 172.21.15.70:0/2623019275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc240017070 con 0x7fc248108ec0 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.116+0000 7fc247fff700 1 -- 172.21.15.70:0/2623019275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fc24000b8c0 con 0x7fc248108ec0 2024-04-26T20:17:31.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.116+0000 7fc247fff700 1 -- 172.21.15.70:0/2623019275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2400045c0 con 0x7fc248108ec0 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.117+0000 7fc24f536700 1 -- 172.21.15.70:0/2623019275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 msgr2=0x7fc2481092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.117+0000 7fc24f536700 1 --2- 172.21.15.70:0/2623019275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc2481092e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc240009e80 tx=0x7fc24000b330 comp rx=0 tx=0).stop 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.117+0000 7fc24f536700 1 -- 172.21.15.70:0/2623019275 shutdown_connections 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.117+0000 7fc24f536700 1 --2- 172.21.15.70:0/2623019275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc2481092e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.117+0000 7fc24f536700 1 -- 172.21.15.70:0/2623019275 >> 172.21.15.70:0/2623019275 conn(0x7fc2481044f0 msgr2=0x7fc248106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.117+0000 7fc24f536700 1 -- 172.21.15.70:0/2623019275 shutdown_connections 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.117+0000 7fc24f536700 1 -- 172.21.15.70:0/2623019275 wait complete. 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.118+0000 7fc24f536700 1 Processor -- start 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.118+0000 7fc24f536700 1 -- start start 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.118+0000 7fc24f536700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc24807f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.118+0000 7fc24f536700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc24810d320 con 0x7fc248108ec0 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.118+0000 7fc24d2d2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc24807f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:31.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.118+0000 7fc24d2d2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc24807f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55106/0 (socket says 172.21.15.70:55106) 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.118+0000 7fc24d2d2700 1 -- 172.21.15.70:0/2455307176 learned_addr learned my addr 172.21.15.70:0/2455307176 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.118+0000 7fc24d2d2700 1 -- 172.21.15.70:0/2455307176 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24807f930 con 0x7fc248108ec0 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.118+0000 7fc24d2d2700 1 --2- 172.21.15.70:0/2455307176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc24807f3f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc240000f80 tx=0x7fc24000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.118+0000 7fc2467fc700 1 -- 172.21.15.70:0/2455307176 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc240017070 con 0x7fc248108ec0 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.119+0000 7fc24f536700 1 -- 172.21.15.70:0/2455307176 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24807db20 con 0x7fc248108ec0 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.119+0000 7fc24f536700 1 -- 172.21.15.70:0/2455307176 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24807e060 con 0x7fc248108ec0 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.119+0000 7fc2467fc700 1 -- 172.21.15.70:0/2455307176 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fc240022070 con 0x7fc248108ec0 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.119+0000 7fc2467fc700 1 -- 172.21.15.70:0/2455307176 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc24001d5b0 con 0x7fc248108ec0 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.119+0000 7fc2467fc700 1 -- 172.21.15.70:0/2455307176 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7fc24001d880 con 0x7fc248108ec0 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.120+0000 7fc2467fc700 1 --2- 172.21.15.70:0/2455307176 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7fc2300395b0 0x7fc23003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.119+0000 7fc24f536700 1 -- 172.21.15.70:0/2455307176 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc234005360 con 0x7fc248108ec0 2024-04-26T20:17:31.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.120+0000 7fc2467fc700 1 -- 172.21.15.70:0/2455307176 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc24000f050 con 0x7fc248108ec0 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.120+0000 7fc24cad1700 1 --2- 172.21.15.70:0/2455307176 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7fc2300395b0 0x7fc23003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.120+0000 7fc24cad1700 1 --2- 172.21.15.70:0/2455307176 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7fc2300395b0 0x7fc23003ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc23c006fd0 tx=0x7fc23c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.125+0000 7fc2467fc700 1 -- 172.21.15.70:0/2455307176 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc240026c70 con 0x7fc248108ec0 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.408+0000 7fc24f536700 1 -- 172.21.15.70:0/2455307176 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc234005650 con 0x7fc248108ec0 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.409+0000 7fc2467fc700 1 -- 172.21.15.70:0/2455307176 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fc24002c200 con 0x7fc248108ec0 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.412+0000 7fc24f536700 1 -- 172.21.15.70:0/2455307176 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7fc2300395b0 msgr2=0x7fc23003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.412+0000 7fc24f536700 1 --2- 172.21.15.70:0/2455307176 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7fc2300395b0 0x7fc23003ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc23c006fd0 tx=0x7fc23c006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.412+0000 7fc24f536700 1 -- 172.21.15.70:0/2455307176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 msgr2=0x7fc24807f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.412+0000 7fc24f536700 1 --2- 172.21.15.70:0/2455307176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc24807f3f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc240000f80 tx=0x7fc24000bd50 comp rx=0 tx=0).stop 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.412+0000 7fc24f536700 1 -- 172.21.15.70:0/2455307176 shutdown_connections 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.412+0000 7fc24f536700 1 --2- 172.21.15.70:0/2455307176 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7fc2300395b0 0x7fc23003ba70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.412+0000 7fc24f536700 1 --2- 172.21.15.70:0/2455307176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc248108ec0 0x7fc24807f3f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:31.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.412+0000 7fc24f536700 1 -- 172.21.15.70:0/2455307176 >> 172.21.15.70:0/2455307176 conn(0x7fc2481044f0 msgr2=0x7fc248104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:31.010 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.412+0000 7fc24f536700 1 -- 172.21.15.70:0/2455307176 shutdown_connections 2024-04-26T20:17:31.010 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:30.412+0000 7fc24f536700 1 -- 172.21.15.70:0/2455307176 wait complete. 2024-04-26T20:17:31.010 INFO:teuthology.orchestra.run.smithi070.stdout:mgr is available 2024-04-26T20:17:31.096 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:30 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2455307176' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:17:32.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:31 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/844250289' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T20:17:32.202 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:32.202 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T20:17:32.202 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:17:32.202 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T20:17:32.203 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.420+0000 7f3f99b46700 1 Processor -- start 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.420+0000 7f3f99b46700 1 -- start start 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.420+0000 7f3f99b46700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f941081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.420+0000 7f3f99b46700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f941087b0 con 0x7f3f94107dc0 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.420+0000 7f3f937fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f941081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.420+0000 7f3f937fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f941081e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55112/0 (socket says 172.21.15.70:55112) 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.420+0000 7f3f937fe700 1 -- 172.21.15.70:0/847140763 learned_addr learned my addr 172.21.15.70:0/847140763 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.420+0000 7f3f937fe700 1 -- 172.21.15.70:0/847140763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f94108fc0 con 0x7f3f94107dc0 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.421+0000 7f3f937fe700 1 --2- 172.21.15.70:0/847140763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f941081e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3f840098a0 tx=0x7f3f84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689011aff2b6b29 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.421+0000 7f3f927fc700 1 -- 172.21.15.70:0/847140763 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f84004160 con 0x7f3f94107dc0 2024-04-26T20:17:32.204 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.421+0000 7f3f927fc700 1 -- 172.21.15.70:0/847140763 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f3f84004300 con 0x7f3f94107dc0 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.421+0000 7f3f927fc700 1 -- 172.21.15.70:0/847140763 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f84011b20 con 0x7f3f94107dc0 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.421+0000 7f3f99b46700 1 -- 172.21.15.70:0/847140763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 msgr2=0x7f3f941081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.421+0000 7f3f99b46700 1 --2- 172.21.15.70:0/847140763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f941081e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3f840098a0 tx=0x7f3f84009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.421+0000 7f3f99b46700 1 -- 172.21.15.70:0/847140763 shutdown_connections 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.421+0000 7f3f99b46700 1 --2- 172.21.15.70:0/847140763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f941081e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.421+0000 7f3f99b46700 1 -- 172.21.15.70:0/847140763 >> 172.21.15.70:0/847140763 conn(0x7f3f941033a0 msgr2=0x7f3f941057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.421+0000 7f3f99b46700 1 -- 172.21.15.70:0/847140763 shutdown_connections 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.421+0000 7f3f99b46700 1 -- 172.21.15.70:0/847140763 wait complete. 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.422+0000 7f3f99b46700 1 Processor -- start 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.422+0000 7f3f99b46700 1 -- start start 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.422+0000 7f3f99b46700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f9419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.422+0000 7f3f99b46700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9410c370 con 0x7f3f94107dc0 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.422+0000 7f3f937fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f9419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:32.205 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.422+0000 7f3f937fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f9419bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55122/0 (socket says 172.21.15.70:55122) 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.422+0000 7f3f937fe700 1 -- 172.21.15.70:0/844250289 learned_addr learned my addr 172.21.15.70:0/844250289 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.423+0000 7f3f937fe700 1 -- 172.21.15.70:0/844250289 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9419c2f0 con 0x7f3f94107dc0 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.423+0000 7f3f937fe700 1 --2- 172.21.15.70:0/844250289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f9419bdb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3f84006af0 tx=0x7f3f84011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.423+0000 7f3f90ff9700 1 -- 172.21.15.70:0/844250289 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f84003930 con 0x7f3f94107dc0 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.423+0000 7f3f90ff9700 1 -- 172.21.15.70:0/844250289 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f3f84003ad0 con 0x7f3f94107dc0 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.423+0000 7f3f99b46700 1 -- 172.21.15.70:0/844250289 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9419c580 con 0x7f3f94107dc0 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.423+0000 7f3f90ff9700 1 -- 172.21.15.70:0/844250289 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f84019610 con 0x7f3f94107dc0 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.423+0000 7f3f99b46700 1 -- 172.21.15.70:0/844250289 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f9419c9e0 con 0x7f3f94107dc0 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.424+0000 7f3f90ff9700 1 -- 172.21.15.70:0/844250289 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f3f840198f0 con 0x7f3f94107dc0 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.424+0000 7f3f90ff9700 1 --2- 172.21.15.70:0/844250289 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f3f7c039510 0x7f3f7c03b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.424+0000 7f3f99b46700 1 -- 172.21.15.70:0/844250289 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f94064a80 con 0x7f3f94107dc0 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.424+0000 7f3f90ff9700 1 -- 172.21.15.70:0/844250289 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3f8404dae0 con 0x7f3f94107dc0 2024-04-26T20:17:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.424+0000 7f3f92ffd700 1 --2- 172.21.15.70:0/844250289 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f3f7c039510 0x7f3f7c03b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.424+0000 7f3f92ffd700 1 --2- 172.21.15.70:0/844250289 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f3f7c039510 0x7f3f7c03b9d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f88006fd0 tx=0x7f3f88006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.429+0000 7f3f90ff9700 1 -- 172.21.15.70:0/844250289 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f3f84011e20 con 0x7f3f94107dc0 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.626+0000 7f3f99b46700 1 -- 172.21.15.70:0/844250289 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f3f9419f330 con 0x7f3f94107dc0 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.627+0000 7f3f90ff9700 1 -- 172.21.15.70:0/844250289 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f3f8404d500 con 0x7f3f94107dc0 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.629+0000 7f3f99b46700 1 -- 172.21.15.70:0/844250289 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f3f7c039510 msgr2=0x7f3f7c03b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.629+0000 7f3f99b46700 1 --2- 172.21.15.70:0/844250289 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f3f7c039510 0x7f3f7c03b9d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f88006fd0 tx=0x7f3f88006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.629+0000 7f3f99b46700 1 -- 172.21.15.70:0/844250289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 msgr2=0x7f3f9419bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.629+0000 7f3f99b46700 1 --2- 172.21.15.70:0/844250289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f9419bdb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3f84006af0 tx=0x7f3f84011c10 comp rx=0 tx=0).stop 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.629+0000 7f3f99b46700 1 -- 172.21.15.70:0/844250289 shutdown_connections 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.629+0000 7f3f99b46700 1 --2- 172.21.15.70:0/844250289 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f3f7c039510 0x7f3f7c03b9d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.629+0000 7f3f99b46700 1 --2- 172.21.15.70:0/844250289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f94107dc0 0x7f3f9419bdb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.629+0000 7f3f99b46700 1 -- 172.21.15.70:0/844250289 >> 172.21.15.70:0/844250289 conn(0x7f3f941033a0 msgr2=0x7f3f94103f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.629+0000 7f3f99b46700 1 -- 172.21.15.70:0/844250289 shutdown_connections 2024-04-26T20:17:32.208 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:31.629+0000 7f3f99b46700 1 -- 172.21.15.70:0/844250289 wait complete. 2024-04-26T20:17:32.208 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling cephadm module... 2024-04-26T20:17:33.200 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:32 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1136198326' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-26T20:17:33.200 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:32 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: ignoring --setuser ceph since I am not root 2024-04-26T20:17:33.200 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:32 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: ignoring --setgroup ceph since I am not root 2024-04-26T20:17:33.200 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:33 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:33.063+0000 7f4cc7fbf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:17:33.475 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:33 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:33.247+0000 7f4cc7fbf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:17:33.476 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:33 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:33.349+0000 7f4cc7fbf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.621+0000 7efd646b9700 1 Processor -- start 2024-04-26T20:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.621+0000 7efd646b9700 1 -- start start 2024-04-26T20:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.621+0000 7efd646b9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c07dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.621+0000 7efd646b9700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c07e190 con 0x7efd5c07f710 2024-04-26T20:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.621+0000 7efd62455700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c07dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.621+0000 7efd62455700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c07dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55134/0 (socket says 172.21.15.70:55134) 2024-04-26T20:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.621+0000 7efd62455700 1 -- 172.21.15.70:0/553705957 learned_addr learned my addr 172.21.15.70:0/553705957 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.622+0000 7efd62455700 1 -- 172.21.15.70:0/553705957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c07e310 con 0x7efd5c07f710 2024-04-26T20:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.622+0000 7efd62455700 1 --2- 172.21.15.70:0/553705957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c07dbc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efd580098a0 tx=0x7efd58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca4e80aaa6a19cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.622+0000 7efd61453700 1 -- 172.21.15.70:0/553705957 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd58004160 con 0x7efd5c07f710 2024-04-26T20:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.622+0000 7efd61453700 1 -- 172.21.15.70:0/553705957 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7efd58004300 con 0x7efd5c07f710 2024-04-26T20:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.622+0000 7efd61453700 1 -- 172.21.15.70:0/553705957 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd58011b20 con 0x7efd5c07f710 2024-04-26T20:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.622+0000 7efd646b9700 1 -- 172.21.15.70:0/553705957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 msgr2=0x7efd5c07dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.622+0000 7efd646b9700 1 --2- 172.21.15.70:0/553705957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c07dbc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efd580098a0 tx=0x7efd58009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd646b9700 1 -- 172.21.15.70:0/553705957 shutdown_connections 2024-04-26T20:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd646b9700 1 --2- 172.21.15.70:0/553705957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c07dbc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd646b9700 1 -- 172.21.15.70:0/553705957 >> 172.21.15.70:0/553705957 conn(0x7efd5c1044f0 msgr2=0x7efd5c106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd646b9700 1 -- 172.21.15.70:0/553705957 shutdown_connections 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd646b9700 1 -- 172.21.15.70:0/553705957 wait complete. 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd646b9700 1 Processor -- start 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd646b9700 1 -- start start 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd646b9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd646b9700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c10f4e0 con 0x7efd5c07f710 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd62455700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd62455700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c19efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55142/0 (socket says 172.21.15.70:55142) 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.623+0000 7efd62455700 1 -- 172.21.15.70:0/1136198326 learned_addr learned my addr 172.21.15.70:0/1136198326 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.624+0000 7efd62455700 1 -- 172.21.15.70:0/1136198326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c19f510 con 0x7efd5c07f710 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.624+0000 7efd62455700 1 --2- 172.21.15.70:0/1136198326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c19efd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efd580116a0 tx=0x7efd58011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.624+0000 7efd537fe700 1 -- 172.21.15.70:0/1136198326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd58003ab0 con 0x7efd5c07f710 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.624+0000 7efd537fe700 1 -- 172.21.15.70:0/1136198326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7efd58003c50 con 0x7efd5c07f710 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.624+0000 7efd537fe700 1 -- 172.21.15.70:0/1136198326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd58019870 con 0x7efd5c07f710 2024-04-26T20:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.624+0000 7efd646b9700 1 -- 172.21.15.70:0/1136198326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c19f7a0 con 0x7efd5c07f710 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.624+0000 7efd646b9700 1 -- 172.21.15.70:0/1136198326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c19fc00 con 0x7efd5c07f710 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.625+0000 7efd537fe700 1 -- 172.21.15.70:0/1136198326 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7efd5801a430 con 0x7efd5c07f710 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.625+0000 7efd646b9700 1 -- 172.21.15.70:0/1136198326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd5c064a80 con 0x7efd5c07f710 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.625+0000 7efd537fe700 1 --2- 172.21.15.70:0/1136198326 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7efd48039560 0x7efd4803ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.625+0000 7efd537fe700 1 -- 172.21.15.70:0/1136198326 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efd5804da20 con 0x7efd5c07f710 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.625+0000 7efd61c54700 1 --2- 172.21.15.70:0/1136198326 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7efd48039560 0x7efd4803ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.626+0000 7efd61c54700 1 --2- 172.21.15.70:0/1136198326 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7efd48039560 0x7efd4803ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd4c006fd0 tx=0x7efd4c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.630+0000 7efd537fe700 1 -- 172.21.15.70:0/1136198326 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7efd58011e20 con 0x7efd5c07f710 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.883+0000 7efd646b9700 1 -- 172.21.15.70:0/1136198326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7efd5c1a2690 con 0x7efd5c07f710 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.895+0000 7efd537fe700 1 -- 172.21.15.70:0/1136198326 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7efd580172b0 con 0x7efd5c07f710 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.897+0000 7efd537fe700 1 -- 172.21.15.70:0/1136198326 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7efd58019ae0 con 0x7efd5c07f710 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.898+0000 7efd646b9700 1 -- 172.21.15.70:0/1136198326 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7efd48039560 msgr2=0x7efd4803ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.898+0000 7efd646b9700 1 --2- 172.21.15.70:0/1136198326 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7efd48039560 0x7efd4803ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd4c006fd0 tx=0x7efd4c006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.898+0000 7efd646b9700 1 -- 172.21.15.70:0/1136198326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 msgr2=0x7efd5c19efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.898+0000 7efd646b9700 1 --2- 172.21.15.70:0/1136198326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c19efd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efd580116a0 tx=0x7efd58011ce0 comp rx=0 tx=0).stop 2024-04-26T20:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.898+0000 7efd646b9700 1 -- 172.21.15.70:0/1136198326 shutdown_connections 2024-04-26T20:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.898+0000 7efd646b9700 1 --2- 172.21.15.70:0/1136198326 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7efd48039560 0x7efd4803ba20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.898+0000 7efd646b9700 1 --2- 172.21.15.70:0/1136198326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5c07f710 0x7efd5c19efd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.898+0000 7efd646b9700 1 -- 172.21.15.70:0/1136198326 >> 172.21.15.70:0/1136198326 conn(0x7efd5c1044f0 msgr2=0x7efd5c104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.898+0000 7efd646b9700 1 -- 172.21.15.70:0/1136198326 shutdown_connections 2024-04-26T20:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:32.898+0000 7efd646b9700 1 -- 172.21.15.70:0/1136198326 wait complete. 2024-04-26T20:17:33.742 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:33 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:33.665+0000 7f4cc7fbf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:17:34.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:33 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:33.753+0000 7f4cc7fbf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:17:34.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:33 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1136198326' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-26T20:17:34.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:33 smithi070 ceph-mon[29124]: mgrmap e5: x(active, since 6s) 2024-04-26T20:17:34.848 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:17:34.848 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-26T20:17:34.848 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.969+0000 7f0dc490f700 1 Processor -- start 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.969+0000 7f0dc490f700 1 -- start start 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.969+0000 7f0dc490f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc01081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.969+0000 7f0dc490f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc01087c0 con 0x7f0dc0107dd0 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.969+0000 7f0dbe59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc01081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.969+0000 7f0dbe59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc01081f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55166/0 (socket says 172.21.15.70:55166) 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.969+0000 7f0dbe59c700 1 -- 172.21.15.70:0/2663195996 learned_addr learned my addr 172.21.15.70:0/2663195996 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.970+0000 7f0dbe59c700 1 -- 172.21.15.70:0/2663195996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc0108fd0 con 0x7f0dc0107dd0 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.970+0000 7f0dbe59c700 1 --2- 172.21.15.70:0/2663195996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc01081f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0db00098a0 tx=0x7f0db0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615b4bd3dc32d1be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.970+0000 7f0dbd59a700 1 -- 172.21.15.70:0/2663195996 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db0004160 con 0x7f0dc0107dd0 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.970+0000 7f0dbd59a700 1 -- 172.21.15.70:0/2663195996 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f0db0004300 con 0x7f0dc0107dd0 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.970+0000 7f0dbd59a700 1 -- 172.21.15.70:0/2663195996 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db0011b20 con 0x7f0dc0107dd0 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.971+0000 7f0dc490f700 1 -- 172.21.15.70:0/2663195996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 msgr2=0x7f0dc01081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.971+0000 7f0dc490f700 1 --2- 172.21.15.70:0/2663195996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc01081f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0db00098a0 tx=0x7f0db0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.971+0000 7f0dc490f700 1 -- 172.21.15.70:0/2663195996 shutdown_connections 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.971+0000 7f0dc490f700 1 --2- 172.21.15.70:0/2663195996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc01081f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.971+0000 7f0dc490f700 1 -- 172.21.15.70:0/2663195996 >> 172.21.15.70:0/2663195996 conn(0x7f0dc0103350 msgr2=0x7f0dc01057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.971+0000 7f0dc490f700 1 -- 172.21.15.70:0/2663195996 shutdown_connections 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.971+0000 7f0dc490f700 1 -- 172.21.15.70:0/2663195996 wait complete. 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.972+0000 7f0dc490f700 1 Processor -- start 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.972+0000 7f0dc490f700 1 -- start start 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.972+0000 7f0dc490f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.972+0000 7f0dc490f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc010c380 con 0x7f0dc0107dd0 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.972+0000 7f0dbe59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.972+0000 7f0dbe59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55172/0 (socket says 172.21.15.70:55172) 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.972+0000 7f0dbe59c700 1 -- 172.21.15.70:0/2919045437 learned_addr learned my addr 172.21.15.70:0/2919045437 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.972+0000 7f0dbe59c700 1 -- 172.21.15.70:0/2919045437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc019d3a0 con 0x7f0dc0107dd0 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.972+0000 7f0dbe59c700 1 --2- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc019ce60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0db0006af0 tx=0x7f0db0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.972+0000 7f0daf7fe700 1 -- 172.21.15.70:0/2919045437 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db0003930 con 0x7f0dc0107dd0 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.973+0000 7f0dc490f700 1 -- 172.21.15.70:0/2919045437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc019d630 con 0x7f0dc0107dd0 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.973+0000 7f0daf7fe700 1 -- 172.21.15.70:0/2919045437 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f0db0003ad0 con 0x7f0dc0107dd0 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.973+0000 7f0daf7fe700 1 -- 172.21.15.70:0/2919045437 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db0019610 con 0x7f0dc0107dd0 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.973+0000 7f0dc490f700 1 -- 172.21.15.70:0/2919045437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc019da90 con 0x7f0dc0107dd0 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.973+0000 7f0daf7fe700 1 -- 172.21.15.70:0/2919045437 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f0db00198d0 con 0x7f0dc0107dd0 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.974+0000 7f0dc490f700 1 -- 172.21.15.70:0/2919045437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc0064a80 con 0x7f0dc0107dd0 2024-04-26T20:17:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.974+0000 7f0daf7fe700 1 --2- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f0da8039560 0x7f0da803ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.974+0000 7f0dbdd9b700 1 -- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f0da8039560 msgr2=0x7f0da803ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3935679702 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.974+0000 7f0daf7fe700 1 -- 172.21.15.70:0/2919045437 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0db004db10 con 0x7f0dc0107dd0 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.974+0000 7f0dbdd9b700 1 --2- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f0da8039560 0x7f0da803ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:33.979+0000 7f0daf7fe700 1 -- 172.21.15.70:0/2919045437 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f0db0011e20 con 0x7f0dc0107dd0 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.175+0000 7f0dbdd9b700 1 -- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f0da8039560 msgr2=0x7f0da803ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3935679702 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.175+0000 7f0dbdd9b700 1 --2- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f0da8039560 0x7f0da803ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.283+0000 7f0dc490f700 1 -- 172.21.15.70:0/2919045437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f0dc0064030 con 0x7f0dc0107dd0 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.284+0000 7f0daf7fe700 1 -- 172.21.15.70:0/2919045437 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f0db0017ca0 con 0x7f0dc0107dd0 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.286+0000 7f0dc490f700 1 -- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f0da8039560 msgr2=0x7f0da803ba20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.286+0000 7f0dc490f700 1 --2- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f0da8039560 0x7f0da803ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.286+0000 7f0dc490f700 1 -- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 msgr2=0x7f0dc019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.286+0000 7f0dc490f700 1 --2- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc019ce60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0db0006af0 tx=0x7f0db0011c10 comp rx=0 tx=0).stop 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.286+0000 7f0dc490f700 1 -- 172.21.15.70:0/2919045437 shutdown_connections 2024-04-26T20:17:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.286+0000 7f0dc490f700 1 --2- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f0da8039560 0x7f0da803ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:34.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.286+0000 7f0dc490f700 1 --2- 172.21.15.70:0/2919045437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dc0107dd0 0x7f0dc019ce60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:34.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.286+0000 7f0dc490f700 1 -- 172.21.15.70:0/2919045437 >> 172.21.15.70:0/2919045437 conn(0x7f0dc0103350 msgr2=0x7f0dc01041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:34.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.286+0000 7f0dc490f700 1 -- 172.21.15.70:0/2919045437 shutdown_connections 2024-04-26T20:17:34.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:34.286+0000 7f0dc490f700 1 -- 172.21.15.70:0/2919045437 wait complete. 2024-04-26T20:17:34.853 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2024-04-26T20:17:34.853 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 5... 2024-04-26T20:17:35.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:34 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2919045437' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T20:17:35.186 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:35 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:35.009+0000 7f4cc7fbf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:17:35.534 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:35 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:35.185+0000 7f4cc7fbf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:17:35.535 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:35 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:35.355+0000 7f4cc7fbf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:17:35.938 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:35 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:35.643+0000 7f4cc7fbf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:17:35.938 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:35 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:35.735+0000 7f4cc7fbf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:17:35.938 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:35 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:35.937+0000 7f4cc7fbf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:17:36.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:36 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:36.128+0000 7f4cc7fbf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:17:37.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:36 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:36.726+0000 7f4cc7fbf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:17:37.449 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:37 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:37.149+0000 7f4cc7fbf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:17:37.449 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:37 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:37.246+0000 7f4cc7fbf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:17:37.449 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:37 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:37.448+0000 7f4cc7fbf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:17:38.219 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:37 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:37.964+0000 7f4cc7fbf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:17:38.219 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:38 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:38.056+0000 7f4cc7fbf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:17:38.527 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:38 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:38.299+0000 7f4cc7fbf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:17:38.528 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:38 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:38.431+0000 7f4cc7fbf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:17:38.528 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:38 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:38.526+0000 7f4cc7fbf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:17:38.784 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:38 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:38.643+0000 7f4cc7fbf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:17:39.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:38 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:38.947+0000 7f4cc7fbf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:17:39.809 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:39.540+0000 7f4cc7fbf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:17:39.810 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:17:39.756+0000 7f4cc7fbf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:17:40.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: Active manager daemon x restarted 2024-04-26T20:17:40.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: Activating manager daemon x 2024-04-26T20:17:40.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: osdmap e2: 0 total, 0 up, 0 in 2024-04-26T20:17:40.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: mgrmap e6: x(active, starting, since 0.00330472s) 2024-04-26T20:17:40.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:17:40.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T20:17:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:17:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:17:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:17:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: Manager daemon x is now available 2024-04-26T20:17:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:17:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:39 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:17:41.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:40 smithi070 ceph-mon[29124]: Found migration_current of "None". Setting to last migration. 2024-04-26T20:17:41.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:40 smithi070 ceph-mon[29124]: mgrmap e7: x(active, since 1.00574s) 2024-04-26T20:17:41.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:17:41.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-26T20:17:41.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.209+0000 7f6e3f080700 1 Processor -- start 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.209+0000 7f6e3f080700 1 -- start start 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.209+0000 7f6e3f080700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3810bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.209+0000 7f6e3f080700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3807cea0 con 0x7f6e38109940 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.209+0000 7f6e3ce1c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3810bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.210+0000 7f6e3ce1c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3810bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55178/0 (socket says 172.21.15.70:55178) 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.210+0000 7f6e3ce1c700 1 -- 172.21.15.70:0/2664670027 learned_addr learned my addr 172.21.15.70:0/2664670027 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.210+0000 7f6e3ce1c700 1 -- 172.21.15.70:0/2664670027 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3810c270 con 0x7f6e38109940 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.210+0000 7f6e3ce1c700 1 --2- 172.21.15.70:0/2664670027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3810bd30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0098a0 tx=0x7f6e2c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c904363143254c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.210+0000 7f6e377fe700 1 -- 172.21.15.70:0/2664670027 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c004160 con 0x7f6e38109940 2024-04-26T20:17:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.210+0000 7f6e377fe700 1 -- 172.21.15.70:0/2664670027 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f6e2c004300 con 0x7f6e38109940 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.210+0000 7f6e377fe700 1 -- 172.21.15.70:0/2664670027 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c011b20 con 0x7f6e38109940 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.211+0000 7f6e3f080700 1 -- 172.21.15.70:0/2664670027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 msgr2=0x7f6e3810bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.211+0000 7f6e3f080700 1 --2- 172.21.15.70:0/2664670027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3810bd30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0098a0 tx=0x7f6e2c009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.211+0000 7f6e3f080700 1 -- 172.21.15.70:0/2664670027 shutdown_connections 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.211+0000 7f6e3f080700 1 --2- 172.21.15.70:0/2664670027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3810bd30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.211+0000 7f6e3f080700 1 -- 172.21.15.70:0/2664670027 >> 172.21.15.70:0/2664670027 conn(0x7f6e38103370 msgr2=0x7f6e381057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.211+0000 7f6e3f080700 1 -- 172.21.15.70:0/2664670027 shutdown_connections 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.211+0000 7f6e3f080700 1 -- 172.21.15.70:0/2664670027 wait complete. 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.211+0000 7f6e3f080700 1 Processor -- start 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e3f080700 1 -- start start 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e3f080700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e3f080700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3810d2a0 con 0x7f6e38109940 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e3ce1c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:41.349 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e3ce1c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3819ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55186/0 (socket says 172.21.15.70:55186) 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e3ce1c700 1 -- 172.21.15.70:0/1950541815 learned_addr learned my addr 172.21.15.70:0/1950541815 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e3ce1c700 1 -- 172.21.15.70:0/1950541815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3819d380 con 0x7f6e38109940 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e3ce1c700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3819ce40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0116a0 tx=0x7f6e2c011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e35ffb700 1 -- 172.21.15.70:0/1950541815 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c003ab0 con 0x7f6e38109940 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e35ffb700 1 -- 172.21.15.70:0/1950541815 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f6e2c003c50 con 0x7f6e38109940 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e3f080700 1 -- 172.21.15.70:0/1950541815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3819d610 con 0x7f6e38109940 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.212+0000 7f6e35ffb700 1 -- 172.21.15.70:0/1950541815 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c019870 con 0x7f6e38109940 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.213+0000 7f6e3f080700 1 -- 172.21.15.70:0/1950541815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3819da70 con 0x7f6e38109940 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.213+0000 7f6e35ffb700 1 -- 172.21.15.70:0/1950541815 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f6e2c019b30 con 0x7f6e38109940 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.214+0000 7f6e35ffb700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 0x7f6e2803ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.214+0000 7f6e3f080700 1 -- 172.21.15.70:0/1950541815 --> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6e38064a80 con 0x7f6e28039560 2024-04-26T20:17:41.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.214+0000 7f6e35ffb700 1 -- 172.21.15.70:0/1950541815 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6e2c04ecc0 con 0x7f6e38109940 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.214+0000 7f6e37fff700 1 -- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 msgr2=0x7f6e2803ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3935679702 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.214+0000 7f6e37fff700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 0x7f6e2803ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.415+0000 7f6e37fff700 1 -- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 msgr2=0x7f6e2803ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3935679702 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.415+0000 7f6e37fff700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 0x7f6e2803ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.816+0000 7f6e37fff700 1 -- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 msgr2=0x7f6e2803ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3935679702 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:35.816+0000 7f6e37fff700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 0x7f6e2803ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:36.617+0000 7f6e37fff700 1 -- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 msgr2=0x7f6e2803ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3935679702 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:36.617+0000 7f6e37fff700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 0x7f6e2803ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:38.218+0000 7f6e37fff700 1 -- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 msgr2=0x7f6e2803ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3935679702 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:38.218+0000 7f6e37fff700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 0x7f6e2803ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:39.759+0000 7f6e35ffb700 1 -- 172.21.15.70:0/1950541815 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mgrmap(e 6) ==== 46325+0+0 (secure 0 0 0) 0x7f6e2c02dcd0 con 0x7f6e38109940 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:39.759+0000 7f6e35ffb700 1 -- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 msgr2=0x7f6e2803ba20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:17:41.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:39.759+0000 7f6e35ffb700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 0x7f6e2803ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.760+0000 7f6e35ffb700 1 -- 172.21.15.70:0/1950541815 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f6e2c01ac00 con 0x7f6e38109940 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.761+0000 7f6e35ffb700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6e2803cc60 0x7f6e2803f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.761+0000 7f6e35ffb700 1 -- 172.21.15.70:0/1950541815 --> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6e2c001d30 con 0x7f6e2803cc60 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.761+0000 7f6e37fff700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6e2803cc60 0x7f6e2803f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.762+0000 7f6e37fff700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6e2803cc60 0x7f6e2803f050 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6e24003a10 tx=0x7f6e24009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.762+0000 7f6e35ffb700 1 -- 172.21.15.70:0/1950541815 <== mgr.14120 v2:172.21.15.70:6800/2279707405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f6e2c001d30 con 0x7f6e2803cc60 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.770+0000 7f6e3f080700 1 -- 172.21.15.70:0/1950541815 --> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f6e38104570 con 0x7f6e2803cc60 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.770+0000 7f6e35ffb700 1 -- 172.21.15.70:0/1950541815 <== mgr.14120 v2:172.21.15.70:6800/2279707405 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f6e38104570 con 0x7f6e2803cc60 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.771+0000 7f6e3f080700 1 -- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6e2803cc60 msgr2=0x7f6e2803f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.771+0000 7f6e3f080700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6e2803cc60 0x7f6e2803f050 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6e24003a10 tx=0x7f6e24009290 comp rx=0 tx=0).stop 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.771+0000 7f6e3f080700 1 -- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 msgr2=0x7f6e3819ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.771+0000 7f6e3f080700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3819ce40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0116a0 tx=0x7f6e2c011ce0 comp rx=0 tx=0).stop 2024-04-26T20:17:41.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.771+0000 7f6e3f080700 1 -- 172.21.15.70:0/1950541815 shutdown_connections 2024-04-26T20:17:41.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.771+0000 7f6e3f080700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6e2803cc60 0x7f6e2803f050 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:41.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.771+0000 7f6e3f080700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e38109940 0x7f6e3819ce40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:41.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.771+0000 7f6e3f080700 1 --2- 172.21.15.70:0/1950541815 >> [v2:172.21.15.70:6800/3935679702,v1:172.21.15.70:6801/3935679702] conn(0x7f6e28039560 0x7f6e2803ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:41.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.771+0000 7f6e3f080700 1 -- 172.21.15.70:0/1950541815 >> 172.21.15.70:0/1950541815 conn(0x7f6e38103370 msgr2=0x7f6e38103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:41.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.771+0000 7f6e3f080700 1 -- 172.21.15.70:0/1950541815 shutdown_connections 2024-04-26T20:17:41.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:40.771+0000 7f6e3f080700 1 -- 172.21.15.70:0/1950541815 wait complete. 2024-04-26T20:17:41.353 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 5 is available 2024-04-26T20:17:41.353 INFO:teuthology.orchestra.run.smithi070.stdout:Setting orchestrator backend to cephadm... 2024-04-26T20:17:41.973 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:41 smithi070 ceph-mon[29124]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T20:17:41.973 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:41 smithi070 ceph-mon[29124]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T20:17:41.974 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:41 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:41.974 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:41 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:41.974 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:41 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:42.577 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.746+0000 7fb8f4978700 1 Processor -- start 2024-04-26T20:17:42.577 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.746+0000 7fb8f4978700 1 -- start start 2024-04-26T20:17:42.577 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.747+0000 7fb8f4978700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f010bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:42.577 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.747+0000 7fb8f4978700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f007ce40 con 0x7fb8f0109990 2024-04-26T20:17:42.577 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.747+0000 7fb8ee59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f010bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:42.577 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.747+0000 7fb8ee59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f010bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54794/0 (socket says 172.21.15.70:54794) 2024-04-26T20:17:42.577 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.747+0000 7fb8ee59c700 1 -- 172.21.15.70:0/734632567 learned_addr learned my addr 172.21.15.70:0/734632567 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.747+0000 7fb8ee59c700 1 -- 172.21.15.70:0/734632567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f010c2c0 con 0x7fb8f0109990 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.747+0000 7fb8ee59c700 1 --2- 172.21.15.70:0/734632567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f010bd80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00098a0 tx=0x7fb8e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a1134ecd7607d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.747+0000 7fb8ed59a700 1 -- 172.21.15.70:0/734632567 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e0004160 con 0x7fb8f0109990 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.747+0000 7fb8ed59a700 1 -- 172.21.15.70:0/734632567 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fb8e0004300 con 0x7fb8f0109990 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.747+0000 7fb8ed59a700 1 -- 172.21.15.70:0/734632567 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e0011b20 con 0x7fb8f0109990 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.748+0000 7fb8f4978700 1 -- 172.21.15.70:0/734632567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 msgr2=0x7fb8f010bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.748+0000 7fb8f4978700 1 --2- 172.21.15.70:0/734632567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f010bd80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00098a0 tx=0x7fb8e0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.748+0000 7fb8f4978700 1 -- 172.21.15.70:0/734632567 shutdown_connections 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.748+0000 7fb8f4978700 1 --2- 172.21.15.70:0/734632567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f010bd80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.748+0000 7fb8f4978700 1 -- 172.21.15.70:0/734632567 >> 172.21.15.70:0/734632567 conn(0x7fb8f01033a0 msgr2=0x7fb8f01057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.748+0000 7fb8f4978700 1 -- 172.21.15.70:0/734632567 shutdown_connections 2024-04-26T20:17:42.578 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.748+0000 7fb8f4978700 1 -- 172.21.15.70:0/734632567 wait complete. 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.749+0000 7fb8f4978700 1 Processor -- start 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.749+0000 7fb8f4978700 1 -- start start 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.749+0000 7fb8f4978700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.749+0000 7fb8f4978700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f010d290 con 0x7fb8f0109990 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.749+0000 7fb8ee59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.749+0000 7fb8ee59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f019ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54802/0 (socket says 172.21.15.70:54802) 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.749+0000 7fb8ee59c700 1 -- 172.21.15.70:0/4089935925 learned_addr learned my addr 172.21.15.70:0/4089935925 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.749+0000 7fb8ee59c700 1 -- 172.21.15.70:0/4089935925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f019d3b0 con 0x7fb8f0109990 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.749+0000 7fb8ee59c700 1 --2- 172.21.15.70:0/4089935925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f019ce70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00116a0 tx=0x7fb8e0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.750+0000 7fb8df7fe700 1 -- 172.21.15.70:0/4089935925 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e0003ab0 con 0x7fb8f0109990 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.750+0000 7fb8df7fe700 1 -- 172.21.15.70:0/4089935925 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fb8e0003c50 con 0x7fb8f0109990 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.750+0000 7fb8f4978700 1 -- 172.21.15.70:0/4089935925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f019d640 con 0x7fb8f0109990 2024-04-26T20:17:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.750+0000 7fb8df7fe700 1 -- 172.21.15.70:0/4089935925 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e0019870 con 0x7fb8f0109990 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.750+0000 7fb8f4978700 1 -- 172.21.15.70:0/4089935925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f019daa0 con 0x7fb8f0109990 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.750+0000 7fb8df7fe700 1 -- 172.21.15.70:0/4089935925 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7fb8e0019b30 con 0x7fb8f0109990 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.751+0000 7fb8f4978700 1 -- 172.21.15.70:0/4089935925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f0064a80 con 0x7fb8f0109990 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.751+0000 7fb8df7fe700 1 --2- 172.21.15.70:0/4089935925 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fb8d8039450 0x7fb8d803b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.751+0000 7fb8df7fe700 1 -- 172.21.15.70:0/4089935925 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb8e004d980 con 0x7fb8f0109990 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.751+0000 7fb8edd9b700 1 --2- 172.21.15.70:0/4089935925 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fb8d8039450 0x7fb8d803b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.751+0000 7fb8edd9b700 1 --2- 172.21.15.70:0/4089935925 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fb8d8039450 0x7fb8d803b910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4006fd0 tx=0x7fb8e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.756+0000 7fb8df7fe700 1 -- 172.21.15.70:0/4089935925 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb8e0011e20 con 0x7fb8f0109990 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.972+0000 7fb8f4978700 1 -- 172.21.15.70:0/4089935925 --> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fb8f01045c0 con 0x7fb8d8039450 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.977+0000 7fb8df7fe700 1 -- 172.21.15.70:0/4089935925 <== mgr.14120 v2:172.21.15.70:6800/2279707405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb8f01045c0 con 0x7fb8d8039450 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.979+0000 7fb8f4978700 1 -- 172.21.15.70:0/4089935925 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fb8d8039450 msgr2=0x7fb8d803b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.979+0000 7fb8f4978700 1 --2- 172.21.15.70:0/4089935925 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fb8d8039450 0x7fb8d803b910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4006fd0 tx=0x7fb8e4006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:42.580 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.979+0000 7fb8f4978700 1 -- 172.21.15.70:0/4089935925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 msgr2=0x7fb8f019ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:42.581 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.979+0000 7fb8f4978700 1 --2- 172.21.15.70:0/4089935925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f019ce70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00116a0 tx=0x7fb8e0011ce0 comp rx=0 tx=0).stop 2024-04-26T20:17:42.581 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.979+0000 7fb8f4978700 1 -- 172.21.15.70:0/4089935925 shutdown_connections 2024-04-26T20:17:42.581 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.979+0000 7fb8f4978700 1 --2- 172.21.15.70:0/4089935925 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fb8d8039450 0x7fb8d803b910 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:42.581 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.979+0000 7fb8f4978700 1 --2- 172.21.15.70:0/4089935925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8f0109990 0x7fb8f019ce70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:42.581 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.979+0000 7fb8f4978700 1 -- 172.21.15.70:0/4089935925 >> 172.21.15.70:0/4089935925 conn(0x7fb8f01033a0 msgr2=0x7fb8f0103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:42.581 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.979+0000 7fb8f4978700 1 -- 172.21.15.70:0/4089935925 shutdown_connections 2024-04-26T20:17:42.581 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:41.979+0000 7fb8f4978700 1 -- 172.21.15.70:0/4089935925 wait complete. 2024-04-26T20:17:42.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:42 smithi070 ceph-mon[29124]: [26/Apr/2024:20:17:41] ENGINE Bus STARTING 2024-04-26T20:17:42.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:42 smithi070 ceph-mon[29124]: [26/Apr/2024:20:17:41] ENGINE Serving on https://172.21.15.70:7150 2024-04-26T20:17:42.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:42 smithi070 ceph-mon[29124]: [26/Apr/2024:20:17:41] ENGINE Serving on http://172.21.15.70:8765 2024-04-26T20:17:42.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:42 smithi070 ceph-mon[29124]: [26/Apr/2024:20:17:41] ENGINE Bus STARTED 2024-04-26T20:17:42.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:42 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:42.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:42 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:42.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:42 smithi070 ceph-mon[29124]: mgrmap e8: x(active, since 2s) 2024-04-26T20:17:43.791 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-26T20:17:43.791 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.970+0000 7f6d20db6700 1 Processor -- start 2024-04-26T20:17:43.791 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.970+0000 7f6d20db6700 1 -- start start 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.971+0000 7f6d20db6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c1092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.971+0000 7f6d20db6700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c109820 con 0x7f6d1c108ec0 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.971+0000 7f6d1a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c1092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.971+0000 7f6d1a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c1092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54808/0 (socket says 172.21.15.70:54808) 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.971+0000 7f6d1a59c700 1 -- 172.21.15.70:0/3233525048 learned_addr learned my addr 172.21.15.70:0/3233525048 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.971+0000 7f6d1a59c700 1 -- 172.21.15.70:0/3233525048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c10a060 con 0x7f6d1c108ec0 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.971+0000 7f6d1a59c700 1 --2- 172.21.15.70:0/3233525048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c1092e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0098a0 tx=0x7f6d0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823d1c18eb0cf9b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.971+0000 7f6d1959a700 1 -- 172.21.15.70:0/3233525048 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d0c004160 con 0x7f6d1c108ec0 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.971+0000 7f6d1959a700 1 -- 172.21.15.70:0/3233525048 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f6d0c004300 con 0x7f6d1c108ec0 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.971+0000 7f6d1959a700 1 -- 172.21.15.70:0/3233525048 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d0c011b20 con 0x7f6d1c108ec0 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.972+0000 7f6d20db6700 1 -- 172.21.15.70:0/3233525048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 msgr2=0x7f6d1c1092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:43.792 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.972+0000 7f6d20db6700 1 --2- 172.21.15.70:0/3233525048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c1092e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0098a0 tx=0x7f6d0c009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.972+0000 7f6d20db6700 1 -- 172.21.15.70:0/3233525048 shutdown_connections 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.972+0000 7f6d20db6700 1 --2- 172.21.15.70:0/3233525048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c1092e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.972+0000 7f6d20db6700 1 -- 172.21.15.70:0/3233525048 >> 172.21.15.70:0/3233525048 conn(0x7f6d1c1044b0 msgr2=0x7f6d1c1068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.972+0000 7f6d20db6700 1 -- 172.21.15.70:0/3233525048 shutdown_connections 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.972+0000 7f6d20db6700 1 -- 172.21.15.70:0/3233525048 wait complete. 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.973+0000 7f6d20db6700 1 Processor -- start 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.973+0000 7f6d20db6700 1 -- start start 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.973+0000 7f6d20db6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.973+0000 7f6d20db6700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c10d320 con 0x7f6d1c108ec0 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.973+0000 7f6d1a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.973+0000 7f6d1a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54820/0 (socket says 172.21.15.70:54820) 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.973+0000 7f6d1a59c700 1 -- 172.21.15.70:0/3644986266 learned_addr learned my addr 172.21.15.70:0/3644986266 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.973+0000 7f6d1a59c700 1 -- 172.21.15.70:0/3644986266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c19d3c0 con 0x7f6d1c108ec0 2024-04-26T20:17:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.973+0000 7f6d1a59c700 1 --2- 172.21.15.70:0/3644986266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c19ce80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c006af0 tx=0x7f6d0c011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.973+0000 7f6d0b7fe700 1 -- 172.21.15.70:0/3644986266 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d0c003930 con 0x7f6d1c108ec0 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.974+0000 7f6d0b7fe700 1 -- 172.21.15.70:0/3644986266 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f6d0c003ad0 con 0x7f6d1c108ec0 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.974+0000 7f6d20db6700 1 -- 172.21.15.70:0/3644986266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1c19d650 con 0x7f6d1c108ec0 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.974+0000 7f6d0b7fe700 1 -- 172.21.15.70:0/3644986266 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d0c019610 con 0x7f6d1c108ec0 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.974+0000 7f6d20db6700 1 -- 172.21.15.70:0/3644986266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1c19dab0 con 0x7f6d1c108ec0 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.974+0000 7f6d0b7fe700 1 -- 172.21.15.70:0/3644986266 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f6d0c0198d0 con 0x7f6d1c108ec0 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.974+0000 7f6d20db6700 1 -- 172.21.15.70:0/3644986266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d1c064a80 con 0x7f6d1c108ec0 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.975+0000 7f6d0b7fe700 1 --2- 172.21.15.70:0/3644986266 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6d04039560 0x7f6d0403ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.975+0000 7f6d0b7fe700 1 -- 172.21.15.70:0/3644986266 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6d0c04db10 con 0x7f6d1c108ec0 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.975+0000 7f6d19d9b700 1 --2- 172.21.15.70:0/3644986266 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6d04039560 0x7f6d0403ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.975+0000 7f6d19d9b700 1 --2- 172.21.15.70:0/3644986266 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6d04039560 0x7f6d0403ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d10006fd0 tx=0x7f6d10006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:43.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:42.980+0000 7f6d0b7fe700 1 -- 172.21.15.70:0/3644986266 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f6d0c011e20 con 0x7f6d1c108ec0 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.181+0000 7f6d20db6700 1 -- 172.21.15.70:0/3644986266 --> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f6d1c105750 con 0x7f6d04039560 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.182+0000 7f6d0b7fe700 1 -- 172.21.15.70:0/3644986266 <== mgr.14120 v2:172.21.15.70:6800/2279707405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f6d1c105750 con 0x7f6d04039560 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.184+0000 7f6d20db6700 1 -- 172.21.15.70:0/3644986266 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6d04039560 msgr2=0x7f6d0403ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.184+0000 7f6d20db6700 1 --2- 172.21.15.70:0/3644986266 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6d04039560 0x7f6d0403ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d10006fd0 tx=0x7f6d10006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.184+0000 7f6d20db6700 1 -- 172.21.15.70:0/3644986266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 msgr2=0x7f6d1c19ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.184+0000 7f6d20db6700 1 --2- 172.21.15.70:0/3644986266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c19ce80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c006af0 tx=0x7f6d0c011c10 comp rx=0 tx=0).stop 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.184+0000 7f6d20db6700 1 -- 172.21.15.70:0/3644986266 shutdown_connections 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.184+0000 7f6d20db6700 1 --2- 172.21.15.70:0/3644986266 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f6d04039560 0x7f6d0403ba20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.184+0000 7f6d20db6700 1 --2- 172.21.15.70:0/3644986266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d1c108ec0 0x7f6d1c19ce80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.184+0000 7f6d20db6700 1 -- 172.21.15.70:0/3644986266 >> 172.21.15.70:0/3644986266 conn(0x7f6d1c1044b0 msgr2=0x7f6d1c105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.184+0000 7f6d20db6700 1 -- 172.21.15.70:0/3644986266 shutdown_connections 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:43.184+0000 7f6d20db6700 1 -- 172.21.15.70:0/3644986266 wait complete. 2024-04-26T20:17:43.795 INFO:teuthology.orchestra.run.smithi070.stdout:Generating ssh key... 2024-04-26T20:17:44.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:43 smithi070 ceph-mon[29124]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:44.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: Generating public/private rsa key pair. 2024-04-26T20:17:44.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: Your identification has been saved in /tmp/tmpad2pec_d/key. 2024-04-26T20:17:44.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: Your public key has been saved in /tmp/tmpad2pec_d/key.pub. 2024-04-26T20:17:44.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: The key fingerprint is: 2024-04-26T20:17:44.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: SHA256:nC31TVs9lxHrtiVBuplF/Ti3xNO66qPwiqqzNVNF4XU ceph-cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:17:44.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: The key's randomart image is: 2024-04-26T20:17:44.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: +---[RSA 3072]----+ 2024-04-26T20:17:44.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: | o.. E o+.| 2024-04-26T20:17:44.786 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: | o . . + *| 2024-04-26T20:17:44.786 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: | o . . ==*| 2024-04-26T20:17:44.786 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: | o + . B+B*| 2024-04-26T20:17:44.786 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: | . S . = =*+| 2024-04-26T20:17:44.786 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: | . . ooo| 2024-04-26T20:17:44.786 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: | + . o | 2024-04-26T20:17:44.786 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: | .. o . o . . | 2024-04-26T20:17:44.786 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: | o+... ..oooo | 2024-04-26T20:17:44.786 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: +----[SHA256]-----+ 2024-04-26T20:17:45.173 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-mon[29124]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:45.174 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:45.174 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:44 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:45.181 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.231+0000 7f8545f9f700 1 Processor -- start 2024-04-26T20:17:45.181 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.231+0000 7f8545f9f700 1 -- start start 2024-04-26T20:17:45.181 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.231+0000 7f8545f9f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f85401081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:45.181 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.231+0000 7f8545f9f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85401087c0 con 0x7f8540107dd0 2024-04-26T20:17:45.181 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.231+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f85401081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:45.181 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.231+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f85401081f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54828/0 (socket says 172.21.15.70:54828) 2024-04-26T20:17:45.181 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.231+0000 7f853f7fe700 1 -- 172.21.15.70:0/438597901 learned_addr learned my addr 172.21.15.70:0/438597901 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:45.181 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.231+0000 7f853f7fe700 1 -- 172.21.15.70:0/438597901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8540108fd0 con 0x7f8540107dd0 2024-04-26T20:17:45.181 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.232+0000 7f853f7fe700 1 --2- 172.21.15.70:0/438597901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f85401081f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f85300098a0 tx=0x7f8530009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eebc4b255cef6f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:45.181 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.232+0000 7f853e7fc700 1 -- 172.21.15.70:0/438597901 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8530004160 con 0x7f8540107dd0 2024-04-26T20:17:45.182 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.232+0000 7f853e7fc700 1 -- 172.21.15.70:0/438597901 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8530004300 con 0x7f8540107dd0 2024-04-26T20:17:45.182 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.232+0000 7f853e7fc700 1 -- 172.21.15.70:0/438597901 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8530011b20 con 0x7f8540107dd0 2024-04-26T20:17:45.182 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.232+0000 7f8545f9f700 1 -- 172.21.15.70:0/438597901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 msgr2=0x7f85401081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:45.182 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.232+0000 7f8545f9f700 1 --2- 172.21.15.70:0/438597901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f85401081f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f85300098a0 tx=0x7f8530009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:45.182 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.232+0000 7f8545f9f700 1 -- 172.21.15.70:0/438597901 shutdown_connections 2024-04-26T20:17:45.182 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.232+0000 7f8545f9f700 1 --2- 172.21.15.70:0/438597901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f85401081f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:45.182 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.232+0000 7f8545f9f700 1 -- 172.21.15.70:0/438597901 >> 172.21.15.70:0/438597901 conn(0x7f8540103350 msgr2=0x7f85401057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:45.182 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.232+0000 7f8545f9f700 1 -- 172.21.15.70:0/438597901 shutdown_connections 2024-04-26T20:17:45.182 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.232+0000 7f8545f9f700 1 -- 172.21.15.70:0/438597901 wait complete. 2024-04-26T20:17:45.183 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.233+0000 7f8545f9f700 1 Processor -- start 2024-04-26T20:17:45.183 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.233+0000 7f8545f9f700 1 -- start start 2024-04-26T20:17:45.183 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.233+0000 7f8545f9f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f8540192f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:45.183 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.233+0000 7f8545f9f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f854010c380 con 0x7f8540107dd0 2024-04-26T20:17:45.183 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.233+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f8540192f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:45.183 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.233+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f8540192f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54842/0 (socket says 172.21.15.70:54842) 2024-04-26T20:17:45.183 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.233+0000 7f853f7fe700 1 -- 172.21.15.70:0/1595831750 learned_addr learned my addr 172.21.15.70:0/1595831750 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:45.183 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.234+0000 7f853f7fe700 1 -- 172.21.15.70:0/1595831750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85401934c0 con 0x7f8540107dd0 2024-04-26T20:17:45.183 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.234+0000 7f853f7fe700 1 --2- 172.21.15.70:0/1595831750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f8540192f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8530006af0 tx=0x7f8530011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:45.183 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.234+0000 7f853cff9700 1 -- 172.21.15.70:0/1595831750 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8530003930 con 0x7f8540107dd0 2024-04-26T20:17:45.183 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.234+0000 7f853cff9700 1 -- 172.21.15.70:0/1595831750 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8530003ad0 con 0x7f8540107dd0 2024-04-26T20:17:45.184 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.234+0000 7f8545f9f700 1 -- 172.21.15.70:0/1595831750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85401916b0 con 0x7f8540107dd0 2024-04-26T20:17:45.184 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.234+0000 7f853cff9700 1 -- 172.21.15.70:0/1595831750 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8530019610 con 0x7f8540107dd0 2024-04-26T20:17:45.184 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.234+0000 7f8545f9f700 1 -- 172.21.15.70:0/1595831750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8540191b70 con 0x7f8540107dd0 2024-04-26T20:17:45.184 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.235+0000 7f853cff9700 1 -- 172.21.15.70:0/1595831750 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f85300198d0 con 0x7f8540107dd0 2024-04-26T20:17:45.184 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.235+0000 7f8545f9f700 1 -- 172.21.15.70:0/1595831750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8540064a80 con 0x7f8540107dd0 2024-04-26T20:17:45.184 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.235+0000 7f853cff9700 1 --2- 172.21.15.70:0/1595831750 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8528039560 0x7f852803ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:45.184 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.235+0000 7f853cff9700 1 -- 172.21.15.70:0/1595831750 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f853004db00 con 0x7f8540107dd0 2024-04-26T20:17:45.184 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.235+0000 7f853effd700 1 --2- 172.21.15.70:0/1595831750 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8528039560 0x7f852803ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:45.184 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.236+0000 7f853effd700 1 --2- 172.21.15.70:0/1595831750 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8528039560 0x7f852803ba20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8534006fd0 tx=0x7f8534006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.240+0000 7f853cff9700 1 -- 172.21.15.70:0/1595831750 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f8530011e20 con 0x7f8540107dd0 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.438+0000 7f8545f9f700 1 -- 172.21.15.70:0/1595831750 --> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f8540196d20 con 0x7f8528039560 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.608+0000 7f853cff9700 1 -- 172.21.15.70:0/1595831750 <== mgr.14120 v2:172.21.15.70:6800/2279707405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8540196d20 con 0x7f8528039560 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.610+0000 7f8545f9f700 1 -- 172.21.15.70:0/1595831750 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8528039560 msgr2=0x7f852803ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.610+0000 7f8545f9f700 1 --2- 172.21.15.70:0/1595831750 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8528039560 0x7f852803ba20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8534006fd0 tx=0x7f8534006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.610+0000 7f8545f9f700 1 -- 172.21.15.70:0/1595831750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 msgr2=0x7f8540192f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.610+0000 7f8545f9f700 1 --2- 172.21.15.70:0/1595831750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f8540192f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8530006af0 tx=0x7f8530011c10 comp rx=0 tx=0).stop 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.610+0000 7f8545f9f700 1 -- 172.21.15.70:0/1595831750 shutdown_connections 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.610+0000 7f8545f9f700 1 --2- 172.21.15.70:0/1595831750 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8528039560 0x7f852803ba20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.610+0000 7f8545f9f700 1 --2- 172.21.15.70:0/1595831750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8540107dd0 0x7f8540192f80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.610+0000 7f8545f9f700 1 -- 172.21.15.70:0/1595831750 >> 172.21.15.70:0/1595831750 conn(0x7f8540103350 msgr2=0x7f85401041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.610+0000 7f8545f9f700 1 -- 172.21.15.70:0/1595831750 shutdown_connections 2024-04-26T20:17:45.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:44.610+0000 7f8545f9f700 1 -- 172.21.15.70:0/1595831750 wait complete. 2024-04-26T20:17:46.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:45 smithi070 ceph-mon[29124]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:46.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:45 smithi070 ceph-mon[29124]: Generating ssh key... 2024-04-26T20:17:46.321 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhCZcDs+9FZULyQq+hQH+uwgkW8b+a/c3vcOhExgqcKBJD5ygofL6r0u9Sd3gQ5QQY1SMDX8yejPHPZmsAkoHmZP21X6dfisXuAIsrO8RR+IPSixB/DqSLVM4hhBhYnqRwju2Sq1Hu32mMCQWchB9ssig5CWsXU+lAt3nJctuPC2WqM54U4F+OeTkyCY9uzgkgPwVpPhrfUPuwMh3JuWi6p75Qy+s+eR+ko3JWqhKuzM/k0x6WOytxbV8FVKyYMYvMOeoVqs7Rcrwru55Z3DXJNjOV3doe8WMkncd1icvwEr1mSRpMrL6smfQQKxDVS3U9JjT3k3ot0LVURVWEyQQ8tUtNFMZ2q7RvWRPRwTsZ2QfRrTOR93PZOaMG818LWzCf3g/7Ur0CnLa/wO+yJttwPXnmcimI+v7Yl8l9b3AgPjfx/YkZe/FDdRDjOUWVsFoLQTYVYYskTUV2wixy5uxjKvzc6sGPxJq1ICZBwML9q91KeOEWvaMM0CMY7PeyJ20= ceph-cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:17:46.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.573+0000 7f53ea855700 1 Processor -- start 2024-04-26T20:17:46.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.573+0000 7f53ea855700 1 -- start start 2024-04-26T20:17:46.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.573+0000 7f53ea855700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e41092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:46.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.573+0000 7f53ea855700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4109820 con 0x7f53e4108ec0 2024-04-26T20:17:46.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.573+0000 7f53e3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e41092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:46.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.573+0000 7f53e3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e41092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54858/0 (socket says 172.21.15.70:54858) 2024-04-26T20:17:46.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.573+0000 7f53e3fff700 1 -- 172.21.15.70:0/889514516 learned_addr learned my addr 172.21.15.70:0/889514516 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.573+0000 7f53e3fff700 1 -- 172.21.15.70:0/889514516 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e410a060 con 0x7f53e4108ec0 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.574+0000 7f53e3fff700 1 --2- 172.21.15.70:0/889514516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e41092e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53d40098a0 tx=0x7f53d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664296ee227d1bef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.574+0000 7f53e2ffd700 1 -- 172.21.15.70:0/889514516 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d4004160 con 0x7f53e4108ec0 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.574+0000 7f53e2ffd700 1 -- 172.21.15.70:0/889514516 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f53d4004300 con 0x7f53e4108ec0 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.574+0000 7f53e2ffd700 1 -- 172.21.15.70:0/889514516 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d4011b20 con 0x7f53e4108ec0 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.574+0000 7f53ea855700 1 -- 172.21.15.70:0/889514516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 msgr2=0x7f53e41092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.574+0000 7f53ea855700 1 --2- 172.21.15.70:0/889514516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e41092e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53d40098a0 tx=0x7f53d4009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.574+0000 7f53ea855700 1 -- 172.21.15.70:0/889514516 shutdown_connections 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.574+0000 7f53ea855700 1 --2- 172.21.15.70:0/889514516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e41092e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.574+0000 7f53ea855700 1 -- 172.21.15.70:0/889514516 >> 172.21.15.70:0/889514516 conn(0x7f53e41044f0 msgr2=0x7f53e4106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.574+0000 7f53ea855700 1 -- 172.21.15.70:0/889514516 shutdown_connections 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.574+0000 7f53ea855700 1 -- 172.21.15.70:0/889514516 wait complete. 2024-04-26T20:17:46.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.575+0000 7f53ea855700 1 Processor -- start 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.575+0000 7f53ea855700 1 -- start start 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.575+0000 7f53ea855700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.575+0000 7f53ea855700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f53e410d320 con 0x7f53e4108ec0 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.575+0000 7f53e3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.575+0000 7f53e3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54872/0 (socket says 172.21.15.70:54872) 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.575+0000 7f53e3fff700 1 -- 172.21.15.70:0/1987940885 learned_addr learned my addr 172.21.15.70:0/1987940885 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.576+0000 7f53e3fff700 1 -- 172.21.15.70:0/1987940885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e419d340 con 0x7f53e4108ec0 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.576+0000 7f53e3fff700 1 --2- 172.21.15.70:0/1987940885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e419ce00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006af0 tx=0x7f53d4011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.576+0000 7f53e17fa700 1 -- 172.21.15.70:0/1987940885 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d4003930 con 0x7f53e4108ec0 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.576+0000 7f53ea855700 1 -- 172.21.15.70:0/1987940885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e419d5d0 con 0x7f53e4108ec0 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.576+0000 7f53e17fa700 1 -- 172.21.15.70:0/1987940885 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f53d4003ad0 con 0x7f53e4108ec0 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.576+0000 7f53e17fa700 1 -- 172.21.15.70:0/1987940885 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d4019610 con 0x7f53e4108ec0 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.576+0000 7f53ea855700 1 -- 172.21.15.70:0/1987940885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e419da30 con 0x7f53e4108ec0 2024-04-26T20:17:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.577+0000 7f53e17fa700 1 -- 172.21.15.70:0/1987940885 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f53d40198d0 con 0x7f53e4108ec0 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.577+0000 7f53ea855700 1 -- 172.21.15.70:0/1987940885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e4064a80 con 0x7f53e4108ec0 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.577+0000 7f53e17fa700 1 --2- 172.21.15.70:0/1987940885 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f53cc039560 0x7f53cc03ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.577+0000 7f53e17fa700 1 -- 172.21.15.70:0/1987940885 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f53d404db40 con 0x7f53e4108ec0 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.577+0000 7f53e37fe700 1 --2- 172.21.15.70:0/1987940885 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f53cc039560 0x7f53cc03ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.578+0000 7f53e37fe700 1 --2- 172.21.15.70:0/1987940885 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f53cc039560 0x7f53cc03ba20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f53d8006fd0 tx=0x7f53d8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.582+0000 7f53e17fa700 1 -- 172.21.15.70:0/1987940885 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f53d4011e20 con 0x7f53e4108ec0 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.782+0000 7f53ea855700 1 -- 172.21.15.70:0/1987940885 --> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f53e4105670 con 0x7f53cc039560 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.782+0000 7f53e17fa700 1 -- 172.21.15.70:0/1987940885 <== mgr.14120 v2:172.21.15.70:6800/2279707405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f53e4105670 con 0x7f53cc039560 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.784+0000 7f53ea855700 1 -- 172.21.15.70:0/1987940885 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f53cc039560 msgr2=0x7f53cc03ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.784+0000 7f53ea855700 1 --2- 172.21.15.70:0/1987940885 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f53cc039560 0x7f53cc03ba20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f53d8006fd0 tx=0x7f53d8006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.784+0000 7f53ea855700 1 -- 172.21.15.70:0/1987940885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 msgr2=0x7f53e419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:46.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.784+0000 7f53ea855700 1 --2- 172.21.15.70:0/1987940885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e419ce00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006af0 tx=0x7f53d4011c10 comp rx=0 tx=0).stop 2024-04-26T20:17:46.326 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.784+0000 7f53ea855700 1 -- 172.21.15.70:0/1987940885 shutdown_connections 2024-04-26T20:17:46.326 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.784+0000 7f53ea855700 1 --2- 172.21.15.70:0/1987940885 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f53cc039560 0x7f53cc03ba20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:46.326 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.784+0000 7f53ea855700 1 --2- 172.21.15.70:0/1987940885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e4108ec0 0x7f53e419ce00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:46.326 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.784+0000 7f53ea855700 1 -- 172.21.15.70:0/1987940885 >> 172.21.15.70:0/1987940885 conn(0x7f53e41044f0 msgr2=0x7f53e4104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:46.326 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.784+0000 7f53ea855700 1 -- 172.21.15.70:0/1987940885 shutdown_connections 2024-04-26T20:17:46.326 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:45.784+0000 7f53ea855700 1 -- 172.21.15.70:0/1987940885 wait complete. 2024-04-26T20:17:46.326 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-26T20:17:46.326 INFO:teuthology.orchestra.run.smithi070.stdout:Adding key to root@localhost authorized_keys... 2024-04-26T20:17:46.326 INFO:teuthology.orchestra.run.smithi070.stdout:Adding host smithi070... 2024-04-26T20:17:46.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:46 smithi070 ceph-mon[29124]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:48.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:47 smithi070 ceph-mon[29124]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi070", "addr": "172.21.15.70", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:48.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:47 smithi070 ceph-mon[29124]: Deploying cephadm binary to smithi070 2024-04-26T20:17:51.737 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Added host 'smithi070' with addr '172.21.15.70' 2024-04-26T20:17:51.737 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.783+0000 7ff28d74d700 1 Processor -- start 2024-04-26T20:17:51.737 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.783+0000 7ff28d74d700 1 -- start start 2024-04-26T20:17:51.737 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.783+0000 7ff28d74d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:51.737 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.783+0000 7ff28d74d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff288108cb0 con 0x7ff2881082c0 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.784+0000 7ff286ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.784+0000 7ff286ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881086e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54874/0 (socket says 172.21.15.70:54874) 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.784+0000 7ff286ffd700 1 -- 172.21.15.70:0/3120799220 learned_addr learned my addr 172.21.15.70:0/3120799220 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.784+0000 7ff286ffd700 1 -- 172.21.15.70:0/3120799220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff288108fe0 con 0x7ff2881082c0 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.784+0000 7ff286ffd700 1 --2- 172.21.15.70:0/3120799220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881086e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff278009e80 tx=0x7ff27800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d286a6a7c2378d00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.784+0000 7ff285ffb700 1 -- 172.21.15.70:0/3120799220 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff278017070 con 0x7ff2881082c0 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.784+0000 7ff285ffb700 1 -- 172.21.15.70:0/3120799220 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7ff27800b8c0 con 0x7ff2881082c0 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.784+0000 7ff285ffb700 1 -- 172.21.15.70:0/3120799220 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2780045c0 con 0x7ff2881082c0 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.785+0000 7ff28d74d700 1 -- 172.21.15.70:0/3120799220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 msgr2=0x7ff2881086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.785+0000 7ff28d74d700 1 --2- 172.21.15.70:0/3120799220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881086e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff278009e80 tx=0x7ff27800b330 comp rx=0 tx=0).stop 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.785+0000 7ff28d74d700 1 -- 172.21.15.70:0/3120799220 shutdown_connections 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.785+0000 7ff28d74d700 1 --2- 172.21.15.70:0/3120799220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881086e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.785+0000 7ff28d74d700 1 -- 172.21.15.70:0/3120799220 >> 172.21.15.70:0/3120799220 conn(0x7ff288102b20 msgr2=0x7ff288104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.785+0000 7ff28d74d700 1 -- 172.21.15.70:0/3120799220 shutdown_connections 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.785+0000 7ff28d74d700 1 -- 172.21.15.70:0/3120799220 wait complete. 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.785+0000 7ff28d74d700 1 Processor -- start 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.786+0000 7ff28d74d700 1 -- start start 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.786+0000 7ff28d74d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881078c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.786+0000 7ff28d74d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff28810c390 con 0x7ff2881082c0 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.786+0000 7ff286ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.786+0000 7ff286ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54882/0 (socket says 172.21.15.70:54882) 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.786+0000 7ff286ffd700 1 -- 172.21.15.70:0/95398161 learned_addr learned my addr 172.21.15.70:0/95398161 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.786+0000 7ff286ffd700 1 -- 172.21.15.70:0/95398161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28819fc50 con 0x7ff2881082c0 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.786+0000 7ff286ffd700 1 --2- 172.21.15.70:0/95398161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881078c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff278009530 tx=0x7ff27800bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.787+0000 7ff27ffff700 1 -- 172.21.15.70:0/95398161 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff278020020 con 0x7ff2881082c0 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.787+0000 7ff27ffff700 1 -- 172.21.15.70:0/95398161 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7ff278003b50 con 0x7ff2881082c0 2024-04-26T20:17:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.787+0000 7ff28d74d700 1 -- 172.21.15.70:0/95398161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28819fe20 con 0x7ff2881082c0 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.787+0000 7ff27ffff700 1 -- 172.21.15.70:0/95398161 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff278017040 con 0x7ff2881082c0 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.787+0000 7ff28d74d700 1 -- 172.21.15.70:0/95398161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2881a0240 con 0x7ff2881082c0 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.787+0000 7ff27ffff700 1 -- 172.21.15.70:0/95398161 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7ff278023020 con 0x7ff2881082c0 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.788+0000 7ff28d74d700 1 -- 172.21.15.70:0/95398161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff288064a80 con 0x7ff2881082c0 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.788+0000 7ff27ffff700 1 --2- 172.21.15.70:0/95398161 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7ff2740395b0 0x7ff27403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.788+0000 7ff27ffff700 1 -- 172.21.15.70:0/95398161 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff27800f050 con 0x7ff2881082c0 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.788+0000 7ff2867fc700 1 --2- 172.21.15.70:0/95398161 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7ff2740395b0 0x7ff27403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.788+0000 7ff2867fc700 1 --2- 172.21.15.70:0/95398161 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7ff2740395b0 0x7ff27403ba70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff270006fd0 tx=0x7ff270006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.793+0000 7ff27ffff700 1 -- 172.21.15.70:0/95398161 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff27802a020 con 0x7ff2881082c0 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:46.995+0000 7ff28d74d700 1 -- 172.21.15.70:0/95398161 --> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi070", "addr": "172.21.15.70", "target": ["mon-mgr", ""]}) -- 0x7ff288103e20 con 0x7ff2740395b0 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:51.110+0000 7ff27ffff700 1 -- 172.21.15.70:0/95398161 <== mgr.14120 v2:172.21.15.70:6800/2279707405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7ff288103e20 con 0x7ff2740395b0 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:51.112+0000 7ff28d74d700 1 -- 172.21.15.70:0/95398161 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7ff2740395b0 msgr2=0x7ff27403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:51.112+0000 7ff28d74d700 1 --2- 172.21.15.70:0/95398161 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7ff2740395b0 0x7ff27403ba70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff270006fd0 tx=0x7ff270006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:51.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:51.112+0000 7ff28d74d700 1 -- 172.21.15.70:0/95398161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 msgr2=0x7ff2881078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:51.741 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:51.112+0000 7ff28d74d700 1 --2- 172.21.15.70:0/95398161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881078c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff278009530 tx=0x7ff27800bdc0 comp rx=0 tx=0).stop 2024-04-26T20:17:51.741 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:51.112+0000 7ff28d74d700 1 -- 172.21.15.70:0/95398161 shutdown_connections 2024-04-26T20:17:51.741 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:51.112+0000 7ff28d74d700 1 --2- 172.21.15.70:0/95398161 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7ff2740395b0 0x7ff27403ba70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:51.741 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:51.112+0000 7ff28d74d700 1 --2- 172.21.15.70:0/95398161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2881082c0 0x7ff2881078c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:51.741 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:51.112+0000 7ff28d74d700 1 -- 172.21.15.70:0/95398161 >> 172.21.15.70:0/95398161 conn(0x7ff288102b20 msgr2=0x7ff288103710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:51.741 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:51.113+0000 7ff28d74d700 1 -- 172.21.15.70:0/95398161 shutdown_connections 2024-04-26T20:17:51.741 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:51.113+0000 7ff28d74d700 1 -- 172.21.15.70:0/95398161 wait complete. 2024-04-26T20:17:51.741 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mon service... 2024-04-26T20:17:52.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:52 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:52.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:52 smithi070 ceph-mon[29124]: Added host smithi070 2024-04-26T20:17:52.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:52 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:53.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:53 smithi070 ceph-mon[29124]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:53.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:53 smithi070 ceph-mon[29124]: Saving service mon spec with placement count:5 2024-04-26T20:17:53.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:53 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.233+0000 7f8da119e700 1 Processor -- start 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.233+0000 7f8da119e700 1 -- start start 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.233+0000 7f8da119e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c1092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.233+0000 7f8da119e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c109820 con 0x7f8d9c108ec0 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.233+0000 7f8d9ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c1092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.233+0000 7f8d9ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c1092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60772/0 (socket says 172.21.15.70:60772) 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.233+0000 7f8d9ad9d700 1 -- 172.21.15.70:0/1878061972 learned_addr learned my addr 172.21.15.70:0/1878061972 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.233+0000 7f8d9ad9d700 1 -- 172.21.15.70:0/1878061972 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c10a060 con 0x7f8d9c108ec0 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.234+0000 7f8d9ad9d700 1 --2- 172.21.15.70:0/1878061972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c1092e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0098a0 tx=0x7f8d8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cc6b5c9608032e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.234+0000 7f8d99d9b700 1 -- 172.21.15.70:0/1878061972 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d8c004160 con 0x7f8d9c108ec0 2024-04-26T20:17:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.234+0000 7f8d99d9b700 1 -- 172.21.15.70:0/1878061972 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8d8c004300 con 0x7f8d9c108ec0 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.234+0000 7f8d99d9b700 1 -- 172.21.15.70:0/1878061972 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d8c011b20 con 0x7f8d9c108ec0 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.234+0000 7f8da119e700 1 -- 172.21.15.70:0/1878061972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 msgr2=0x7f8d9c1092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.234+0000 7f8da119e700 1 --2- 172.21.15.70:0/1878061972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c1092e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0098a0 tx=0x7f8d8c009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.234+0000 7f8da119e700 1 -- 172.21.15.70:0/1878061972 shutdown_connections 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.234+0000 7f8da119e700 1 --2- 172.21.15.70:0/1878061972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c1092e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.234+0000 7f8da119e700 1 -- 172.21.15.70:0/1878061972 >> 172.21.15.70:0/1878061972 conn(0x7f8d9c1044f0 msgr2=0x7f8d9c106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.235+0000 7f8da119e700 1 -- 172.21.15.70:0/1878061972 shutdown_connections 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.235+0000 7f8da119e700 1 -- 172.21.15.70:0/1878061972 wait complete. 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.235+0000 7f8da119e700 1 Processor -- start 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.235+0000 7f8da119e700 1 -- start start 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8da119e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8da119e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c10d320 con 0x7f8d9c108ec0 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8d9ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:54.071 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8d9ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c19ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60788/0 (socket says 172.21.15.70:60788) 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8d9ad9d700 1 -- 172.21.15.70:0/1931116617 learned_addr learned my addr 172.21.15.70:0/1931116617 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8d9ad9d700 1 -- 172.21.15.70:0/1931116617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c19d360 con 0x7f8d9c108ec0 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8d9ad9d700 1 --2- 172.21.15.70:0/1931116617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c19ce20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c006af0 tx=0x7f8d8c011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8d83fff700 1 -- 172.21.15.70:0/1931116617 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d8c003930 con 0x7f8d9c108ec0 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8d83fff700 1 -- 172.21.15.70:0/1931116617 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8d8c003ad0 con 0x7f8d9c108ec0 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8da119e700 1 -- 172.21.15.70:0/1931116617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9c19d5f0 con 0x7f8d9c108ec0 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8d83fff700 1 -- 172.21.15.70:0/1931116617 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d8c019610 con 0x7f8d9c108ec0 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.236+0000 7f8da119e700 1 -- 172.21.15.70:0/1931116617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d9c19da50 con 0x7f8d9c108ec0 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.237+0000 7f8d83fff700 1 -- 172.21.15.70:0/1931116617 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f8d8c019880 con 0x7f8d9c108ec0 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.237+0000 7f8da119e700 1 -- 172.21.15.70:0/1931116617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d9c064a80 con 0x7f8d9c108ec0 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.237+0000 7f8d83fff700 1 --2- 172.21.15.70:0/1931116617 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8d840395b0 0x7f8d8403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.237+0000 7f8d83fff700 1 -- 172.21.15.70:0/1931116617 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8d8c04daf0 con 0x7f8d9c108ec0 2024-04-26T20:17:54.072 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.237+0000 7f8d9a59c700 1 --2- 172.21.15.70:0/1931116617 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8d840395b0 0x7f8d8403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.238+0000 7f8d9a59c700 1 --2- 172.21.15.70:0/1931116617 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8d840395b0 0x7f8d8403ba70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d90006fd0 tx=0x7f8d90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.242+0000 7f8d83fff700 1 -- 172.21.15.70:0/1931116617 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f8d8c011e20 con 0x7f8d9c108ec0 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.471+0000 7f8da119e700 1 -- 172.21.15.70:0/1931116617 --> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f8d9c1056a0 con 0x7f8d840395b0 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.475+0000 7f8d83fff700 1 -- 172.21.15.70:0/1931116617 <== mgr.14120 v2:172.21.15.70:6800/2279707405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8d9c1056a0 con 0x7f8d840395b0 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.478+0000 7f8da119e700 1 -- 172.21.15.70:0/1931116617 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8d840395b0 msgr2=0x7f8d8403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.478+0000 7f8da119e700 1 --2- 172.21.15.70:0/1931116617 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8d840395b0 0x7f8d8403ba70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d90006fd0 tx=0x7f8d90006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.478+0000 7f8da119e700 1 -- 172.21.15.70:0/1931116617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 msgr2=0x7f8d9c19ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.478+0000 7f8da119e700 1 --2- 172.21.15.70:0/1931116617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c19ce20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c006af0 tx=0x7f8d8c011c10 comp rx=0 tx=0).stop 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.478+0000 7f8da119e700 1 -- 172.21.15.70:0/1931116617 shutdown_connections 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.478+0000 7f8da119e700 1 --2- 172.21.15.70:0/1931116617 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f8d840395b0 0x7f8d8403ba70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.478+0000 7f8da119e700 1 --2- 172.21.15.70:0/1931116617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d9c108ec0 0x7f8d9c19ce20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.478+0000 7f8da119e700 1 -- 172.21.15.70:0/1931116617 >> 172.21.15.70:0/1931116617 conn(0x7f8d9c1044f0 msgr2=0x7f8d9c104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.478+0000 7f8da119e700 1 -- 172.21.15.70:0/1931116617 shutdown_connections 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:52.478+0000 7f8da119e700 1 -- 172.21.15.70:0/1931116617 wait complete. 2024-04-26T20:17:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mgr service... 2024-04-26T20:17:54.960 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:54 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:54.960 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:54 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:56.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:55 smithi070 ceph-mon[29124]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:56.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:55 smithi070 ceph-mon[29124]: Saving service mgr spec with placement count:2 2024-04-26T20:17:56.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:55 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:56.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:55 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.550+0000 7f8643f4f700 1 Processor -- start 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.550+0000 7f8643f4f700 1 -- start start 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.550+0000 7f8643f4f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c1092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.550+0000 7f8643f4f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f863c109820 con 0x7f863c108ec0 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.550+0000 7f8641ceb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c1092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.551+0000 7f8641ceb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c1092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60804/0 (socket says 172.21.15.70:60804) 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.551+0000 7f8641ceb700 1 -- 172.21.15.70:0/3750013894 learned_addr learned my addr 172.21.15.70:0/3750013894 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.551+0000 7f8641ceb700 1 -- 172.21.15.70:0/3750013894 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c10a060 con 0x7f863c108ec0 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.551+0000 7f8641ceb700 1 --2- 172.21.15.70:0/3750013894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c1092e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f86380098a0 tx=0x7f8638009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0864fa9e19a1977 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.551+0000 7f8640ce9700 1 -- 172.21.15.70:0/3750013894 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8638004160 con 0x7f863c108ec0 2024-04-26T20:17:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.551+0000 7f8640ce9700 1 -- 172.21.15.70:0/3750013894 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8638004300 con 0x7f863c108ec0 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.551+0000 7f8640ce9700 1 -- 172.21.15.70:0/3750013894 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8638011af0 con 0x7f863c108ec0 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.552+0000 7f8643f4f700 1 -- 172.21.15.70:0/3750013894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 msgr2=0x7f863c1092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.552+0000 7f8643f4f700 1 --2- 172.21.15.70:0/3750013894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c1092e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f86380098a0 tx=0x7f8638009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.552+0000 7f8643f4f700 1 -- 172.21.15.70:0/3750013894 shutdown_connections 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.552+0000 7f8643f4f700 1 --2- 172.21.15.70:0/3750013894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c1092e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.552+0000 7f8643f4f700 1 -- 172.21.15.70:0/3750013894 >> 172.21.15.70:0/3750013894 conn(0x7f863c1044f0 msgr2=0x7f863c106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.552+0000 7f8643f4f700 1 -- 172.21.15.70:0/3750013894 shutdown_connections 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.552+0000 7f8643f4f700 1 -- 172.21.15.70:0/3750013894 wait complete. 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.552+0000 7f8643f4f700 1 Processor -- start 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.553+0000 7f8643f4f700 1 -- start start 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.553+0000 7f8643f4f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c07f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:56.064 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.553+0000 7f8643f4f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f863c10d320 con 0x7f863c108ec0 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.553+0000 7f8641ceb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c07f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.553+0000 7f8641ceb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c07f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60820/0 (socket says 172.21.15.70:60820) 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.553+0000 7f8641ceb700 1 -- 172.21.15.70:0/596230254 learned_addr learned my addr 172.21.15.70:0/596230254 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.553+0000 7f8641ceb700 1 -- 172.21.15.70:0/596230254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c07f930 con 0x7f863c108ec0 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.553+0000 7f8641ceb700 1 --2- 172.21.15.70:0/596230254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c07f3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8638009520 tx=0x7f86380045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.553+0000 7f8632ffd700 1 -- 172.21.15.70:0/596230254 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86380036a0 con 0x7f863c108ec0 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.554+0000 7f8632ffd700 1 -- 172.21.15.70:0/596230254 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f863801a430 con 0x7f863c108ec0 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.554+0000 7f8643f4f700 1 -- 172.21.15.70:0/596230254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863c07db20 con 0x7f863c108ec0 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.554+0000 7f8632ffd700 1 -- 172.21.15.70:0/596230254 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8638019550 con 0x7f863c108ec0 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.554+0000 7f8643f4f700 1 -- 172.21.15.70:0/596230254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863c07dfe0 con 0x7f863c108ec0 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.555+0000 7f8643f4f700 1 -- 172.21.15.70:0/596230254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863c064a80 con 0x7f863c108ec0 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.555+0000 7f8632ffd700 1 -- 172.21.15.70:0/596230254 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f8638019800 con 0x7f863c108ec0 2024-04-26T20:17:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.555+0000 7f8632ffd700 1 --2- 172.21.15.70:0/596230254 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f86280395b0 0x7f862803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.555+0000 7f8632ffd700 1 -- 172.21.15.70:0/596230254 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f863804d8a0 con 0x7f863c108ec0 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.555+0000 7f86414ea700 1 --2- 172.21.15.70:0/596230254 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f86280395b0 0x7f862803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.555+0000 7f86414ea700 1 --2- 172.21.15.70:0/596230254 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f86280395b0 0x7f862803ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f862c006fd0 tx=0x7f862c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.564+0000 7f8632ffd700 1 -- 172.21.15.70:0/596230254 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f8638023e30 con 0x7f863c108ec0 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.798+0000 7f8643f4f700 1 -- 172.21.15.70:0/596230254 --> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f863c07e7c0 con 0x7f86280395b0 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.803+0000 7f8632ffd700 1 -- 172.21.15.70:0/596230254 <== mgr.14120 v2:172.21.15.70:6800/2279707405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f863c07e7c0 con 0x7f86280395b0 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.805+0000 7f8643f4f700 1 -- 172.21.15.70:0/596230254 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f86280395b0 msgr2=0x7f862803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.805+0000 7f8643f4f700 1 --2- 172.21.15.70:0/596230254 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f86280395b0 0x7f862803ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f862c006fd0 tx=0x7f862c006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.805+0000 7f8643f4f700 1 -- 172.21.15.70:0/596230254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 msgr2=0x7f863c07f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.805+0000 7f8643f4f700 1 --2- 172.21.15.70:0/596230254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c07f3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8638009520 tx=0x7f86380045f0 comp rx=0 tx=0).stop 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.805+0000 7f8643f4f700 1 -- 172.21.15.70:0/596230254 shutdown_connections 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.805+0000 7f8643f4f700 1 --2- 172.21.15.70:0/596230254 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f86280395b0 0x7f862803ba70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.805+0000 7f8643f4f700 1 --2- 172.21.15.70:0/596230254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863c108ec0 0x7f863c07f3f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:56.067 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.805+0000 7f8643f4f700 1 -- 172.21.15.70:0/596230254 >> 172.21.15.70:0/596230254 conn(0x7f863c1044f0 msgr2=0x7f863c104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:56.067 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.805+0000 7f8643f4f700 1 -- 172.21.15.70:0/596230254 shutdown_connections 2024-04-26T20:17:56.067 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:54.805+0000 7f8643f4f700 1 -- 172.21.15.70:0/596230254 wait complete. 2024-04-26T20:17:57.405 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.556+0000 7fa6e2dd7700 1 Processor -- start 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.556+0000 7fa6e2dd7700 1 -- start start 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.556+0000 7fa6e2dd7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc10bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.556+0000 7fa6e2dd7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc07ce60 con 0x7fa6dc109970 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.557+0000 7fa6e0b73700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc10bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.557+0000 7fa6e0b73700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc10bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60828/0 (socket says 172.21.15.70:60828) 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.557+0000 7fa6e0b73700 1 -- 172.21.15.70:0/4025902881 learned_addr learned my addr 172.21.15.70:0/4025902881 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.557+0000 7fa6e0b73700 1 -- 172.21.15.70:0/4025902881 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6dc10c2a0 con 0x7fa6dc109970 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.557+0000 7fa6e0b73700 1 --2- 172.21.15.70:0/4025902881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc10bd60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00098a0 tx=0x7fa6d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5d78504598575f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.557+0000 7fa6db7fe700 1 -- 172.21.15.70:0/4025902881 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d0004160 con 0x7fa6dc109970 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.557+0000 7fa6db7fe700 1 -- 172.21.15.70:0/4025902881 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa6d0004300 con 0x7fa6dc109970 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.557+0000 7fa6db7fe700 1 -- 172.21.15.70:0/4025902881 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d0011af0 con 0x7fa6dc109970 2024-04-26T20:17:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.558+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/4025902881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 msgr2=0x7fa6dc10bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.558+0000 7fa6e2dd7700 1 --2- 172.21.15.70:0/4025902881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc10bd60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00098a0 tx=0x7fa6d0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.558+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/4025902881 shutdown_connections 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.558+0000 7fa6e2dd7700 1 --2- 172.21.15.70:0/4025902881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc10bd60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.558+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/4025902881 >> 172.21.15.70:0/4025902881 conn(0x7fa6dc1033a0 msgr2=0x7fa6dc1057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.558+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/4025902881 shutdown_connections 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.558+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/4025902881 wait complete. 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.559+0000 7fa6e2dd7700 1 Processor -- start 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.559+0000 7fa6e2dd7700 1 -- start start 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.559+0000 7fa6e2dd7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.559+0000 7fa6e2dd7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc10d300 con 0x7fa6dc109970 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.559+0000 7fa6e0b73700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.559+0000 7fa6e0b73700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc19ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60832/0 (socket says 172.21.15.70:60832) 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.559+0000 7fa6e0b73700 1 -- 172.21.15.70:0/3224438602 learned_addr learned my addr 172.21.15.70:0/3224438602 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.559+0000 7fa6e0b73700 1 -- 172.21.15.70:0/3224438602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6dc19d3f0 con 0x7fa6dc109970 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.559+0000 7fa6e0b73700 1 --2- 172.21.15.70:0/3224438602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc19ceb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00117b0 tx=0x7fa6d00045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.559+0000 7fa6d9ffb700 1 -- 172.21.15.70:0/3224438602 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d00036a0 con 0x7fa6dc109970 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.560+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/3224438602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6dc19d680 con 0x7fa6dc109970 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.560+0000 7fa6d9ffb700 1 -- 172.21.15.70:0/3224438602 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa6d001a430 con 0x7fa6dc109970 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.560+0000 7fa6d9ffb700 1 -- 172.21.15.70:0/3224438602 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d0019530 con 0x7fa6dc109970 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.560+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/3224438602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6dc1a0370 con 0x7fa6dc109970 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.561+0000 7fa6d9ffb700 1 -- 172.21.15.70:0/3224438602 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fa6d0019830 con 0x7fa6dc109970 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.561+0000 7fa6d9ffb700 1 --2- 172.21.15.70:0/3224438602 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fa6cc039560 0x7fa6cc03ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.561+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/3224438602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6dc064a80 con 0x7fa6dc109970 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.561+0000 7fa6d9ffb700 1 -- 172.21.15.70:0/3224438602 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa6d004d7f0 con 0x7fa6dc109970 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.561+0000 7fa6dbfff700 1 --2- 172.21.15.70:0/3224438602 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fa6cc039560 0x7fa6cc03ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.561+0000 7fa6dbfff700 1 --2- 172.21.15.70:0/3224438602 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fa6cc039560 0x7fa6cc03ba20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8006fd0 tx=0x7fa6c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:57.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.566+0000 7fa6d9ffb700 1 -- 172.21.15.70:0/3224438602 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa6d000ba00 con 0x7fa6dc109970 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.775+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/3224438602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fa6dc1a08f0 con 0x7fa6dc109970 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.777+0000 7fa6d9ffb700 1 -- 172.21.15.70:0/3224438602 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fa6d000bc60 con 0x7fa6dc109970 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.780+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/3224438602 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fa6cc039560 msgr2=0x7fa6cc03ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.780+0000 7fa6e2dd7700 1 --2- 172.21.15.70:0/3224438602 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fa6cc039560 0x7fa6cc03ba20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8006fd0 tx=0x7fa6c8006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.780+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/3224438602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 msgr2=0x7fa6dc19ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.780+0000 7fa6e2dd7700 1 --2- 172.21.15.70:0/3224438602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc19ceb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00117b0 tx=0x7fa6d00045f0 comp rx=0 tx=0).stop 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.780+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/3224438602 shutdown_connections 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.780+0000 7fa6e2dd7700 1 --2- 172.21.15.70:0/3224438602 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fa6cc039560 0x7fa6cc03ba20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.780+0000 7fa6e2dd7700 1 --2- 172.21.15.70:0/3224438602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc109970 0x7fa6dc19ceb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.780+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/3224438602 >> 172.21.15.70:0/3224438602 conn(0x7fa6dc1033a0 msgr2=0x7fa6dc103f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.780+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/3224438602 shutdown_connections 2024-04-26T20:17:57.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:56.780+0000 7fa6e2dd7700 1 -- 172.21.15.70:0/3224438602 wait complete. 2024-04-26T20:17:58.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:57 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3224438602' entity='client.admin' 2024-04-26T20:17:58.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:57 smithi070 ceph-mon[29124]: from='mgr.14120 172.21.15.70:0/405703115' entity='mgr.x' 2024-04-26T20:17:59.139 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.875+0000 7f060f7ea700 1 Processor -- start 2024-04-26T20:17:59.139 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.875+0000 7f060f7ea700 1 -- start start 2024-04-26T20:17:59.139 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.875+0000 7f060f7ea700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060807dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:59.139 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.875+0000 7f060f7ea700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f060807e170 con 0x7f060807f6f0 2024-04-26T20:17:59.139 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.875+0000 7f060d586700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060807dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:59.139 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.875+0000 7f060d586700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060807dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60838/0 (socket says 172.21.15.70:60838) 2024-04-26T20:17:59.139 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.875+0000 7f060d586700 1 -- 172.21.15.70:0/1484341633 learned_addr learned my addr 172.21.15.70:0/1484341633 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:59.139 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.876+0000 7f060d586700 1 -- 172.21.15.70:0/1484341633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060807e2f0 con 0x7f060807f6f0 2024-04-26T20:17:59.139 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.876+0000 7f060d586700 1 --2- 172.21.15.70:0/1484341633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060807dba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f06040098a0 tx=0x7f0604009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131362c76f26f963 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.876+0000 7f05fffff700 1 -- 172.21.15.70:0/1484341633 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0604004160 con 0x7f060807f6f0 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.876+0000 7f05fffff700 1 -- 172.21.15.70:0/1484341633 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0604004300 con 0x7f060807f6f0 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.876+0000 7f05fffff700 1 -- 172.21.15.70:0/1484341633 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0604011af0 con 0x7f060807f6f0 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.876+0000 7f060f7ea700 1 -- 172.21.15.70:0/1484341633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 msgr2=0x7f060807dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.876+0000 7f060f7ea700 1 --2- 172.21.15.70:0/1484341633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060807dba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f06040098a0 tx=0x7f0604009bb0 comp rx=0 tx=0).stop 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060f7ea700 1 -- 172.21.15.70:0/1484341633 shutdown_connections 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060f7ea700 1 --2- 172.21.15.70:0/1484341633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060807dba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060f7ea700 1 -- 172.21.15.70:0/1484341633 >> 172.21.15.70:0/1484341633 conn(0x7f06081044f0 msgr2=0x7f0608106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060f7ea700 1 -- 172.21.15.70:0/1484341633 shutdown_connections 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060f7ea700 1 -- 172.21.15.70:0/1484341633 wait complete. 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060f7ea700 1 Processor -- start 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060f7ea700 1 -- start start 2024-04-26T20:17:59.140 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060f7ea700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060f7ea700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f060810f4f0 con 0x7f060807f6f0 2024-04-26T20:17:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060d586700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060d586700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060819f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60846/0 (socket says 172.21.15.70:60846) 2024-04-26T20:17:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.877+0000 7f060d586700 1 -- 172.21.15.70:0/2853658626 learned_addr learned my addr 172.21.15.70:0/2853658626 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:17:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.878+0000 7f060d586700 1 -- 172.21.15.70:0/2853658626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060819f550 con 0x7f060807f6f0 2024-04-26T20:17:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.878+0000 7f060d586700 1 --2- 172.21.15.70:0/2853658626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060819f010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06040117b0 tx=0x7f06040045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.878+0000 7f05fe7fc700 1 -- 172.21.15.70:0/2853658626 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06040036a0 con 0x7f060807f6f0 2024-04-26T20:17:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.878+0000 7f05fe7fc700 1 -- 172.21.15.70:0/2853658626 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f060401a430 con 0x7f060807f6f0 2024-04-26T20:17:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.878+0000 7f060f7ea700 1 -- 172.21.15.70:0/2853658626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060819f7e0 con 0x7f060807f6f0 2024-04-26T20:17:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.878+0000 7f05fe7fc700 1 -- 172.21.15.70:0/2853658626 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0604019530 con 0x7f060807f6f0 2024-04-26T20:17:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.878+0000 7f060f7ea700 1 -- 172.21.15.70:0/2853658626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06081a24d0 con 0x7f060807f6f0 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.879+0000 7f05fe7fc700 1 -- 172.21.15.70:0/2853658626 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f06040197e0 con 0x7f060807f6f0 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.879+0000 7f060f7ea700 1 -- 172.21.15.70:0/2853658626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0608064a80 con 0x7f060807f6f0 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.879+0000 7f05fe7fc700 1 --2- 172.21.15.70:0/2853658626 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f05f40395b0 0x7f05f403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.879+0000 7f05fe7fc700 1 -- 172.21.15.70:0/2853658626 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f060404d7a0 con 0x7f060807f6f0 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.879+0000 7f060cd85700 1 --2- 172.21.15.70:0/2853658626 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f05f40395b0 0x7f05f403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.880+0000 7f060cd85700 1 --2- 172.21.15.70:0/2853658626 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f05f40395b0 0x7f05f403ba70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f05f8006fd0 tx=0x7f05f8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:57.884+0000 7f05fe7fc700 1 -- 172.21.15.70:0/2853658626 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f060400fda0 con 0x7f060807f6f0 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.091+0000 7f060f7ea700 1 -- 172.21.15.70:0/2853658626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f06081a2af0 con 0x7f060807f6f0 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.094+0000 7f05fe7fc700 1 -- 172.21.15.70:0/2853658626 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f060401a5e0 con 0x7f060807f6f0 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.097+0000 7f060f7ea700 1 -- 172.21.15.70:0/2853658626 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f05f40395b0 msgr2=0x7f05f403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.097+0000 7f060f7ea700 1 --2- 172.21.15.70:0/2853658626 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f05f40395b0 0x7f05f403ba70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f05f8006fd0 tx=0x7f05f8006e40 comp rx=0 tx=0).stop 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.097+0000 7f060f7ea700 1 -- 172.21.15.70:0/2853658626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 msgr2=0x7f060819f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:59.142 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.097+0000 7f060f7ea700 1 --2- 172.21.15.70:0/2853658626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060819f010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06040117b0 tx=0x7f06040045f0 comp rx=0 tx=0).stop 2024-04-26T20:17:59.143 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.097+0000 7f060f7ea700 1 -- 172.21.15.70:0/2853658626 shutdown_connections 2024-04-26T20:17:59.143 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.097+0000 7f060f7ea700 1 --2- 172.21.15.70:0/2853658626 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f05f40395b0 0x7f05f403ba70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:59.143 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.097+0000 7f060f7ea700 1 --2- 172.21.15.70:0/2853658626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f060807f6f0 0x7f060819f010 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:59.143 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.097+0000 7f060f7ea700 1 -- 172.21.15.70:0/2853658626 >> 172.21.15.70:0/2853658626 conn(0x7f06081044f0 msgr2=0x7f0608104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:59.143 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.097+0000 7f060f7ea700 1 -- 172.21.15.70:0/2853658626 shutdown_connections 2024-04-26T20:17:59.143 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:58.097+0000 7f060f7ea700 1 -- 172.21.15.70:0/2853658626 wait complete. 2024-04-26T20:17:59.143 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling the dashboard module... 2024-04-26T20:17:59.352 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:17:59 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2853658626' entity='client.admin' 2024-04-26T20:18:01.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:00 smithi070 ceph-mon[29124]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:01.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:00 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3488727604' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-26T20:18:01.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: ignoring --setuser ceph since I am not root 2024-04-26T20:18:01.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: ignoring --setgroup ceph since I am not root 2024-04-26T20:18:01.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:00.952+0000 7f37e8a1f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:18:01.382 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:01 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:01.138+0000 7f37e8a1f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:18:01.382 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:01 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:01.239+0000 7f37e8a1f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:18:01.384 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.560+0000 7f47858d3700 1 Processor -- start 2024-04-26T20:18:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.560+0000 7f47858d3700 1 -- start start 2024-04-26T20:18:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.560+0000 7f47858d3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478010bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.560+0000 7f47858d3700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f478007cde0 con 0x7f47801099f0 2024-04-26T20:18:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.560+0000 7f477effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478010bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.560+0000 7f477effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478010bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42954/0 (socket says 172.21.15.70:42954) 2024-04-26T20:18:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.560+0000 7f477effd700 1 -- 172.21.15.70:0/529916524 learned_addr learned my addr 172.21.15.70:0/529916524 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.561+0000 7f477effd700 1 -- 172.21.15.70:0/529916524 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478010c320 con 0x7f47801099f0 2024-04-26T20:18:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.561+0000 7f477effd700 1 --2- 172.21.15.70:0/529916524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478010bde0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f47740098a0 tx=0x7f4774009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d48215fa0038f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.561+0000 7f477dffb700 1 -- 172.21.15.70:0/529916524 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4774004160 con 0x7f47801099f0 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.561+0000 7f477dffb700 1 -- 172.21.15.70:0/529916524 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4774004300 con 0x7f47801099f0 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.561+0000 7f477dffb700 1 -- 172.21.15.70:0/529916524 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4774011af0 con 0x7f47801099f0 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.561+0000 7f47858d3700 1 -- 172.21.15.70:0/529916524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 msgr2=0x7f478010bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.561+0000 7f47858d3700 1 --2- 172.21.15.70:0/529916524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478010bde0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f47740098a0 tx=0x7f4774009bb0 comp rx=0 tx=0).stop 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.561+0000 7f47858d3700 1 -- 172.21.15.70:0/529916524 shutdown_connections 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.561+0000 7f47858d3700 1 --2- 172.21.15.70:0/529916524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478010bde0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.562+0000 7f47858d3700 1 -- 172.21.15.70:0/529916524 >> 172.21.15.70:0/529916524 conn(0x7f47801033a0 msgr2=0x7f47801057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.562+0000 7f47858d3700 1 -- 172.21.15.70:0/529916524 shutdown_connections 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.562+0000 7f47858d3700 1 -- 172.21.15.70:0/529916524 wait complete. 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.562+0000 7f47858d3700 1 Processor -- start 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.562+0000 7f47858d3700 1 -- start start 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.562+0000 7f47858d3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.562+0000 7f47858d3700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f478010d2d0 con 0x7f47801099f0 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.563+0000 7f477effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.563+0000 7f477effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478019ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42956/0 (socket says 172.21.15.70:42956) 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.563+0000 7f477effd700 1 -- 172.21.15.70:0/3488727604 learned_addr learned my addr 172.21.15.70:0/3488727604 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.563+0000 7f477effd700 1 -- 172.21.15.70:0/3488727604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478019d3d0 con 0x7f47801099f0 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.563+0000 7f477effd700 1 --2- 172.21.15.70:0/3488727604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478019ce90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47740117b0 tx=0x7f47740045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.563+0000 7f47848d1700 1 -- 172.21.15.70:0/3488727604 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47740036a0 con 0x7f47801099f0 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.563+0000 7f47848d1700 1 -- 172.21.15.70:0/3488727604 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f477401a430 con 0x7f47801099f0 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.563+0000 7f47848d1700 1 -- 172.21.15.70:0/3488727604 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4774019530 con 0x7f47801099f0 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.563+0000 7f47858d3700 1 -- 172.21.15.70:0/3488727604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478019d660 con 0x7f47801099f0 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.563+0000 7f47858d3700 1 -- 172.21.15.70:0/3488727604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47801a0350 con 0x7f47801099f0 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.564+0000 7f47848d1700 1 -- 172.21.15.70:0/3488727604 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f47740197e0 con 0x7f47801099f0 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.564+0000 7f47858d3700 1 -- 172.21.15.70:0/3488727604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4780064a80 con 0x7f47801099f0 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.564+0000 7f47848d1700 1 --2- 172.21.15.70:0/3488727604 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f47680395b0 0x7f476803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.564+0000 7f47848d1700 1 -- 172.21.15.70:0/3488727604 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f477404d8f0 con 0x7f47801099f0 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.564+0000 7f477e7fc700 1 --2- 172.21.15.70:0/3488727604 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f47680395b0 0x7f476803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.565+0000 7f477e7fc700 1 --2- 172.21.15.70:0/3488727604 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f47680395b0 0x7f476803ba70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4770006fd0 tx=0x7f4770006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.569+0000 7f47848d1700 1 -- 172.21.15.70:0/3488727604 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f477401a5e0 con 0x7f47801099f0 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:17:59.836+0000 7f47858d3700 1 -- 172.21.15.70:0/3488727604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f47801a0900 con 0x7f47801099f0 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.768+0000 7f47848d1700 1 -- 172.21.15.70:0/3488727604 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f477402d960 con 0x7f47801099f0 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.770+0000 7f47848d1700 1 -- 172.21.15.70:0/3488727604 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f477401a900 con 0x7f47801099f0 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.772+0000 7f47858d3700 1 -- 172.21.15.70:0/3488727604 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f47680395b0 msgr2=0x7f476803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.772+0000 7f47858d3700 1 --2- 172.21.15.70:0/3488727604 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f47680395b0 0x7f476803ba70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4770006fd0 tx=0x7f4770006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.772+0000 7f47858d3700 1 -- 172.21.15.70:0/3488727604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 msgr2=0x7f478019ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.772+0000 7f47858d3700 1 --2- 172.21.15.70:0/3488727604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478019ce90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47740117b0 tx=0x7f47740045f0 comp rx=0 tx=0).stop 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.772+0000 7f47858d3700 1 -- 172.21.15.70:0/3488727604 shutdown_connections 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.772+0000 7f47858d3700 1 --2- 172.21.15.70:0/3488727604 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f47680395b0 0x7f476803ba70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.772+0000 7f47858d3700 1 --2- 172.21.15.70:0/3488727604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47801099f0 0x7f478019ce90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.772+0000 7f47858d3700 1 -- 172.21.15.70:0/3488727604 >> 172.21.15.70:0/3488727604 conn(0x7f47801033a0 msgr2=0x7f4780103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.772+0000 7f47858d3700 1 -- 172.21.15.70:0/3488727604 shutdown_connections 2024-04-26T20:18:01.394 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:00.772+0000 7f47858d3700 1 -- 172.21.15.70:0/3488727604 wait complete. 2024-04-26T20:18:01.642 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:01 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:01.552+0000 7f37e8a1f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:18:01.643 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:01 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:01.641+0000 7f37e8a1f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:18:02.009 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:01 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3488727604' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-26T20:18:02.009 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:01 smithi070 ceph-mon[29124]: mgrmap e9: x(active, since 21s) 2024-04-26T20:18:02.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.802+0000 7fee74761700 1 Processor -- start 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.802+0000 7fee74761700 1 -- start start 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.802+0000 7fee74761700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c10bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.802+0000 7fee74761700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c07d6a0 con 0x7fee6c109970 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.802+0000 7fee724fd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c10bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.802+0000 7fee724fd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c10bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42990/0 (socket says 172.21.15.70:42990) 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.802+0000 7fee724fd700 1 -- 172.21.15.70:0/2772764571 learned_addr learned my addr 172.21.15.70:0/2772764571 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:02.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.803+0000 7fee724fd700 1 -- 172.21.15.70:0/2772764571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c10c2a0 con 0x7fee6c109970 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.803+0000 7fee724fd700 1 --2- 172.21.15.70:0/2772764571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c10bd60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee680098a0 tx=0x7fee68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e6db9b751ec7e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.803+0000 7fee714fb700 1 -- 172.21.15.70:0/2772764571 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee68004160 con 0x7fee6c109970 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.803+0000 7fee714fb700 1 -- 172.21.15.70:0/2772764571 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee68004300 con 0x7fee6c109970 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.803+0000 7fee714fb700 1 -- 172.21.15.70:0/2772764571 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee68011af0 con 0x7fee6c109970 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.804+0000 7fee74761700 1 -- 172.21.15.70:0/2772764571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 msgr2=0x7fee6c10bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.804+0000 7fee74761700 1 --2- 172.21.15.70:0/2772764571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c10bd60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee680098a0 tx=0x7fee68009bb0 comp rx=0 tx=0).stop 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.804+0000 7fee74761700 1 -- 172.21.15.70:0/2772764571 shutdown_connections 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.804+0000 7fee74761700 1 --2- 172.21.15.70:0/2772764571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c10bd60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.804+0000 7fee74761700 1 -- 172.21.15.70:0/2772764571 >> 172.21.15.70:0/2772764571 conn(0x7fee6c103360 msgr2=0x7fee6c1057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.804+0000 7fee74761700 1 -- 172.21.15.70:0/2772764571 shutdown_connections 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.804+0000 7fee74761700 1 -- 172.21.15.70:0/2772764571 wait complete. 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.805+0000 7fee74761700 1 Processor -- start 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.805+0000 7fee74761700 1 -- start start 2024-04-26T20:18:02.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.805+0000 7fee74761700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.805+0000 7fee74761700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c10d2a0 con 0x7fee6c109970 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.805+0000 7fee724fd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.805+0000 7fee724fd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c19cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43000/0 (socket says 172.21.15.70:43000) 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.805+0000 7fee724fd700 1 -- 172.21.15.70:0/621492765 learned_addr learned my addr 172.21.15.70:0/621492765 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.805+0000 7fee724fd700 1 -- 172.21.15.70:0/621492765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c19d310 con 0x7fee6c109970 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.805+0000 7fee724fd700 1 --2- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c19cdd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fee680117b0 tx=0x7fee68003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.806+0000 7fee637fe700 1 -- 172.21.15.70:0/621492765 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee680036a0 con 0x7fee6c109970 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.806+0000 7fee74761700 1 -- 172.21.15.70:0/621492765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c19d5a0 con 0x7fee6c109970 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.806+0000 7fee74761700 1 -- 172.21.15.70:0/621492765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6c1a0290 con 0x7fee6c109970 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.806+0000 7fee637fe700 1 -- 172.21.15.70:0/621492765 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee6801a430 con 0x7fee6c109970 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.806+0000 7fee637fe700 1 -- 172.21.15.70:0/621492765 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee68019530 con 0x7fee6c109970 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.807+0000 7fee637fe700 1 -- 172.21.15.70:0/621492765 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7fee680196d0 con 0x7fee6c109970 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.807+0000 7fee74761700 1 -- 172.21.15.70:0/621492765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee50005360 con 0x7fee6c109970 2024-04-26T20:18:02.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.807+0000 7fee637fe700 1 --2- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fee58039610 0x7fee5803bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.807+0000 7fee637fe700 1 -- 172.21.15.70:0/621492765 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fee6804d7e0 con 0x7fee6c109970 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.807+0000 7fee71cfc700 1 -- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fee58039610 msgr2=0x7fee5803bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2279707405 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.807+0000 7fee71cfc700 1 --2- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fee58039610 0x7fee5803bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:01.812+0000 7fee637fe700 1 -- 172.21.15.70:0/621492765 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fee68020240 con 0x7fee6c109970 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.008+0000 7fee71cfc700 1 -- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fee58039610 msgr2=0x7fee5803bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2279707405 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.008+0000 7fee71cfc700 1 --2- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fee58039610 0x7fee5803bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.106+0000 7fee74761700 1 -- 172.21.15.70:0/621492765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fee50005e60 con 0x7fee6c109970 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.107+0000 7fee637fe700 1 -- 172.21.15.70:0/621492765 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fee68029d50 con 0x7fee6c109970 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.109+0000 7fee74761700 1 -- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fee58039610 msgr2=0x7fee5803bad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.109+0000 7fee74761700 1 --2- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fee58039610 0x7fee5803bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.109+0000 7fee74761700 1 -- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 msgr2=0x7fee6c19cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:02.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.109+0000 7fee74761700 1 --2- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c19cdd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fee680117b0 tx=0x7fee68003eb0 comp rx=0 tx=0).stop 2024-04-26T20:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.109+0000 7fee74761700 1 -- 172.21.15.70:0/621492765 shutdown_connections 2024-04-26T20:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.109+0000 7fee74761700 1 --2- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7fee58039610 0x7fee5803bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.109+0000 7fee74761700 1 --2- 172.21.15.70:0/621492765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee6c109970 0x7fee6c19cdd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.109+0000 7fee74761700 1 -- 172.21.15.70:0/621492765 >> 172.21.15.70:0/621492765 conn(0x7fee6c103360 msgr2=0x7fee6c103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.109+0000 7fee74761700 1 -- 172.21.15.70:0/621492765 shutdown_connections 2024-04-26T20:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:02.109+0000 7fee74761700 1 -- 172.21.15.70:0/621492765 wait complete. 2024-04-26T20:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2024-04-26T20:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 9... 2024-04-26T20:18:03.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:02 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/621492765' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T20:18:03.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:02.863+0000 7f37e8a1f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:18:03.284 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:03.039+0000 7f37e8a1f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:18:03.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:03.214+0000 7f37e8a1f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:18:03.593 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:03.501+0000 7f37e8a1f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:18:03.594 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:03.592+0000 7f37e8a1f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:18:04.003 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:03.809+0000 7f37e8a1f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:18:04.284 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:04 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:04.002+0000 7f37e8a1f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:18:04.786 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:04 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:04.607+0000 7f37e8a1f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:18:05.284 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:05.032+0000 7f37e8a1f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:18:05.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:05.130+0000 7f37e8a1f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:18:05.784 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:05.333+0000 7f37e8a1f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:18:06.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:05.872+0000 7f37e8a1f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:18:06.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:05.966+0000 7f37e8a1f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:18:06.449 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:06.214+0000 7f37e8a1f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:18:06.450 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:06.349+0000 7f37e8a1f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:18:06.450 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:06.448+0000 7f37e8a1f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:18:06.784 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:06.566+0000 7f37e8a1f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:18:07.284 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:06.865+0000 7f37e8a1f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:18:07.745 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:07.472+0000 7f37e8a1f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:18:07.746 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:18:07.692+0000 7f37e8a1f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: Active manager daemon x restarted 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: Activating manager daemon x 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: osdmap e3: 0 total, 0 up, 0 in 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: mgrmap e10: x(active, starting, since 0.0034074s) 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: Manager daemon x is now available 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:18:08.977 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:18:08.977 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:08 smithi070 ceph-mon[29124]: mgrmap e11: x(active, since 1.00601s) 2024-04-26T20:18:09.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:18:09.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-26T20:18:09.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T20:18:09.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:18:09.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.120+0000 7f1be475d700 1 Processor -- start 2024-04-26T20:18:09.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.120+0000 7f1be475d700 1 -- start start 2024-04-26T20:18:09.331 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.120+0000 7f1be475d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc10bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.120+0000 7f1be475d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1bdc07d6a0 con 0x7f1bdc109980 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.120+0000 7f1be24f9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc10bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.120+0000 7f1be24f9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc10bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43012/0 (socket says 172.21.15.70:43012) 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.120+0000 7f1be24f9700 1 -- 172.21.15.70:0/1733773204 learned_addr learned my addr 172.21.15.70:0/1733773204 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.120+0000 7f1be24f9700 1 -- 172.21.15.70:0/1733773204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bdc10c2b0 con 0x7f1bdc109980 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.121+0000 7f1be24f9700 1 --2- 172.21.15.70:0/1733773204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc10bd70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80098a0 tx=0x7f1bd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c288b62233ffe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.121+0000 7f1be14f7700 1 -- 172.21.15.70:0/1733773204 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd8004160 con 0x7f1bdc109980 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.121+0000 7f1be14f7700 1 -- 172.21.15.70:0/1733773204 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1bd8004300 con 0x7f1bdc109980 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.121+0000 7f1be14f7700 1 -- 172.21.15.70:0/1733773204 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd8011af0 con 0x7f1bdc109980 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.121+0000 7f1be475d700 1 -- 172.21.15.70:0/1733773204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 msgr2=0x7f1bdc10bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.122+0000 7f1be475d700 1 --2- 172.21.15.70:0/1733773204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc10bd70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80098a0 tx=0x7f1bd8009bb0 comp rx=0 tx=0).stop 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.122+0000 7f1be475d700 1 -- 172.21.15.70:0/1733773204 shutdown_connections 2024-04-26T20:18:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.122+0000 7f1be475d700 1 --2- 172.21.15.70:0/1733773204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc10bd70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.122+0000 7f1be475d700 1 -- 172.21.15.70:0/1733773204 >> 172.21.15.70:0/1733773204 conn(0x7f1bdc103350 msgr2=0x7f1bdc1057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.122+0000 7f1be475d700 1 -- 172.21.15.70:0/1733773204 shutdown_connections 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.122+0000 7f1be475d700 1 -- 172.21.15.70:0/1733773204 wait complete. 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.122+0000 7f1be475d700 1 Processor -- start 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.122+0000 7f1be475d700 1 -- start start 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.122+0000 7f1be475d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc109200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.122+0000 7f1be475d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1bdc10d2b0 con 0x7f1bdc109980 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.123+0000 7f1be24f9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc109200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.123+0000 7f1be24f9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc109200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43018/0 (socket says 172.21.15.70:43018) 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.123+0000 7f1be24f9700 1 -- 172.21.15.70:0/4102390478 learned_addr learned my addr 172.21.15.70:0/4102390478 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.123+0000 7f1be24f9700 1 -- 172.21.15.70:0/4102390478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bdc109740 con 0x7f1bdc109980 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.123+0000 7f1be24f9700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc109200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80117b0 tx=0x7f1bd80045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.123+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd80036a0 con 0x7f1bdc109980 2024-04-26T20:18:09.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.123+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1bd801a430 con 0x7f1bdc109980 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.123+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd8019530 con 0x7f1bdc109980 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.123+0000 7f1be475d700 1 -- 172.21.15.70:0/4102390478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bdc107930 con 0x7f1bdc109980 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.123+0000 7f1be475d700 1 -- 172.21.15.70:0/4102390478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bdc107e70 con 0x7f1bdc109980 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.124+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f1bd80197e0 con 0x7f1bdc109980 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.124+0000 7f1bd37fe700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 0x7f1bc803bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.124+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 --> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1bc803c1e0 con 0x7f1bc8039610 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.124+0000 7f1be1cf8700 1 -- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 msgr2=0x7f1bc803bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2279707405 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.124+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1bd801a670 con 0x7f1bdc109980 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.124+0000 7f1be1cf8700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 0x7f1bc803bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.325+0000 7f1be1cf8700 1 -- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 msgr2=0x7f1bc803bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2279707405 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.325+0000 7f1be1cf8700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 0x7f1bc803bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.726+0000 7f1be1cf8700 1 -- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 msgr2=0x7f1bc803bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2279707405 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:03.726+0000 7f1be1cf8700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 0x7f1bc803bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T20:18:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:04.527+0000 7f1be1cf8700 1 -- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 msgr2=0x7f1bc803bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2279707405 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:04.527+0000 7f1be1cf8700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 0x7f1bc803bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:06.128+0000 7f1be1cf8700 1 -- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 msgr2=0x7f1bc803bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2279707405 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:06.128+0000 7f1be1cf8700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 0x7f1bc803bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:07.695+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mgrmap(e 10) ==== 46338+0+0 (secure 0 0 0) 0x7f1bd8019b70 con 0x7f1bdc109980 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:07.695+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 msgr2=0x7f1bc803bad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:07.695+0000 7f1bd37fe700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 0x7f1bc803bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.697+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7f1bd804f9c0 con 0x7f1bdc109980 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.697+0000 7f1bd37fe700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1bc803cff0 0x7f1bc803f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.697+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1bd8001d30 con 0x7f1bc803cff0 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.697+0000 7f1be1cf8700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1bc803cff0 0x7f1bc803f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.698+0000 7f1be1cf8700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1bc803cff0 0x7f1bc803f3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc003a10 tx=0x7f1bcc009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.698+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f1bd8001d30 con 0x7f1bc803cff0 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.706+0000 7f1be475d700 1 -- 172.21.15.70:0/4102390478 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f1bdc064a80 con 0x7f1bc803cff0 2024-04-26T20:18:09.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.707+0000 7f1bd37fe700 1 -- 172.21.15.70:0/4102390478 <== mgr.14152 v2:172.21.15.70:6800/828657527 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f1bdc064a80 con 0x7f1bc803cff0 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.707+0000 7f1be475d700 1 -- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1bc803cff0 msgr2=0x7f1bc803f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.707+0000 7f1be475d700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1bc803cff0 0x7f1bc803f3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc003a10 tx=0x7f1bcc009270 comp rx=0 tx=0).stop 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.707+0000 7f1be475d700 1 -- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 msgr2=0x7f1bdc109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.707+0000 7f1be475d700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc109200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80117b0 tx=0x7f1bd80045f0 comp rx=0 tx=0).stop 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.707+0000 7f1be475d700 1 -- 172.21.15.70:0/4102390478 shutdown_connections 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.707+0000 7f1be475d700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1bc803cff0 0x7f1bc803f3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.707+0000 7f1be475d700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bdc109980 0x7f1bdc109200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.707+0000 7f1be475d700 1 --2- 172.21.15.70:0/4102390478 >> [v2:172.21.15.70:6800/2279707405,v1:172.21.15.70:6801/2279707405] conn(0x7f1bc8039610 0x7f1bc803bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.707+0000 7f1be475d700 1 -- 172.21.15.70:0/4102390478 >> 172.21.15.70:0/4102390478 conn(0x7f1bdc103350 msgr2=0x7f1bdc103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.708+0000 7f1be475d700 1 -- 172.21.15.70:0/4102390478 shutdown_connections 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:08.708+0000 7f1be475d700 1 -- 172.21.15.70:0/4102390478 wait complete. 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 9 is available 2024-04-26T20:18:09.336 INFO:teuthology.orchestra.run.smithi070.stdout:Generating a dashboard self-signed certificate... 2024-04-26T20:18:09.891 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:09 smithi070 ceph-mon[29124]: [26/Apr/2024:20:18:07] ENGINE Bus STARTING 2024-04-26T20:18:09.892 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:09 smithi070 ceph-mon[29124]: [26/Apr/2024:20:18:08] ENGINE Serving on https://172.21.15.70:7150 2024-04-26T20:18:09.892 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:09 smithi070 ceph-mon[29124]: [26/Apr/2024:20:18:08] ENGINE Serving on http://172.21.15.70:8765 2024-04-26T20:18:09.892 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:09 smithi070 ceph-mon[29124]: [26/Apr/2024:20:18:08] ENGINE Bus STARTED 2024-04-26T20:18:09.892 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:09 smithi070 ceph-mon[29124]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T20:18:09.892 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:09 smithi070 ceph-mon[29124]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T20:18:10.604 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-26T20:18:10.605 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.775+0000 7f91c3b76700 1 Processor -- start 2024-04-26T20:18:10.605 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.775+0000 7f91c3b76700 1 -- start start 2024-04-26T20:18:10.605 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.776+0000 7f91c3b76700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc07dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:10.605 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.776+0000 7f91c3b76700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc07e170 con 0x7f91bc07f6f0 2024-04-26T20:18:10.605 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.776+0000 7f91c1912700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc07dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:10.605 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.776+0000 7f91c1912700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc07dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38232/0 (socket says 172.21.15.70:38232) 2024-04-26T20:18:10.605 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.776+0000 7f91c1912700 1 -- 172.21.15.70:0/3204117943 learned_addr learned my addr 172.21.15.70:0/3204117943 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:10.605 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.776+0000 7f91c1912700 1 -- 172.21.15.70:0/3204117943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc07e2f0 con 0x7f91bc07f6f0 2024-04-26T20:18:10.605 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.776+0000 7f91c1912700 1 --2- 172.21.15.70:0/3204117943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc07dba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009e80 tx=0x7f91b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8c6f5ce997218b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:10.605 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.776+0000 7f91c0910700 1 -- 172.21.15.70:0/3204117943 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b4017070 con 0x7f91bc07f6f0 2024-04-26T20:18:10.605 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.776+0000 7f91c0910700 1 -- 172.21.15.70:0/3204117943 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91b400b8c0 con 0x7f91bc07f6f0 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.776+0000 7f91c0910700 1 -- 172.21.15.70:0/3204117943 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b4004500 con 0x7f91bc07f6f0 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.777+0000 7f91c3b76700 1 -- 172.21.15.70:0/3204117943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 msgr2=0x7f91bc07dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.777+0000 7f91c3b76700 1 --2- 172.21.15.70:0/3204117943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc07dba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009e80 tx=0x7f91b400b330 comp rx=0 tx=0).stop 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.777+0000 7f91c3b76700 1 -- 172.21.15.70:0/3204117943 shutdown_connections 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.777+0000 7f91c3b76700 1 --2- 172.21.15.70:0/3204117943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc07dba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.777+0000 7f91c3b76700 1 -- 172.21.15.70:0/3204117943 >> 172.21.15.70:0/3204117943 conn(0x7f91bc1044f0 msgr2=0x7f91bc106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.777+0000 7f91c3b76700 1 -- 172.21.15.70:0/3204117943 shutdown_connections 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.777+0000 7f91c3b76700 1 -- 172.21.15.70:0/3204117943 wait complete. 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91c3b76700 1 Processor -- start 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91c3b76700 1 -- start start 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91c3b76700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc19f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:10.606 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91c3b76700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc10f4f0 con 0x7f91bc07f6f0 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91c1912700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc19f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91c1912700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc19f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38244/0 (socket says 172.21.15.70:38244) 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91c1912700 1 -- 172.21.15.70:0/2347044146 learned_addr learned my addr 172.21.15.70:0/2347044146 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91c1912700 1 -- 172.21.15.70:0/2347044146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc19f580 con 0x7f91bc07f6f0 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91c1912700 1 --2- 172.21.15.70:0/2347044146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc19f040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91b40072a0 tx=0x7f91b400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91baffd700 1 -- 172.21.15.70:0/2347044146 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b4021020 con 0x7f91bc07f6f0 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91baffd700 1 -- 172.21.15.70:0/2347044146 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91b4003b50 con 0x7f91bc07f6f0 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91c3b76700 1 -- 172.21.15.70:0/2347044146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91bc19f810 con 0x7f91bc07f6f0 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91baffd700 1 -- 172.21.15.70:0/2347044146 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b4017040 con 0x7f91bc07f6f0 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.778+0000 7f91c3b76700 1 -- 172.21.15.70:0/2347044146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91bc1a2500 con 0x7f91bc07f6f0 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.779+0000 7f91c3b76700 1 -- 172.21.15.70:0/2347044146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91bc064a80 con 0x7f91bc07f6f0 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.779+0000 7f91baffd700 1 -- 172.21.15.70:0/2347044146 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f91b4024020 con 0x7f91bc07f6f0 2024-04-26T20:18:10.607 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.780+0000 7f91baffd700 1 --2- 172.21.15.70:0/2347044146 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91a4039650 0x7f91a403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.780+0000 7f91baffd700 1 -- 172.21.15.70:0/2347044146 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f91b400f050 con 0x7f91bc07f6f0 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.780+0000 7f91c1111700 1 --2- 172.21.15.70:0/2347044146 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91a4039650 0x7f91a403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.780+0000 7f91c1111700 1 --2- 172.21.15.70:0/2347044146 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91a4039650 0x7f91a403bb10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006fd0 tx=0x7f91b0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.784+0000 7f91baffd700 1 -- 172.21.15.70:0/2347044146 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f91b402b020 con 0x7f91bc07f6f0 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:09.991+0000 7f91c3b76700 1 -- 172.21.15.70:0/2347044146 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f91bc1056d0 con 0x7f91a4039650 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:10.089+0000 7f91baffd700 1 -- 172.21.15.70:0/2347044146 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f91bc1056d0 con 0x7f91a4039650 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:10.091+0000 7f91c3b76700 1 -- 172.21.15.70:0/2347044146 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91a4039650 msgr2=0x7f91a403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:10.091+0000 7f91c3b76700 1 --2- 172.21.15.70:0/2347044146 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91a4039650 0x7f91a403bb10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006fd0 tx=0x7f91b0006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:10.091+0000 7f91c3b76700 1 -- 172.21.15.70:0/2347044146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 msgr2=0x7f91bc19f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:10.091+0000 7f91c3b76700 1 --2- 172.21.15.70:0/2347044146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc19f040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91b40072a0 tx=0x7f91b400bd50 comp rx=0 tx=0).stop 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:10.091+0000 7f91c3b76700 1 -- 172.21.15.70:0/2347044146 shutdown_connections 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:10.091+0000 7f91c3b76700 1 --2- 172.21.15.70:0/2347044146 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91a4039650 0x7f91a403bb10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:10.608 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:10.091+0000 7f91c3b76700 1 --2- 172.21.15.70:0/2347044146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc07f6f0 0x7f91bc19f040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:10.609 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:10.091+0000 7f91c3b76700 1 -- 172.21.15.70:0/2347044146 >> 172.21.15.70:0/2347044146 conn(0x7f91bc1044f0 msgr2=0x7f91bc104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:10.609 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:10.092+0000 7f91c3b76700 1 -- 172.21.15.70:0/2347044146 shutdown_connections 2024-04-26T20:18:10.609 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:10.092+0000 7f91c3b76700 1 -- 172.21.15.70:0/2347044146 wait complete. 2024-04-26T20:18:10.609 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial admin user... 2024-04-26T20:18:10.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:10 smithi070 ceph-mon[29124]: mgrmap e12: x(active, since 2s) 2024-04-26T20:18:10.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:10.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:12.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:11 smithi070 ceph-mon[29124]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:12.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:11 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:12.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:11 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:12.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$pK6aWKr2PNcj0Qhyh6UnoO/VQOC/1clQLa9IM5z/02DsQXhhrrupK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714162691, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-26T20:18:12.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.044+0000 7f20ed74e700 1 Processor -- start 2024-04-26T20:18:12.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.044+0000 7f20ed74e700 1 -- start start 2024-04-26T20:18:12.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.045+0000 7f20ed74e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e81075a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:12.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.045+0000 7f20ed74e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20e8107b70 con 0x7f20e8107180 2024-04-26T20:18:12.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.045+0000 7f20e6ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e81075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:12.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.045+0000 7f20e6ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e81075a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38254/0 (socket says 172.21.15.70:38254) 2024-04-26T20:18:12.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.045+0000 7f20e6ffd700 1 -- 172.21.15.70:0/1580279839 learned_addr learned my addr 172.21.15.70:0/1580279839 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.045+0000 7f20e6ffd700 1 -- 172.21.15.70:0/1580279839 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e8107cf0 con 0x7f20e8107180 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.045+0000 7f20e6ffd700 1 --2- 172.21.15.70:0/1580279839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e81075a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20d80098a0 tx=0x7f20d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91020b1e764a329a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.045+0000 7f20e5ffb700 1 -- 172.21.15.70:0/1580279839 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20d8004160 con 0x7f20e8107180 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.046+0000 7f20e5ffb700 1 -- 172.21.15.70:0/1580279839 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f20d8004300 con 0x7f20e8107180 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.046+0000 7f20e5ffb700 1 -- 172.21.15.70:0/1580279839 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20d8011af0 con 0x7f20e8107180 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.046+0000 7f20ed74e700 1 -- 172.21.15.70:0/1580279839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 msgr2=0x7f20e81075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.046+0000 7f20ed74e700 1 --2- 172.21.15.70:0/1580279839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e81075a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20d80098a0 tx=0x7f20d8009bb0 comp rx=0 tx=0).stop 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.046+0000 7f20ed74e700 1 -- 172.21.15.70:0/1580279839 shutdown_connections 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.046+0000 7f20ed74e700 1 --2- 172.21.15.70:0/1580279839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e81075a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.046+0000 7f20ed74e700 1 -- 172.21.15.70:0/1580279839 >> 172.21.15.70:0/1580279839 conn(0x7f20e8102b20 msgr2=0x7f20e8104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.046+0000 7f20ed74e700 1 -- 172.21.15.70:0/1580279839 shutdown_connections 2024-04-26T20:18:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.046+0000 7f20ed74e700 1 -- 172.21.15.70:0/1580279839 wait complete. 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.047+0000 7f20ed74e700 1 Processor -- start 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.047+0000 7f20ed74e700 1 -- start start 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.048+0000 7f20ed74e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.048+0000 7f20ed74e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20e810d430 con 0x7f20e8107180 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.048+0000 7f20e6ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.048+0000 7f20e6ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e819cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38262/0 (socket says 172.21.15.70:38262) 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.048+0000 7f20e6ffd700 1 -- 172.21.15.70:0/799461579 learned_addr learned my addr 172.21.15.70:0/799461579 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.048+0000 7f20e6ffd700 1 -- 172.21.15.70:0/799461579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e819d4a0 con 0x7f20e8107180 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.048+0000 7f20e6ffd700 1 --2- 172.21.15.70:0/799461579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e819cf60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009520 tx=0x7f20d80045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.048+0000 7f20cffff700 1 -- 172.21.15.70:0/799461579 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20d80036a0 con 0x7f20e8107180 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.048+0000 7f20cffff700 1 -- 172.21.15.70:0/799461579 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f20d801a430 con 0x7f20e8107180 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.048+0000 7f20ed74e700 1 -- 172.21.15.70:0/799461579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e819d730 con 0x7f20e8107180 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.048+0000 7f20cffff700 1 -- 172.21.15.70:0/799461579 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20d8019550 con 0x7f20e8107180 2024-04-26T20:18:12.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.049+0000 7f20ed74e700 1 -- 172.21.15.70:0/799461579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e819db90 con 0x7f20e8107180 2024-04-26T20:18:12.130 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.049+0000 7f20cffff700 1 -- 172.21.15.70:0/799461579 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f20d8019800 con 0x7f20e8107180 2024-04-26T20:18:12.130 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.050+0000 7f20ed74e700 1 -- 172.21.15.70:0/799461579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e8064a80 con 0x7f20e8107180 2024-04-26T20:18:12.130 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.050+0000 7f20cffff700 1 --2- 172.21.15.70:0/799461579 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20d0039610 0x7f20d003bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:12.130 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.050+0000 7f20cffff700 1 -- 172.21.15.70:0/799461579 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f20d804e8e0 con 0x7f20e8107180 2024-04-26T20:18:12.131 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.050+0000 7f20e67fc700 1 --2- 172.21.15.70:0/799461579 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20d0039610 0x7f20d003bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:12.131 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.050+0000 7f20e67fc700 1 --2- 172.21.15.70:0/799461579 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20d0039610 0x7f20d003bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20dc006fd0 tx=0x7f20dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:12.131 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.059+0000 7f20cffff700 1 -- 172.21.15.70:0/799461579 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f20d8023c90 con 0x7f20e8107180 2024-04-26T20:18:12.131 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.281+0000 7f20ed74e700 1 -- 172.21.15.70:0/799461579 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f20e81a05a0 con 0x7f20d0039610 2024-04-26T20:18:12.131 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.504+0000 7f20cffff700 1 -- 172.21.15.70:0/799461579 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f20e81a05a0 con 0x7f20d0039610 2024-04-26T20:18:12.131 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.506+0000 7f20ed74e700 1 -- 172.21.15.70:0/799461579 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20d0039610 msgr2=0x7f20d003bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:12.131 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.506+0000 7f20ed74e700 1 --2- 172.21.15.70:0/799461579 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20d0039610 0x7f20d003bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20dc006fd0 tx=0x7f20dc006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:12.131 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.506+0000 7f20ed74e700 1 -- 172.21.15.70:0/799461579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 msgr2=0x7f20e819cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:12.131 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.506+0000 7f20ed74e700 1 --2- 172.21.15.70:0/799461579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e819cf60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009520 tx=0x7f20d80045f0 comp rx=0 tx=0).stop 2024-04-26T20:18:12.131 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.506+0000 7f20ed74e700 1 -- 172.21.15.70:0/799461579 shutdown_connections 2024-04-26T20:18:12.131 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.506+0000 7f20ed74e700 1 --2- 172.21.15.70:0/799461579 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20d0039610 0x7f20d003bad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:12.132 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.506+0000 7f20ed74e700 1 --2- 172.21.15.70:0/799461579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e8107180 0x7f20e819cf60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:12.132 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.506+0000 7f20ed74e700 1 -- 172.21.15.70:0/799461579 >> 172.21.15.70:0/799461579 conn(0x7f20e8102b20 msgr2=0x7f20e81036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:12.132 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.506+0000 7f20ed74e700 1 -- 172.21.15.70:0/799461579 shutdown_connections 2024-04-26T20:18:12.132 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:11.506+0000 7f20ed74e700 1 -- 172.21.15.70:0/799461579 wait complete. 2024-04-26T20:18:12.132 INFO:teuthology.orchestra.run.smithi070.stdout:Fetching dashboard port number... 2024-04-26T20:18:13.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:12 smithi070 ceph-mon[29124]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:13.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 8443 2024-04-26T20:18:13.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.556+0000 7f36f3075700 1 Processor -- start 2024-04-26T20:18:13.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.556+0000 7f36f3075700 1 -- start start 2024-04-26T20:18:13.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.556+0000 7f36f3075700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec1092c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:13.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.556+0000 7f36f3075700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec109800 con 0x7f36ec108ea0 2024-04-26T20:18:13.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.556+0000 7f36f0e11700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec1092c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:13.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.556+0000 7f36f0e11700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec1092c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38270/0 (socket says 172.21.15.70:38270) 2024-04-26T20:18:13.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.556+0000 7f36f0e11700 1 -- 172.21.15.70:0/992908388 learned_addr learned my addr 172.21.15.70:0/992908388 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:13.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.557+0000 7f36f0e11700 1 -- 172.21.15.70:0/992908388 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec10a040 con 0x7f36ec108ea0 2024-04-26T20:18:13.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.557+0000 7f36f0e11700 1 --2- 172.21.15.70:0/992908388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec1092c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f36e00098a0 tx=0x7f36e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b825c51a8ee0a2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.557+0000 7f36eb7fe700 1 -- 172.21.15.70:0/992908388 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e0004160 con 0x7f36ec108ea0 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.557+0000 7f36eb7fe700 1 -- 172.21.15.70:0/992908388 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36e0004300 con 0x7f36ec108ea0 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.557+0000 7f36eb7fe700 1 -- 172.21.15.70:0/992908388 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e0011af0 con 0x7f36ec108ea0 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.558+0000 7f36f3075700 1 -- 172.21.15.70:0/992908388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 msgr2=0x7f36ec1092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.558+0000 7f36f3075700 1 --2- 172.21.15.70:0/992908388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec1092c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f36e00098a0 tx=0x7f36e0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.558+0000 7f36f3075700 1 -- 172.21.15.70:0/992908388 shutdown_connections 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.558+0000 7f36f3075700 1 --2- 172.21.15.70:0/992908388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec1092c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.558+0000 7f36f3075700 1 -- 172.21.15.70:0/992908388 >> 172.21.15.70:0/992908388 conn(0x7f36ec1044b0 msgr2=0x7f36ec1068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.558+0000 7f36f3075700 1 -- 172.21.15.70:0/992908388 shutdown_connections 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.558+0000 7f36f3075700 1 -- 172.21.15.70:0/992908388 wait complete. 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.558+0000 7f36f3075700 1 Processor -- start 2024-04-26T20:18:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.558+0000 7f36f3075700 1 -- start start 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.558+0000 7f36f3075700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.558+0000 7f36f3075700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec10d300 con 0x7f36ec108ea0 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.559+0000 7f36f0e11700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.559+0000 7f36f0e11700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec19ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38286/0 (socket says 172.21.15.70:38286) 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.559+0000 7f36f0e11700 1 -- 172.21.15.70:0/4061448065 learned_addr learned my addr 172.21.15.70:0/4061448065 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.559+0000 7f36f0e11700 1 -- 172.21.15.70:0/4061448065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec19d3f0 con 0x7f36ec108ea0 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.559+0000 7f36f0e11700 1 --2- 172.21.15.70:0/4061448065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec19ceb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009520 tx=0x7f36e0003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.559+0000 7f36e9ffb700 1 -- 172.21.15.70:0/4061448065 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e00036a0 con 0x7f36ec108ea0 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.559+0000 7f36e9ffb700 1 -- 172.21.15.70:0/4061448065 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36e001a430 con 0x7f36ec108ea0 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.559+0000 7f36f3075700 1 -- 172.21.15.70:0/4061448065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ec19d680 con 0x7f36ec108ea0 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.559+0000 7f36e9ffb700 1 -- 172.21.15.70:0/4061448065 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e00193c0 con 0x7f36ec108ea0 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.559+0000 7f36f3075700 1 -- 172.21.15.70:0/4061448065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ec19dae0 con 0x7f36ec108ea0 2024-04-26T20:18:13.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.560+0000 7f36f3075700 1 -- 172.21.15.70:0/4061448065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ec064a80 con 0x7f36ec108ea0 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.560+0000 7f36e9ffb700 1 -- 172.21.15.70:0/4061448065 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f36e0019670 con 0x7f36ec108ea0 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.561+0000 7f36e9ffb700 1 --2- 172.21.15.70:0/4061448065 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f36dc0395b0 0x7f36dc03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.561+0000 7f36e9ffb700 1 -- 172.21.15.70:0/4061448065 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f36e004d9b0 con 0x7f36ec108ea0 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.561+0000 7f36ebfff700 1 --2- 172.21.15.70:0/4061448065 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f36dc0395b0 0x7f36dc03ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.561+0000 7f36ebfff700 1 --2- 172.21.15.70:0/4061448065 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f36dc0395b0 0x7f36dc03ba70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36d8006fd0 tx=0x7f36d8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.566+0000 7f36e9ffb700 1 -- 172.21.15.70:0/4061448065 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f36e000fda0 con 0x7f36ec108ea0 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.770+0000 7f36f3075700 1 -- 172.21.15.70:0/4061448065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f36ec1a04b0 con 0x7f36ec108ea0 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.770+0000 7f36e9ffb700 1 -- 172.21.15.70:0/4061448065 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f36e001a5e0 con 0x7f36ec108ea0 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.772+0000 7f36f3075700 1 -- 172.21.15.70:0/4061448065 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f36dc0395b0 msgr2=0x7f36dc03ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.772+0000 7f36f3075700 1 --2- 172.21.15.70:0/4061448065 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f36dc0395b0 0x7f36dc03ba70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36d8006fd0 tx=0x7f36d8006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.772+0000 7f36f3075700 1 -- 172.21.15.70:0/4061448065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 msgr2=0x7f36ec19ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.772+0000 7f36f3075700 1 --2- 172.21.15.70:0/4061448065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec19ceb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009520 tx=0x7f36e0003eb0 comp rx=0 tx=0).stop 2024-04-26T20:18:13.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.773+0000 7f36f3075700 1 -- 172.21.15.70:0/4061448065 shutdown_connections 2024-04-26T20:18:13.413 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.773+0000 7f36f3075700 1 --2- 172.21.15.70:0/4061448065 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f36dc0395b0 0x7f36dc03ba70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:13.413 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.773+0000 7f36f3075700 1 --2- 172.21.15.70:0/4061448065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ec108ea0 0x7f36ec19ceb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:13.413 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.773+0000 7f36f3075700 1 -- 172.21.15.70:0/4061448065 >> 172.21.15.70:0/4061448065 conn(0x7f36ec1044b0 msgr2=0x7f36ec104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:13.413 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.773+0000 7f36f3075700 1 -- 172.21.15.70:0/4061448065 shutdown_connections 2024-04-26T20:18:13.413 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:12.773+0000 7f36f3075700 1 -- 172.21.15.70:0/4061448065 wait complete. 2024-04-26T20:18:13.414 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:18:13.414 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-04-26T20:18:13.422 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:18:13.422 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-04-26T20:18:13.422 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-04-26T20:18:13.422 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-26T20:18:13.424 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph Dashboard is now available at: 2024-04-26T20:18:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: URL: https://smithi070:8443/ 2024-04-26T20:18:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: User: admin 2024-04-26T20:18:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: Password: kfnj6qnszc 2024-04-26T20:18:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:13.425 INFO:teuthology.orchestra.run.smithi070.stdout:Saving cluster configuration to /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config directory 2024-04-26T20:18:13.425 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling autotune for osd_memory_target 2024-04-26T20:18:14.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:13 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/4061448065' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-26T20:18:14.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:13 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:14.659 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.820+0000 7f607dac4700 1 Processor -- start 2024-04-26T20:18:14.659 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.820+0000 7f607dac4700 1 -- start start 2024-04-26T20:18:14.659 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.820+0000 7f607dac4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f60781081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:14.659 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.820+0000 7f607dac4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f60781087b0 con 0x7f6078107dc0 2024-04-26T20:18:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.821+0000 7f60777fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f60781081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.821+0000 7f60777fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f60781081e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38298/0 (socket says 172.21.15.70:38298) 2024-04-26T20:18:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.821+0000 7f60777fe700 1 -- 172.21.15.70:0/4051055401 learned_addr learned my addr 172.21.15.70:0/4051055401 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.821+0000 7f60777fe700 1 -- 172.21.15.70:0/4051055401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6078108fc0 con 0x7f6078107dc0 2024-04-26T20:18:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.821+0000 7f60777fe700 1 --2- 172.21.15.70:0/4051055401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f60781081e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60680098a0 tx=0x7f6068009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243197ec571456a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.821+0000 7f6076ffd700 1 -- 172.21.15.70:0/4051055401 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6068004160 con 0x7f6078107dc0 2024-04-26T20:18:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.821+0000 7f6076ffd700 1 -- 172.21.15.70:0/4051055401 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6068004300 con 0x7f6078107dc0 2024-04-26T20:18:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.821+0000 7f6076ffd700 1 -- 172.21.15.70:0/4051055401 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6068011af0 con 0x7f6078107dc0 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.822+0000 7f607dac4700 1 -- 172.21.15.70:0/4051055401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 msgr2=0x7f60781081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.822+0000 7f607dac4700 1 --2- 172.21.15.70:0/4051055401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f60781081e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60680098a0 tx=0x7f6068009bb0 comp rx=0 tx=0).stop 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.822+0000 7f607dac4700 1 -- 172.21.15.70:0/4051055401 shutdown_connections 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.822+0000 7f607dac4700 1 --2- 172.21.15.70:0/4051055401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f60781081e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.822+0000 7f607dac4700 1 -- 172.21.15.70:0/4051055401 >> 172.21.15.70:0/4051055401 conn(0x7f60781033a0 msgr2=0x7f60781057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.822+0000 7f607dac4700 1 -- 172.21.15.70:0/4051055401 shutdown_connections 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.822+0000 7f607dac4700 1 -- 172.21.15.70:0/4051055401 wait complete. 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.822+0000 7f607dac4700 1 Processor -- start 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.822+0000 7f607dac4700 1 -- start start 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f607dac4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f6078192f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f607dac4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f607810c370 con 0x7f6078107dc0 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f60777fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f6078192f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f60777fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f6078192f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38302/0 (socket says 172.21.15.70:38302) 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f60777fe700 1 -- 172.21.15.70:0/982885995 learned_addr learned my addr 172.21.15.70:0/982885995 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f60777fe700 1 -- 172.21.15.70:0/982885995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60781934b0 con 0x7f6078107dc0 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f60777fe700 1 --2- 172.21.15.70:0/982885995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f6078192f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6068009520 tx=0x7f60680045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f60757fa700 1 -- 172.21.15.70:0/982885995 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60680036a0 con 0x7f6078107dc0 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f60757fa700 1 -- 172.21.15.70:0/982885995 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f606801a430 con 0x7f6078107dc0 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f60757fa700 1 -- 172.21.15.70:0/982885995 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6068019550 con 0x7f6078107dc0 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f607dac4700 1 -- 172.21.15.70:0/982885995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60781916a0 con 0x7f6078107dc0 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.823+0000 7f607dac4700 1 -- 172.21.15.70:0/982885995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6078191be0 con 0x7f6078107dc0 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.824+0000 7f60757fa700 1 -- 172.21.15.70:0/982885995 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f606801a5e0 con 0x7f6078107dc0 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.824+0000 7f607dac4700 1 -- 172.21.15.70:0/982885995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6078064a80 con 0x7f6078107dc0 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.824+0000 7f60757fa700 1 --2- 172.21.15.70:0/982885995 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f60640395b0 0x7f606403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.824+0000 7f60757fa700 1 -- 172.21.15.70:0/982885995 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f606804da30 con 0x7f6078107dc0 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.824+0000 7f606effd700 1 --2- 172.21.15.70:0/982885995 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f60640395b0 0x7f606403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.825+0000 7f606effd700 1 --2- 172.21.15.70:0/982885995 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f60640395b0 0x7f606403ba70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6060006fd0 tx=0x7f6060006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.830+0000 7f60757fa700 1 -- 172.21.15.70:0/982885995 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f606801a9b0 con 0x7f6078107dc0 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:13.846+0000 7f60757fa700 1 -- 172.21.15.70:0/982885995 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f6068019850 con 0x7f6078107dc0 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.039+0000 7f607dac4700 1 -- 172.21.15.70:0/982885995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f6078196cf0 con 0x7f6078107dc0 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.039+0000 7f60757fa700 1 -- 172.21.15.70:0/982885995 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f606801be20 con 0x7f6078107dc0 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.041+0000 7f607dac4700 1 -- 172.21.15.70:0/982885995 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f60640395b0 msgr2=0x7f606403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.041+0000 7f607dac4700 1 --2- 172.21.15.70:0/982885995 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f60640395b0 0x7f606403ba70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6060006fd0 tx=0x7f6060006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.041+0000 7f607dac4700 1 -- 172.21.15.70:0/982885995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 msgr2=0x7f6078192f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.041+0000 7f607dac4700 1 --2- 172.21.15.70:0/982885995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f6078192f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6068009520 tx=0x7f60680045f0 comp rx=0 tx=0).stop 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.042+0000 7f607dac4700 1 -- 172.21.15.70:0/982885995 shutdown_connections 2024-04-26T20:18:14.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.042+0000 7f607dac4700 1 --2- 172.21.15.70:0/982885995 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f60640395b0 0x7f606403ba70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:14.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.042+0000 7f607dac4700 1 --2- 172.21.15.70:0/982885995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6078107dc0 0x7f6078192f70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:14.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.042+0000 7f607dac4700 1 -- 172.21.15.70:0/982885995 >> 172.21.15.70:0/982885995 conn(0x7f60781033a0 msgr2=0x7f6078104290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:14.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.042+0000 7f607dac4700 1 -- 172.21.15.70:0/982885995 shutdown_connections 2024-04-26T20:18:14.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:14.042+0000 7f607dac4700 1 -- 172.21.15.70:0/982885995 wait complete. 2024-04-26T20:18:14.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:14 smithi070 ceph-mon[29124]: mgrmap e13: x(active, since 6s) 2024-04-26T20:18:16.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.524+0000 7f44ad1fd700 1 Processor -- start 2024-04-26T20:18:16.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.524+0000 7f44ad1fd700 1 -- start start 2024-04-26T20:18:16.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.524+0000 7f44ad1fd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a81075a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:16.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.524+0000 7f44ad1fd700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44a8107b70 con 0x7f44a8107180 2024-04-26T20:18:16.463 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.524+0000 7f44a6d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a81075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.524+0000 7f44a6d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a81075a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38316/0 (socket says 172.21.15.70:38316) 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.524+0000 7f44a6d9d700 1 -- 172.21.15.70:0/3866854993 learned_addr learned my addr 172.21.15.70:0/3866854993 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.525+0000 7f44a6d9d700 1 -- 172.21.15.70:0/3866854993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a8107cf0 con 0x7f44a8107180 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.525+0000 7f44a6d9d700 1 --2- 172.21.15.70:0/3866854993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a81075a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f44980098a0 tx=0x7f4498009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545228c36a9d301a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.525+0000 7f44a659c700 1 -- 172.21.15.70:0/3866854993 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4498004160 con 0x7f44a8107180 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.525+0000 7f44a659c700 1 -- 172.21.15.70:0/3866854993 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4498004300 con 0x7f44a8107180 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.525+0000 7f44a659c700 1 -- 172.21.15.70:0/3866854993 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4498011af0 con 0x7f44a8107180 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.525+0000 7f44ad1fd700 1 -- 172.21.15.70:0/3866854993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 msgr2=0x7f44a81075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.525+0000 7f44ad1fd700 1 --2- 172.21.15.70:0/3866854993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a81075a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f44980098a0 tx=0x7f4498009bb0 comp rx=0 tx=0).stop 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.526+0000 7f44ad1fd700 1 -- 172.21.15.70:0/3866854993 shutdown_connections 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.526+0000 7f44ad1fd700 1 --2- 172.21.15.70:0/3866854993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a81075a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.526+0000 7f44ad1fd700 1 -- 172.21.15.70:0/3866854993 >> 172.21.15.70:0/3866854993 conn(0x7f44a8102b20 msgr2=0x7f44a8104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:16.464 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.526+0000 7f44ad1fd700 1 -- 172.21.15.70:0/3866854993 shutdown_connections 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.526+0000 7f44ad1fd700 1 -- 172.21.15.70:0/3866854993 wait complete. 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.526+0000 7f44ad1fd700 1 Processor -- start 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.526+0000 7f44ad1fd700 1 -- start start 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44ad1fd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44ad1fd700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44a810d430 con 0x7f44a8107180 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44a6d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44a6d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a819cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38328/0 (socket says 172.21.15.70:38328) 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44a6d9d700 1 -- 172.21.15.70:0/1144948348 learned_addr learned my addr 172.21.15.70:0/1144948348 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44a6d9d700 1 -- 172.21.15.70:0/1144948348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a819d4a0 con 0x7f44a8107180 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44a6d9d700 1 --2- 172.21.15.70:0/1144948348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a819cf60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4498009520 tx=0x7f44980045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44a4d99700 1 -- 172.21.15.70:0/1144948348 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44980036a0 con 0x7f44a8107180 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44a4d99700 1 -- 172.21.15.70:0/1144948348 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f449801a430 con 0x7f44a8107180 2024-04-26T20:18:16.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44ad1fd700 1 -- 172.21.15.70:0/1144948348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a819d730 con 0x7f44a8107180 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44a4d99700 1 -- 172.21.15.70:0/1144948348 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4498019550 con 0x7f44a8107180 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.527+0000 7f44ad1fd700 1 -- 172.21.15.70:0/1144948348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a819db90 con 0x7f44a8107180 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.528+0000 7f44a4d99700 1 -- 172.21.15.70:0/1144948348 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f4498019850 con 0x7f44a8107180 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.528+0000 7f44a4d99700 1 --2- 172.21.15.70:0/1144948348 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4494039650 0x7f449403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.528+0000 7f44a4d99700 1 -- 172.21.15.70:0/1144948348 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f449804ee30 con 0x7f44a8107180 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.528+0000 7f449e59c700 1 --2- 172.21.15.70:0/1144948348 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4494039650 0x7f449403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.528+0000 7f44ad1fd700 1 -- 172.21.15.70:0/1144948348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a8064a80 con 0x7f44a8107180 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.529+0000 7f449e59c700 1 --2- 172.21.15.70:0/1144948348 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4494039650 0x7f449403bb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4490006fd0 tx=0x7f4490006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.533+0000 7f44a4d99700 1 -- 172.21.15.70:0/1144948348 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f4498019dc0 con 0x7f44a8107180 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.847+0000 7f44ad1fd700 1 -- 172.21.15.70:0/1144948348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f44a81a04c0 con 0x7f44a8107180 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.849+0000 7f44a4d99700 1 -- 172.21.15.70:0/1144948348 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f4498032030 con 0x7f44a8107180 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.851+0000 7f44ad1fd700 1 -- 172.21.15.70:0/1144948348 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4494039650 msgr2=0x7f449403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:16.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.851+0000 7f44ad1fd700 1 --2- 172.21.15.70:0/1144948348 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4494039650 0x7f449403bb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4490006fd0 tx=0x7f4490006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.851+0000 7f44ad1fd700 1 -- 172.21.15.70:0/1144948348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 msgr2=0x7f44a819cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.851+0000 7f44ad1fd700 1 --2- 172.21.15.70:0/1144948348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a819cf60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4498009520 tx=0x7f44980045f0 comp rx=0 tx=0).stop 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.851+0000 7f44ad1fd700 1 -- 172.21.15.70:0/1144948348 shutdown_connections 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.852+0000 7f44ad1fd700 1 --2- 172.21.15.70:0/1144948348 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4494039650 0x7f449403bb10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.852+0000 7f44ad1fd700 1 --2- 172.21.15.70:0/1144948348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44a8107180 0x7f44a819cf60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.852+0000 7f44ad1fd700 1 -- 172.21.15.70:0/1144948348 >> 172.21.15.70:0/1144948348 conn(0x7f44a8102b20 msgr2=0x7f44a81036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.852+0000 7f44ad1fd700 1 -- 172.21.15.70:0/1144948348 shutdown_connections 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-04-26T20:18:15.852+0000 7f44ad1fd700 1 -- 172.21.15.70:0/1144948348 wait complete. 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:16.467 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout:Or, if you are only running a single cluster on this host: 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: ceph telemetry on 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout:For more information see: 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:16.468 INFO:teuthology.orchestra.run.smithi070.stdout:Bootstrap complete. 2024-04-26T20:18:16.505 INFO:tasks.cephadm:Fetching config... 2024-04-26T20:18:16.505 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:18:16.506 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-26T20:18:16.522 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-26T20:18:16.523 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:18:16.523 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-26T20:18:16.578 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-26T20:18:16.578 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:18:16.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-26T20:18:16.643 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-26T20:18:16.643 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:18:16.643 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-26T20:18:16.697 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-26T20:18:16.698 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhCZcDs+9FZULyQq+hQH+uwgkW8b+a/c3vcOhExgqcKBJD5ygofL6r0u9Sd3gQ5QQY1SMDX8yejPHPZmsAkoHmZP21X6dfisXuAIsrO8RR+IPSixB/DqSLVM4hhBhYnqRwju2Sq1Hu32mMCQWchB9ssig5CWsXU+lAt3nJctuPC2WqM54U4F+OeTkyCY9uzgkgPwVpPhrfUPuwMh3JuWi6p75Qy+s+eR+ko3JWqhKuzM/k0x6WOytxbV8FVKyYMYvMOeoVqs7Rcrwru55Z3DXJNjOV3doe8WMkncd1icvwEr1mSRpMrL6smfQQKxDVS3U9JjT3k3ot0LVURVWEyQQ8tUtNFMZ2q7RvWRPRwTsZ2QfRrTOR93PZOaMG818LWzCf3g/7Ur0CnLa/wO+yJttwPXnmcimI+v7Yl8l9b3AgPjfx/YkZe/FDdRDjOUWVsFoLQTYVYYskTUV2wixy5uxjKvzc6sGPxJq1ICZBwML9q91KeOEWvaMM0CMY7PeyJ20= ceph-cc0136ee-0409-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T20:18:16.773 INFO:teuthology.orchestra.run.smithi070.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhCZcDs+9FZULyQq+hQH+uwgkW8b+a/c3vcOhExgqcKBJD5ygofL6r0u9Sd3gQ5QQY1SMDX8yejPHPZmsAkoHmZP21X6dfisXuAIsrO8RR+IPSixB/DqSLVM4hhBhYnqRwju2Sq1Hu32mMCQWchB9ssig5CWsXU+lAt3nJctuPC2WqM54U4F+OeTkyCY9uzgkgPwVpPhrfUPuwMh3JuWi6p75Qy+s+eR+ko3JWqhKuzM/k0x6WOytxbV8FVKyYMYvMOeoVqs7Rcrwru55Z3DXJNjOV3doe8WMkncd1icvwEr1mSRpMrL6smfQQKxDVS3U9JjT3k3ot0LVURVWEyQQ8tUtNFMZ2q7RvWRPRwTsZ2QfRrTOR93PZOaMG818LWzCf3g/7Ur0CnLa/wO+yJttwPXnmcimI+v7Yl8l9b3AgPjfx/YkZe/FDdRDjOUWVsFoLQTYVYYskTUV2wixy5uxjKvzc6sGPxJq1ICZBwML9q91KeOEWvaMM0CMY7PeyJ20= ceph-cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:18:16.783 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhCZcDs+9FZULyQq+hQH+uwgkW8b+a/c3vcOhExgqcKBJD5ygofL6r0u9Sd3gQ5QQY1SMDX8yejPHPZmsAkoHmZP21X6dfisXuAIsrO8RR+IPSixB/DqSLVM4hhBhYnqRwju2Sq1Hu32mMCQWchB9ssig5CWsXU+lAt3nJctuPC2WqM54U4F+OeTkyCY9uzgkgPwVpPhrfUPuwMh3JuWi6p75Qy+s+eR+ko3JWqhKuzM/k0x6WOytxbV8FVKyYMYvMOeoVqs7Rcrwru55Z3DXJNjOV3doe8WMkncd1icvwEr1mSRpMrL6smfQQKxDVS3U9JjT3k3ot0LVURVWEyQQ8tUtNFMZ2q7RvWRPRwTsZ2QfRrTOR93PZOaMG818LWzCf3g/7Ur0CnLa/wO+yJttwPXnmcimI+v7Yl8l9b3AgPjfx/YkZe/FDdRDjOUWVsFoLQTYVYYskTUV2wixy5uxjKvzc6sGPxJq1ICZBwML9q91KeOEWvaMM0CMY7PeyJ20= ceph-cc0136ee-0409-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T20:18:16.823 INFO:teuthology.orchestra.run.smithi080.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhCZcDs+9FZULyQq+hQH+uwgkW8b+a/c3vcOhExgqcKBJD5ygofL6r0u9Sd3gQ5QQY1SMDX8yejPHPZmsAkoHmZP21X6dfisXuAIsrO8RR+IPSixB/DqSLVM4hhBhYnqRwju2Sq1Hu32mMCQWchB9ssig5CWsXU+lAt3nJctuPC2WqM54U4F+OeTkyCY9uzgkgPwVpPhrfUPuwMh3JuWi6p75Qy+s+eR+ko3JWqhKuzM/k0x6WOytxbV8FVKyYMYvMOeoVqs7Rcrwru55Z3DXJNjOV3doe8WMkncd1icvwEr1mSRpMrL6smfQQKxDVS3U9JjT3k3ot0LVURVWEyQQ8tUtNFMZ2q7RvWRPRwTsZ2QfRrTOR93PZOaMG818LWzCf3g/7Ur0CnLa/wO+yJttwPXnmcimI+v7Yl8l9b3AgPjfx/YkZe/FDdRDjOUWVsFoLQTYVYYskTUV2wixy5uxjKvzc6sGPxJq1ICZBwML9q91KeOEWvaMM0CMY7PeyJ20= ceph-cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:18:16.835 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhCZcDs+9FZULyQq+hQH+uwgkW8b+a/c3vcOhExgqcKBJD5ygofL6r0u9Sd3gQ5QQY1SMDX8yejPHPZmsAkoHmZP21X6dfisXuAIsrO8RR+IPSixB/DqSLVM4hhBhYnqRwju2Sq1Hu32mMCQWchB9ssig5CWsXU+lAt3nJctuPC2WqM54U4F+OeTkyCY9uzgkgPwVpPhrfUPuwMh3JuWi6p75Qy+s+eR+ko3JWqhKuzM/k0x6WOytxbV8FVKyYMYvMOeoVqs7Rcrwru55Z3DXJNjOV3doe8WMkncd1icvwEr1mSRpMrL6smfQQKxDVS3U9JjT3k3ot0LVURVWEyQQ8tUtNFMZ2q7RvWRPRwTsZ2QfRrTOR93PZOaMG818LWzCf3g/7Ur0CnLa/wO+yJttwPXnmcimI+v7Yl8l9b3AgPjfx/YkZe/FDdRDjOUWVsFoLQTYVYYskTUV2wixy5uxjKvzc6sGPxJq1ICZBwML9q91KeOEWvaMM0CMY7PeyJ20= ceph-cc0136ee-0409-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T20:18:16.874 INFO:teuthology.orchestra.run.smithi098.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhCZcDs+9FZULyQq+hQH+uwgkW8b+a/c3vcOhExgqcKBJD5ygofL6r0u9Sd3gQ5QQY1SMDX8yejPHPZmsAkoHmZP21X6dfisXuAIsrO8RR+IPSixB/DqSLVM4hhBhYnqRwju2Sq1Hu32mMCQWchB9ssig5CWsXU+lAt3nJctuPC2WqM54U4F+OeTkyCY9uzgkgPwVpPhrfUPuwMh3JuWi6p75Qy+s+eR+ko3JWqhKuzM/k0x6WOytxbV8FVKyYMYvMOeoVqs7Rcrwru55Z3DXJNjOV3doe8WMkncd1icvwEr1mSRpMrL6smfQQKxDVS3U9JjT3k3ot0LVURVWEyQQ8tUtNFMZ2q7RvWRPRwTsZ2QfRrTOR93PZOaMG818LWzCf3g/7Ur0CnLa/wO+yJttwPXnmcimI+v7Yl8l9b3AgPjfx/YkZe/FDdRDjOUWVsFoLQTYVYYskTUV2wixy5uxjKvzc6sGPxJq1ICZBwML9q91KeOEWvaMM0CMY7PeyJ20= ceph-cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:18:16.886 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-26T20:18:17.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:16 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1144948348' entity='client.admin' 2024-04-26T20:18:17.120 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:18:19.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.601+0000 7fcbf342d700 1 -- 172.21.15.70:0/4037456831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbec101d80 msgr2=0x7fcbec1021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:19.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.601+0000 7fcbf342d700 1 --2- 172.21.15.70:0/4037456831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbec101d80 0x7fcbec1021a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009910 tx=0x7fcbdc009c20 comp rx=0 tx=0).stop 2024-04-26T20:18:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.601+0000 7fcbf342d700 1 -- 172.21.15.70:0/4037456831 shutdown_connections 2024-04-26T20:18:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.601+0000 7fcbf342d700 1 --2- 172.21.15.70:0/4037456831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbec101d80 0x7fcbec1021a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.601+0000 7fcbf342d700 1 -- 172.21.15.70:0/4037456831 >> 172.21.15.70:0/4037456831 conn(0x7fcbec0fd320 msgr2=0x7fcbec0ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.601+0000 7fcbf342d700 1 -- 172.21.15.70:0/4037456831 shutdown_connections 2024-04-26T20:18:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.601+0000 7fcbf342d700 1 -- 172.21.15.70:0/4037456831 wait complete. 2024-04-26T20:18:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.602+0000 7fcbf342d700 1 Processor -- start 2024-04-26T20:18:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.602+0000 7fcbf342d700 1 -- start start 2024-04-26T20:18:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.602+0000 7fcbf342d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbec101d80 0x7fcbec1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.602+0000 7fcbf342d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec107e00 con 0x7fcbec101d80 2024-04-26T20:18:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.602+0000 7fcbf11c9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbec101d80 0x7fcbec1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.602+0000 7fcbf11c9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbec101d80 0x7fcbec1973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51638/0 (socket says 172.21.15.70:51638) 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.602+0000 7fcbf11c9700 1 -- 172.21.15.70:0/3465762718 learned_addr learned my addr 172.21.15.70:0/3465762718 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.602+0000 7fcbf11c9700 1 -- 172.21.15.70:0/3465762718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec197930 con 0x7fcbec101d80 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.602+0000 7fcbf11c9700 1 --2- 172.21.15.70:0/3465762718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbec101d80 0x7fcbec1973f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009ec0 tx=0x7fcbdc004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.603+0000 7fcbe27fc700 1 -- 172.21.15.70:0/3465762718 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc027070 con 0x7fcbec101d80 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.603+0000 7fcbe27fc700 1 -- 172.21.15.70:0/3465762718 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcbdc022470 con 0x7fcbec101d80 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.603+0000 7fcbf342d700 1 -- 172.21.15.70:0/3465762718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec197bc0 con 0x7fcbec101d80 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.603+0000 7fcbe27fc700 1 -- 172.21.15.70:0/3465762718 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc00f5f0 con 0x7fcbec101d80 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.603+0000 7fcbf342d700 1 -- 172.21.15.70:0/3465762718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbec19a8b0 con 0x7fcbec101d80 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.603+0000 7fcbe27fc700 1 -- 172.21.15.70:0/3465762718 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fcbdc02a070 con 0x7fcbec101d80 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.603+0000 7fcbf342d700 1 -- 172.21.15.70:0/3465762718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbec108580 con 0x7fcbec101d80 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.604+0000 7fcbe27fc700 1 --2- 172.21.15.70:0/3465762718 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcbd8039650 0x7fcbd803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.604+0000 7fcbe27fc700 1 -- 172.21.15.70:0/3465762718 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcbdc01e030 con 0x7fcbec101d80 2024-04-26T20:18:19.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.604+0000 7fcbf09c8700 1 --2- 172.21.15.70:0/3465762718 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcbd8039650 0x7fcbd803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:19.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.604+0000 7fcbf09c8700 1 --2- 172.21.15.70:0/3465762718 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcbd8039650 0x7fcbd803bb10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8006fd0 tx=0x7fcbe8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:19.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.609+0000 7fcbe27fc700 1 -- 172.21.15.70:0/3465762718 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fcbdc013070 con 0x7fcbec101d80 2024-04-26T20:18:19.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:19.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:19.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:19.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:19.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:19.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:19.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.813+0000 7fcbf342d700 1 -- 172.21.15.70:0/3465762718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fcbec02e5a0 con 0x7fcbec101d80 2024-04-26T20:18:19.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.817+0000 7fcbe27fc700 1 -- 172.21.15.70:0/3465762718 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fcbdc00e3e0 con 0x7fcbec101d80 2024-04-26T20:18:19.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.819+0000 7fcbf342d700 1 -- 172.21.15.70:0/3465762718 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcbd8039650 msgr2=0x7fcbd803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:19.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.819+0000 7fcbf342d700 1 --2- 172.21.15.70:0/3465762718 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcbd8039650 0x7fcbd803bb10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8006fd0 tx=0x7fcbe8006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:19.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.819+0000 7fcbf342d700 1 -- 172.21.15.70:0/3465762718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbec101d80 msgr2=0x7fcbec1973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:19.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.819+0000 7fcbf342d700 1 --2- 172.21.15.70:0/3465762718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbec101d80 0x7fcbec1973f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009ec0 tx=0x7fcbdc004690 comp rx=0 tx=0).stop 2024-04-26T20:18:19.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.819+0000 7fcbf342d700 1 -- 172.21.15.70:0/3465762718 shutdown_connections 2024-04-26T20:18:19.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.819+0000 7fcbf342d700 1 --2- 172.21.15.70:0/3465762718 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcbd8039650 0x7fcbd803bb10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:19.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.819+0000 7fcbf342d700 1 --2- 172.21.15.70:0/3465762718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbec101d80 0x7fcbec1973f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:19.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.819+0000 7fcbf342d700 1 -- 172.21.15.70:0/3465762718 >> 172.21.15.70:0/3465762718 conn(0x7fcbec0fd320 msgr2=0x7fcbec0fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:19.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.819+0000 7fcbf342d700 1 -- 172.21.15.70:0/3465762718 shutdown_connections 2024-04-26T20:18:19.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:19.819+0000 7fcbf342d700 1 -- 172.21.15.70:0/3465762718 wait complete. 2024-04-26T20:18:20.492 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-26T20:18:20.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-26T20:18:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:20 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3465762718' entity='client.admin' 2024-04-26T20:18:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:21.173 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:18:22.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.651+0000 7f4a40980700 1 -- 172.21.15.70:0/2876533281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a3c103930 msgr2=0x7f4a3c105d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:22.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.651+0000 7f4a40980700 1 --2- 172.21.15.70:0/2876533281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a3c103930 0x7f4a3c105d20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009910 tx=0x7f4a2c009c20 comp rx=0 tx=0).stop 2024-04-26T20:18:22.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.651+0000 7f4a40980700 1 -- 172.21.15.70:0/2876533281 shutdown_connections 2024-04-26T20:18:22.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.651+0000 7f4a40980700 1 --2- 172.21.15.70:0/2876533281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a3c103930 0x7f4a3c105d20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:22.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.651+0000 7f4a40980700 1 -- 172.21.15.70:0/2876533281 >> 172.21.15.70:0/2876533281 conn(0x7f4a3c0fd360 msgr2=0x7f4a3c0ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:22.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.651+0000 7f4a40980700 1 -- 172.21.15.70:0/2876533281 shutdown_connections 2024-04-26T20:18:22.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.651+0000 7f4a40980700 1 -- 172.21.15.70:0/2876533281 wait complete. 2024-04-26T20:18:22.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.651+0000 7f4a40980700 1 Processor -- start 2024-04-26T20:18:22.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.652+0000 7f4a40980700 1 -- start start 2024-04-26T20:18:22.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.652+0000 7f4a40980700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a3c103930 0x7f4a3c1031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:22.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.652+0000 7f4a40980700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c108ec0 con 0x7f4a3c103930 2024-04-26T20:18:22.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.652+0000 7f4a3a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a3c103930 0x7f4a3c1031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:22.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.652+0000 7f4a3a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a3c103930 0x7f4a3c1031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51658/0 (socket says 172.21.15.70:51658) 2024-04-26T20:18:22.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.652+0000 7f4a3a59c700 1 -- 172.21.15.70:0/34932131 learned_addr learned my addr 172.21.15.70:0/34932131 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:22.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.652+0000 7f4a3a59c700 1 -- 172.21.15.70:0/34932131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c1036f0 con 0x7f4a3c103930 2024-04-26T20:18:22.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.652+0000 7f4a3a59c700 1 --2- 172.21.15.70:0/34932131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a3c103930 0x7f4a3c1031b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009ef0 tx=0x7f4a2c004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:22.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.653+0000 7f4a33fff700 1 -- 172.21.15.70:0/34932131 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a2c027070 con 0x7f4a3c103930 2024-04-26T20:18:22.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.653+0000 7f4a40980700 1 -- 172.21.15.70:0/34932131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3c1018e0 con 0x7f4a3c103930 2024-04-26T20:18:22.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.653+0000 7f4a33fff700 1 -- 172.21.15.70:0/34932131 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a2c022470 con 0x7f4a3c103930 2024-04-26T20:18:22.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.653+0000 7f4a33fff700 1 -- 172.21.15.70:0/34932131 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a2c00f5f0 con 0x7f4a3c103930 2024-04-26T20:18:22.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.653+0000 7f4a40980700 1 -- 172.21.15.70:0/34932131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3c101e20 con 0x7f4a3c103930 2024-04-26T20:18:22.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.654+0000 7f4a33fff700 1 -- 172.21.15.70:0/34932131 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f4a2c02a070 con 0x7f4a3c103930 2024-04-26T20:18:22.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.654+0000 7f4a40980700 1 -- 172.21.15.70:0/34932131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a3c109640 con 0x7f4a3c103930 2024-04-26T20:18:22.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.654+0000 7f4a33fff700 1 --2- 172.21.15.70:0/34932131 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4a28039650 0x7f4a2803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:22.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.654+0000 7f4a33fff700 1 -- 172.21.15.70:0/34932131 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4a2c01e030 con 0x7f4a3c103930 2024-04-26T20:18:22.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.654+0000 7f4a31d9b700 1 --2- 172.21.15.70:0/34932131 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4a28039650 0x7f4a2803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:22.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.654+0000 7f4a31d9b700 1 --2- 172.21.15.70:0/34932131 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4a28039650 0x7f4a2803bb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a24006fd0 tx=0x7f4a24006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:22.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.659+0000 7f4a33fff700 1 -- 172.21.15.70:0/34932131 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f4a2c013070 con 0x7f4a3c103930 2024-04-26T20:18:22.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.863+0000 7f4a40980700 1 -- 172.21.15.70:0/34932131 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f4a3c191b80 con 0x7f4a28039650 2024-04-26T20:18:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.866+0000 7f4a33fff700 1 -- 172.21.15.70:0/34932131 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4a3c191b80 con 0x7f4a28039650 2024-04-26T20:18:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.868+0000 7f4a40980700 1 -- 172.21.15.70:0/34932131 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4a28039650 msgr2=0x7f4a2803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.868+0000 7f4a40980700 1 --2- 172.21.15.70:0/34932131 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4a28039650 0x7f4a2803bb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a24006fd0 tx=0x7f4a24006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.868+0000 7f4a40980700 1 -- 172.21.15.70:0/34932131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a3c103930 msgr2=0x7f4a3c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.868+0000 7f4a40980700 1 --2- 172.21.15.70:0/34932131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a3c103930 0x7f4a3c1031b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009ef0 tx=0x7f4a2c004690 comp rx=0 tx=0).stop 2024-04-26T20:18:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.868+0000 7f4a40980700 1 -- 172.21.15.70:0/34932131 shutdown_connections 2024-04-26T20:18:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.868+0000 7f4a40980700 1 --2- 172.21.15.70:0/34932131 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4a28039650 0x7f4a2803bb10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.868+0000 7f4a40980700 1 --2- 172.21.15.70:0/34932131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a3c103930 0x7f4a3c1031b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.868+0000 7f4a40980700 1 -- 172.21.15.70:0/34932131 >> 172.21.15.70:0/34932131 conn(0x7f4a3c0fd360 msgr2=0x7f4a3c0fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.868+0000 7f4a40980700 1 -- 172.21.15.70:0/34932131 shutdown_connections 2024-04-26T20:18:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:22.868+0000 7f4a40980700 1 -- 172.21.15.70:0/34932131 wait complete. 2024-04-26T20:18:23.624 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi080 2024-04-26T20:18:23.624 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T20:18:23.624 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/etc/ceph/ceph.conf 2024-04-26T20:18:23.643 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T20:18:23.643 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:18:23.701 INFO:tasks.cephadm:Adding host smithi080 to orchestrator... 2024-04-26T20:18:23.701 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch host add smithi080 2024-04-26T20:18:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:18:24.165 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:24.165 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:24.165 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:24.165 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:24.165 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:24.165 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: Updating smithi070:/etc/ceph/ceph.conf 2024-04-26T20:18:24.166 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: Updating smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:18:24.166 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:18:24.166 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: Updating smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:18:24.166 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:24.166 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:24.166 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.455+0000 7f1b01a34700 1 -- 172.21.15.70:0/228902590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1afc103090 msgr2=0x7f1afc103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.455+0000 7f1b01a34700 1 --2- 172.21.15.70:0/228902590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1afc103090 0x7f1afc103470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009910 tx=0x7f1aec009c20 comp rx=0 tx=0).stop 2024-04-26T20:18:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.455+0000 7f1b01a34700 1 -- 172.21.15.70:0/228902590 shutdown_connections 2024-04-26T20:18:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.455+0000 7f1b01a34700 1 --2- 172.21.15.70:0/228902590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1afc103090 0x7f1afc103470 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.455+0000 7f1b01a34700 1 -- 172.21.15.70:0/228902590 >> 172.21.15.70:0/228902590 conn(0x7f1afc0fe960 msgr2=0x7f1afc100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.455+0000 7f1b01a34700 1 -- 172.21.15.70:0/228902590 shutdown_connections 2024-04-26T20:18:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.455+0000 7f1b01a34700 1 -- 172.21.15.70:0/228902590 wait complete. 2024-04-26T20:18:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.456+0000 7f1b01a34700 1 Processor -- start 2024-04-26T20:18:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.456+0000 7f1b01a34700 1 -- start start 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.456+0000 7f1b01a34700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1afc103090 0x7f1afc19e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.456+0000 7f1b01a34700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc10d450 con 0x7f1afc103090 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.456+0000 7f1afaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1afc103090 0x7f1afc19e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.456+0000 7f1afaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1afc103090 0x7f1afc19e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51682/0 (socket says 172.21.15.70:51682) 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.456+0000 7f1afaffd700 1 -- 172.21.15.70:0/3676866461 learned_addr learned my addr 172.21.15.70:0/3676866461 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.457+0000 7f1afaffd700 1 -- 172.21.15.70:0/3676866461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1afc19eb60 con 0x7f1afc103090 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.457+0000 7f1afaffd700 1 --2- 172.21.15.70:0/3676866461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1afc103090 0x7f1afc19e620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1aec005780 tx=0x7f1aec0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.457+0000 7f1b00a32700 1 -- 172.21.15.70:0/3676866461 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec026070 con 0x7f1afc103090 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.457+0000 7f1b00a32700 1 -- 172.21.15.70:0/3676866461 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1aec004370 con 0x7f1afc103090 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.457+0000 7f1b01a34700 1 -- 172.21.15.70:0/3676866461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1afc19ee50 con 0x7f1afc103090 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.457+0000 7f1b00a32700 1 -- 172.21.15.70:0/3676866461 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec003a30 con 0x7f1afc103090 2024-04-26T20:18:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.457+0000 7f1b01a34700 1 -- 172.21.15.70:0/3676866461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1afc1988c0 con 0x7f1afc103090 2024-04-26T20:18:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.458+0000 7f1b00a32700 1 -- 172.21.15.70:0/3676866461 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f1aec029070 con 0x7f1afc103090 2024-04-26T20:18:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.458+0000 7f1b01a34700 1 -- 172.21.15.70:0/3676866461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1afc104570 con 0x7f1afc103090 2024-04-26T20:18:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.458+0000 7f1b00a32700 1 --2- 172.21.15.70:0/3676866461 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1ae4039650 0x7f1ae403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.458+0000 7f1b00a32700 1 -- 172.21.15.70:0/3676866461 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1aec01e070 con 0x7f1afc103090 2024-04-26T20:18:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.458+0000 7f1afa7fc700 1 --2- 172.21.15.70:0/3676866461 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1ae4039650 0x7f1ae403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.459+0000 7f1afa7fc700 1 --2- 172.21.15.70:0/3676866461 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1ae4039650 0x7f1ae403bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1af0006fd0 tx=0x7f1af0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.463+0000 7f1b00a32700 1 -- 172.21.15.70:0/3676866461 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1aec013070 con 0x7f1afc103090 2024-04-26T20:18:25.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:25.667+0000 7f1b01a34700 1 -- 172.21.15.70:0/3676866461 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi080", "target": ["mon-mgr", ""]}) -- 0x7f1afc199c50 con 0x7f1ae4039650 2024-04-26T20:18:26.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:25 smithi070 ceph-mon[29124]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi080", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:27.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:26 smithi070 ceph-mon[29124]: Deploying cephadm binary to smithi080 2024-04-26T20:18:28.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:27 smithi070 ceph-mon[29124]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:29.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:29.831+0000 7f1b00a32700 1 -- 172.21.15.70:0/3676866461 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f1afc199c50 con 0x7f1ae4039650 2024-04-26T20:18:29.832 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi080' with addr '172.21.15.80' 2024-04-26T20:18:29.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:29.833+0000 7f1b01a34700 1 -- 172.21.15.70:0/3676866461 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1ae4039650 msgr2=0x7f1ae403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:29.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:29.833+0000 7f1b01a34700 1 --2- 172.21.15.70:0/3676866461 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1ae4039650 0x7f1ae403bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1af0006fd0 tx=0x7f1af0006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:29.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:29.833+0000 7f1b01a34700 1 -- 172.21.15.70:0/3676866461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1afc103090 msgr2=0x7f1afc19e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:29.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:29.833+0000 7f1b01a34700 1 --2- 172.21.15.70:0/3676866461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1afc103090 0x7f1afc19e620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1aec005780 tx=0x7f1aec0057b0 comp rx=0 tx=0).stop 2024-04-26T20:18:29.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:29.833+0000 7f1b01a34700 1 -- 172.21.15.70:0/3676866461 shutdown_connections 2024-04-26T20:18:29.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:29.833+0000 7f1b01a34700 1 --2- 172.21.15.70:0/3676866461 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1ae4039650 0x7f1ae403bb10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:29.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:29.833+0000 7f1b01a34700 1 --2- 172.21.15.70:0/3676866461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1afc103090 0x7f1afc19e620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:29.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:29.833+0000 7f1b01a34700 1 -- 172.21.15.70:0/3676866461 >> 172.21.15.70:0/3676866461 conn(0x7f1afc0fe960 msgr2=0x7f1afc104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:29.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:29.833+0000 7f1b01a34700 1 -- 172.21.15.70:0/3676866461 shutdown_connections 2024-04-26T20:18:29.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:29.833+0000 7f1b01a34700 1 -- 172.21.15.70:0/3676866461 wait complete. 2024-04-26T20:18:30.427 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T20:18:30.664 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:18:31.117 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:30 smithi070 ceph-mon[29124]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:31.117 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:30 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:31.118 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:30 smithi070 ceph-mon[29124]: Added host smithi080 2024-04-26T20:18:31.118 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:30 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:31.118 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:30 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:32.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:31 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:32.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:31 smithi070 ceph-mon[29124]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.281+0000 7fec7d857700 1 -- 172.21.15.70:0/3123959411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec78108ec0 msgr2=0x7fec781092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.281+0000 7fec7d857700 1 --2- 172.21.15.70:0/3123959411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec78108ec0 0x7fec781092a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec68009910 tx=0x7fec68009c20 comp rx=0 tx=0).stop 2024-04-26T20:18:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.282+0000 7fec7d857700 1 -- 172.21.15.70:0/3123959411 shutdown_connections 2024-04-26T20:18:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.282+0000 7fec7d857700 1 --2- 172.21.15.70:0/3123959411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec78108ec0 0x7fec781092a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.282+0000 7fec7d857700 1 -- 172.21.15.70:0/3123959411 >> 172.21.15.70:0/3123959411 conn(0x7fec78077880 msgr2=0x7fec78077c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.282+0000 7fec7d857700 1 -- 172.21.15.70:0/3123959411 shutdown_connections 2024-04-26T20:18:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.282+0000 7fec7d857700 1 -- 172.21.15.70:0/3123959411 wait complete. 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.282+0000 7fec7d857700 1 Processor -- start 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.282+0000 7fec7d857700 1 -- start start 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.282+0000 7fec7d857700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec78108ec0 0x7fec78101e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.282+0000 7fec7d857700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810d440 con 0x7fec78108ec0 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.283+0000 7fec76ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec78108ec0 0x7fec78101e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.283+0000 7fec76ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec78108ec0 0x7fec78101e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50580/0 (socket says 172.21.15.70:50580) 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.283+0000 7fec76ffd700 1 -- 172.21.15.70:0/2112316410 learned_addr learned my addr 172.21.15.70:0/2112316410 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.283+0000 7fec76ffd700 1 -- 172.21.15.70:0/2112316410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec78103ce0 con 0x7fec78108ec0 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.283+0000 7fec76ffd700 1 --2- 172.21.15.70:0/2112316410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec78108ec0 0x7fec78101e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fec68006010 tx=0x7fec68009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.283+0000 7fec7c855700 1 -- 172.21.15.70:0/2112316410 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec68027070 con 0x7fec78108ec0 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.283+0000 7fec7d857700 1 -- 172.21.15.70:0/2112316410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec78102380 con 0x7fec78108ec0 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.283+0000 7fec7c855700 1 -- 172.21.15.70:0/2112316410 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fec6800be30 con 0x7fec78108ec0 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.283+0000 7fec7c855700 1 -- 172.21.15.70:0/2112316410 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec6800f460 con 0x7fec78108ec0 2024-04-26T20:18:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.283+0000 7fec7d857700 1 -- 172.21.15.70:0/2112316410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec78102840 con 0x7fec78108ec0 2024-04-26T20:18:32.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.284+0000 7fec7c855700 1 -- 172.21.15.70:0/2112316410 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fec6802a070 con 0x7fec78108ec0 2024-04-26T20:18:32.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.284+0000 7fec7d857700 1 -- 172.21.15.70:0/2112316410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec78104570 con 0x7fec78108ec0 2024-04-26T20:18:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.284+0000 7fec7c855700 1 --2- 172.21.15.70:0/2112316410 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fec60039650 0x7fec6003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.284+0000 7fec7c855700 1 -- 172.21.15.70:0/2112316410 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fec6801e030 con 0x7fec78108ec0 2024-04-26T20:18:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.284+0000 7fec767fc700 1 --2- 172.21.15.70:0/2112316410 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fec60039650 0x7fec6003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.285+0000 7fec767fc700 1 --2- 172.21.15.70:0/2112316410 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fec60039650 0x7fec6003bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fec6c006fd0 tx=0x7fec6c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.289+0000 7fec7c855700 1 -- 172.21.15.70:0/2112316410 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fec68013070 con 0x7fec78108ec0 2024-04-26T20:18:32.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.499+0000 7fec7d857700 1 -- 172.21.15.70:0/2112316410 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec78103390 con 0x7fec60039650 2024-04-26T20:18:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.501+0000 7fec7c855700 1 -- 172.21.15.70:0/2112316410 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7fec78103390 con 0x7fec60039650 2024-04-26T20:18:32.501 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:32.502 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.80", "hostname": "smithi080", "labels": [], "status": ""}] 2024-04-26T20:18:32.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.503+0000 7fec7d857700 1 -- 172.21.15.70:0/2112316410 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fec60039650 msgr2=0x7fec6003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:32.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.503+0000 7fec7d857700 1 --2- 172.21.15.70:0/2112316410 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fec60039650 0x7fec6003bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fec6c006fd0 tx=0x7fec6c006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:32.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.503+0000 7fec7d857700 1 -- 172.21.15.70:0/2112316410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec78108ec0 msgr2=0x7fec78101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:32.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.503+0000 7fec7d857700 1 --2- 172.21.15.70:0/2112316410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec78108ec0 0x7fec78101e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fec68006010 tx=0x7fec68009ec0 comp rx=0 tx=0).stop 2024-04-26T20:18:32.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.504+0000 7fec7d857700 1 -- 172.21.15.70:0/2112316410 shutdown_connections 2024-04-26T20:18:32.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.504+0000 7fec7d857700 1 --2- 172.21.15.70:0/2112316410 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fec60039650 0x7fec6003bb10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:32.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.504+0000 7fec7d857700 1 --2- 172.21.15.70:0/2112316410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec78108ec0 0x7fec78101e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:32.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.504+0000 7fec7d857700 1 -- 172.21.15.70:0/2112316410 >> 172.21.15.70:0/2112316410 conn(0x7fec78077880 msgr2=0x7fec780ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:32.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.504+0000 7fec7d857700 1 -- 172.21.15.70:0/2112316410 shutdown_connections 2024-04-26T20:18:32.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:32.504+0000 7fec7d857700 1 -- 172.21.15.70:0/2112316410 wait complete. 2024-04-26T20:18:33.071 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi098 2024-04-26T20:18:33.071 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T20:18:33.071 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.conf 2024-04-26T20:18:33.091 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T20:18:33.091 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:18:33.148 INFO:tasks.cephadm:Adding host smithi098 to orchestrator... 2024-04-26T20:18:33.148 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch host add smithi098 2024-04-26T20:18:33.378 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:18:33.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:33 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:33.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:33 smithi070 ceph-mon[29124]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:18:34.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:34 smithi070 ceph-mon[29124]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:34.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.938+0000 7f377a145700 1 -- 172.21.15.70:0/4251568928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3774101fd0 msgr2=0x7f37741023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:34.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.938+0000 7f377a145700 1 --2- 172.21.15.70:0/4251568928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3774101fd0 0x7f37741023b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3764009910 tx=0x7f3764009c20 comp rx=0 tx=0).stop 2024-04-26T20:18:34.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.938+0000 7f377a145700 1 -- 172.21.15.70:0/4251568928 shutdown_connections 2024-04-26T20:18:34.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.938+0000 7f377a145700 1 --2- 172.21.15.70:0/4251568928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3774101fd0 0x7f37741023b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:34.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.938+0000 7f377a145700 1 -- 172.21.15.70:0/4251568928 >> 172.21.15.70:0/4251568928 conn(0x7f3774077880 msgr2=0x7f3774077c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:34.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.938+0000 7f377a145700 1 -- 172.21.15.70:0/4251568928 shutdown_connections 2024-04-26T20:18:34.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.938+0000 7f377a145700 1 -- 172.21.15.70:0/4251568928 wait complete. 2024-04-26T20:18:34.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.939+0000 7f377a145700 1 Processor -- start 2024-04-26T20:18:34.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.939+0000 7f377a145700 1 -- start start 2024-04-26T20:18:34.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.939+0000 7f377a145700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3774101fd0 0x7f377419d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:34.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.939+0000 7f377a145700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f377410c340 con 0x7f3774101fd0 2024-04-26T20:18:34.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.939+0000 7f37737fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3774101fd0 0x7f377419d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:34.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.939+0000 7f37737fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3774101fd0 0x7f377419d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50606/0 (socket says 172.21.15.70:50606) 2024-04-26T20:18:34.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.939+0000 7f37737fe700 1 -- 172.21.15.70:0/3550672528 learned_addr learned my addr 172.21.15.70:0/3550672528 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:34.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.940+0000 7f37737fe700 1 -- 172.21.15.70:0/3550672528 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377419d980 con 0x7f3774101fd0 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.940+0000 7f37737fe700 1 --2- 172.21.15.70:0/3550672528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3774101fd0 0x7f377419d440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3764005780 tx=0x7f37640057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.940+0000 7f37717fa700 1 -- 172.21.15.70:0/3550672528 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3764026070 con 0x7f3774101fd0 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.940+0000 7f37717fa700 1 -- 172.21.15.70:0/3550672528 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3764004370 con 0x7f3774101fd0 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.940+0000 7f377a145700 1 -- 172.21.15.70:0/3550672528 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377419dc70 con 0x7f3774101fd0 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.940+0000 7f37717fa700 1 -- 172.21.15.70:0/3550672528 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3764003a30 con 0x7f3774101fd0 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.940+0000 7f377a145700 1 -- 172.21.15.70:0/3550672528 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3774197600 con 0x7f3774101fd0 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.941+0000 7f37717fa700 1 -- 172.21.15.70:0/3550672528 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f3764029070 con 0x7f3774101fd0 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.941+0000 7f377a145700 1 -- 172.21.15.70:0/3550672528 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3774103460 con 0x7f3774101fd0 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.941+0000 7f37717fa700 1 --2- 172.21.15.70:0/3550672528 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3760039650 0x7f376003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.941+0000 7f37717fa700 1 -- 172.21.15.70:0/3550672528 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f376401e070 con 0x7f3774101fd0 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.941+0000 7f376bfff700 1 --2- 172.21.15.70:0/3550672528 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3760039650 0x7f376003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:34.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.941+0000 7f376bfff700 1 --2- 172.21.15.70:0/3550672528 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3760039650 0x7f376003bb10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f375c006fd0 tx=0x7f375c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:34.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:34.946+0000 7f37717fa700 1 -- 172.21.15.70:0/3550672528 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f3764013070 con 0x7f3774101fd0 2024-04-26T20:18:35.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:35.147+0000 7f377a145700 1 -- 172.21.15.70:0/3550672528 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}) -- 0x7f3774198b30 con 0x7f3760039650 2024-04-26T20:18:36.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi080", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T20:18:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:18:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:36 smithi070 ceph-mon[29124]: Deploying cephadm binary to smithi098 2024-04-26T20:18:37.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:37 smithi070 ceph-mon[29124]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:18:37.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:37 smithi070 ceph-mon[29124]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:18:38.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:38 smithi070 ceph-mon[29124]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:39.323 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi098' with addr '172.21.15.98' 2024-04-26T20:18:39.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:39.321+0000 7f37717fa700 1 -- 172.21.15.70:0/3550672528 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f3774198b30 con 0x7f3760039650 2024-04-26T20:18:39.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:39.324+0000 7f377a145700 1 -- 172.21.15.70:0/3550672528 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3760039650 msgr2=0x7f376003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:39.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:39.324+0000 7f377a145700 1 --2- 172.21.15.70:0/3550672528 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3760039650 0x7f376003bb10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f375c006fd0 tx=0x7f375c006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:39.324+0000 7f377a145700 1 -- 172.21.15.70:0/3550672528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3774101fd0 msgr2=0x7f377419d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:39.324+0000 7f377a145700 1 --2- 172.21.15.70:0/3550672528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3774101fd0 0x7f377419d440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3764005780 tx=0x7f37640057b0 comp rx=0 tx=0).stop 2024-04-26T20:18:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:39.324+0000 7f377a145700 1 -- 172.21.15.70:0/3550672528 shutdown_connections 2024-04-26T20:18:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:39.324+0000 7f377a145700 1 --2- 172.21.15.70:0/3550672528 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3760039650 0x7f376003bb10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:39.324+0000 7f377a145700 1 --2- 172.21.15.70:0/3550672528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3774101fd0 0x7f377419d440 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:39.324+0000 7f377a145700 1 -- 172.21.15.70:0/3550672528 >> 172.21.15.70:0/3550672528 conn(0x7f3774077880 msgr2=0x7f3774103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:39.325+0000 7f377a145700 1 -- 172.21.15.70:0/3550672528 shutdown_connections 2024-04-26T20:18:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:39.325+0000 7f377a145700 1 -- 172.21.15.70:0/3550672528 wait complete. 2024-04-26T20:18:39.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:39.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:39.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:39.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:39.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:39.971 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T20:18:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:18:41.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:40 smithi070 ceph-mon[29124]: Added host smithi098 2024-04-26T20:18:41.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:40 smithi070 ceph-mon[29124]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:41.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:40 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:41.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:40 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:41.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.547+0000 7fb14f77e700 1 -- 172.21.15.70:0/2238295588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb148101800 msgr2=0x7fb148101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:41.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.547+0000 7fb14f77e700 1 --2- 172.21.15.70:0/2238295588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb148101800 0x7fb148101be0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb13800aa20 tx=0x7fb13800ad30 comp rx=0 tx=0).stop 2024-04-26T20:18:41.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.547+0000 7fb14f77e700 1 -- 172.21.15.70:0/2238295588 shutdown_connections 2024-04-26T20:18:41.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.547+0000 7fb14f77e700 1 --2- 172.21.15.70:0/2238295588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb148101800 0x7fb148101be0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:41.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.547+0000 7fb14f77e700 1 -- 172.21.15.70:0/2238295588 >> 172.21.15.70:0/2238295588 conn(0x7fb1480fcf90 msgr2=0x7fb1480ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:41.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.547+0000 7fb14f77e700 1 -- 172.21.15.70:0/2238295588 shutdown_connections 2024-04-26T20:18:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.547+0000 7fb14f77e700 1 -- 172.21.15.70:0/2238295588 wait complete. 2024-04-26T20:18:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.548+0000 7fb14f77e700 1 Processor -- start 2024-04-26T20:18:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.548+0000 7fb14f77e700 1 -- start start 2024-04-26T20:18:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.548+0000 7fb14f77e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb148101800 0x7fb14819e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.548+0000 7fb14f77e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb14810b340 con 0x7fb148101800 2024-04-26T20:18:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.548+0000 7fb14d51a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb148101800 0x7fb14819e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.548+0000 7fb14d51a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb148101800 0x7fb14819e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49854/0 (socket says 172.21.15.70:49854) 2024-04-26T20:18:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.548+0000 7fb14d51a700 1 -- 172.21.15.70:0/869364561 learned_addr learned my addr 172.21.15.70:0/869364561 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.548+0000 7fb14d51a700 1 -- 172.21.15.70:0/869364561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14819ebc0 con 0x7fb148101800 2024-04-26T20:18:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.548+0000 7fb14d51a700 1 --2- 172.21.15.70:0/869364561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb148101800 0x7fb14819e680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb138006010 tx=0x7fb138004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.549+0000 7fb13e7fc700 1 -- 172.21.15.70:0/869364561 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1380052f0 con 0x7fb148101800 2024-04-26T20:18:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.549+0000 7fb13e7fc700 1 -- 172.21.15.70:0/869364561 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb138005490 con 0x7fb148101800 2024-04-26T20:18:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.549+0000 7fb14f77e700 1 -- 172.21.15.70:0/869364561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14819ee50 con 0x7fb148101800 2024-04-26T20:18:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.549+0000 7fb13e7fc700 1 -- 172.21.15.70:0/869364561 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb13800e7f0 con 0x7fb148101800 2024-04-26T20:18:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.549+0000 7fb14f77e700 1 -- 172.21.15.70:0/869364561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb148198800 con 0x7fb148101800 2024-04-26T20:18:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.549+0000 7fb13e7fc700 1 -- 172.21.15.70:0/869364561 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fb138016470 con 0x7fb148101800 2024-04-26T20:18:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.550+0000 7fb13e7fc700 1 --2- 172.21.15.70:0/869364561 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb1340396b0 0x7fb13403bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.550+0000 7fb13e7fc700 1 -- 172.21.15.70:0/869364561 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb13801e070 con 0x7fb148101800 2024-04-26T20:18:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.550+0000 7fb14f77e700 1 -- 172.21.15.70:0/869364561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb148102c00 con 0x7fb148101800 2024-04-26T20:18:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.550+0000 7fb14cd19700 1 --2- 172.21.15.70:0/869364561 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb1340396b0 0x7fb13403bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:41.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.550+0000 7fb14cd19700 1 --2- 172.21.15.70:0/869364561 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb1340396b0 0x7fb13403bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb144006fd0 tx=0x7fb144006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:41.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.555+0000 7fb13e7fc700 1 -- 172.21.15.70:0/869364561 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb138020bb0 con 0x7fb148101800 2024-04-26T20:18:41.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.759+0000 7fb14f77e700 1 -- 172.21.15.70:0/869364561 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb148064a80 con 0x7fb1340396b0 2024-04-26T20:18:41.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.760+0000 7fb13e7fc700 1 -- 172.21.15.70:0/869364561 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7fb148064a80 con 0x7fb1340396b0 2024-04-26T20:18:41.761 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:18:41.761 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.80", "hostname": "smithi080", "labels": [], "status": ""}, {"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}] 2024-04-26T20:18:41.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.762+0000 7fb14f77e700 1 -- 172.21.15.70:0/869364561 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb1340396b0 msgr2=0x7fb13403bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:41.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.762+0000 7fb14f77e700 1 --2- 172.21.15.70:0/869364561 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb1340396b0 0x7fb13403bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb144006fd0 tx=0x7fb144006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:41.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.762+0000 7fb14f77e700 1 -- 172.21.15.70:0/869364561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb148101800 msgr2=0x7fb14819e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:41.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.762+0000 7fb14f77e700 1 --2- 172.21.15.70:0/869364561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb148101800 0x7fb14819e680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb138006010 tx=0x7fb138004d90 comp rx=0 tx=0).stop 2024-04-26T20:18:41.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.762+0000 7fb14f77e700 1 -- 172.21.15.70:0/869364561 shutdown_connections 2024-04-26T20:18:41.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.762+0000 7fb14f77e700 1 --2- 172.21.15.70:0/869364561 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb1340396b0 0x7fb13403bb70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:41.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.762+0000 7fb14f77e700 1 --2- 172.21.15.70:0/869364561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb148101800 0x7fb14819e680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:41.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.762+0000 7fb14f77e700 1 -- 172.21.15.70:0/869364561 >> 172.21.15.70:0/869364561 conn(0x7fb1480fcf90 msgr2=0x7fb1480fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:41.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.762+0000 7fb14f77e700 1 -- 172.21.15.70:0/869364561 shutdown_connections 2024-04-26T20:18:41.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:41.763+0000 7fb14f77e700 1 -- 172.21.15.70:0/869364561 wait complete. 2024-04-26T20:18:42.318 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-26T20:18:42.319 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-26T20:18:42.548 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:18:42.977 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:42 smithi070 ceph-mon[29124]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:42.977 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:42 smithi070 ceph-mon[29124]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:18:42.977 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:42 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.094+0000 7f6d762b6700 1 -- 172.21.15.70:0/4049349292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d701030c0 msgr2=0x7f6d701034a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.094+0000 7f6d762b6700 1 --2- 172.21.15.70:0/4049349292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d701030c0 0x7f6d701034a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009910 tx=0x7f6d60009c20 comp rx=0 tx=0).stop 2024-04-26T20:18:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.094+0000 7f6d762b6700 1 -- 172.21.15.70:0/4049349292 shutdown_connections 2024-04-26T20:18:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.094+0000 7f6d762b6700 1 --2- 172.21.15.70:0/4049349292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d701030c0 0x7f6d701034a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.094+0000 7f6d762b6700 1 -- 172.21.15.70:0/4049349292 >> 172.21.15.70:0/4049349292 conn(0x7f6d700fe950 msgr2=0x7f6d70100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.094+0000 7f6d762b6700 1 -- 172.21.15.70:0/4049349292 shutdown_connections 2024-04-26T20:18:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.094+0000 7f6d762b6700 1 -- 172.21.15.70:0/4049349292 wait complete. 2024-04-26T20:18:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.095+0000 7f6d762b6700 1 Processor -- start 2024-04-26T20:18:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.095+0000 7f6d762b6700 1 -- start start 2024-04-26T20:18:44.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.095+0000 7f6d762b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d701030c0 0x7f6d7019e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:44.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.095+0000 7f6d762b6700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7010d480 con 0x7f6d701030c0 2024-04-26T20:18:44.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.095+0000 7f6d6ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d701030c0 0x7f6d7019e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:44.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.095+0000 7f6d6ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d701030c0 0x7f6d7019e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49876/0 (socket says 172.21.15.70:49876) 2024-04-26T20:18:44.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.095+0000 7f6d6ffff700 1 -- 172.21.15.70:0/895601844 learned_addr learned my addr 172.21.15.70:0/895601844 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:18:44.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.096+0000 7f6d6ffff700 1 -- 172.21.15.70:0/895601844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7019eb50 con 0x7f6d701030c0 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.096+0000 7f6d6ffff700 1 --2- 172.21.15.70:0/895601844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d701030c0 0x7f6d7019e610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d60005780 tx=0x7f6d600057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.096+0000 7f6d6d7fa700 1 -- 172.21.15.70:0/895601844 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d60026070 con 0x7f6d701030c0 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.096+0000 7f6d762b6700 1 -- 172.21.15.70:0/895601844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d7019ee40 con 0x7f6d701030c0 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.096+0000 7f6d6d7fa700 1 -- 172.21.15.70:0/895601844 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6d60004370 con 0x7f6d701030c0 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.096+0000 7f6d6d7fa700 1 -- 172.21.15.70:0/895601844 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d60003a30 con 0x7f6d701030c0 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.096+0000 7f6d762b6700 1 -- 172.21.15.70:0/895601844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d701988b0 con 0x7f6d701030c0 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.097+0000 7f6d6d7fa700 1 -- 172.21.15.70:0/895601844 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f6d60029070 con 0x7f6d701030c0 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.097+0000 7f6d762b6700 1 -- 172.21.15.70:0/895601844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d701045a0 con 0x7f6d701030c0 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.097+0000 7f6d6d7fa700 1 --2- 172.21.15.70:0/895601844 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6d5c039650 0x7f6d5c03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.097+0000 7f6d6d7fa700 1 -- 172.21.15.70:0/895601844 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6d6001e070 con 0x7f6d701030c0 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.097+0000 7f6d6f7fe700 1 --2- 172.21.15.70:0/895601844 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6d5c039650 0x7f6d5c03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:44.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.098+0000 7f6d6f7fe700 1 --2- 172.21.15.70:0/895601844 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6d5c039650 0x7f6d5c03bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6d58006fd0 tx=0x7f6d58006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:44.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.102+0000 7f6d6d7fa700 1 -- 172.21.15.70:0/895601844 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f6d60013070 con 0x7f6d701030c0 2024-04-26T20:18:44.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.307+0000 7f6d762b6700 1 -- 172.21.15.70:0/895601844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f6d70199c10 con 0x7f6d701030c0 2024-04-26T20:18:44.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.757+0000 7f6d6d7fa700 1 -- 172.21.15.70:0/895601844 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f6d6000d340 con 0x7f6d701030c0 2024-04-26T20:18:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.759+0000 7f6d762b6700 1 -- 172.21.15.70:0/895601844 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6d5c039650 msgr2=0x7f6d5c03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.759+0000 7f6d762b6700 1 --2- 172.21.15.70:0/895601844 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6d5c039650 0x7f6d5c03bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6d58006fd0 tx=0x7f6d58006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.759+0000 7f6d762b6700 1 -- 172.21.15.70:0/895601844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d701030c0 msgr2=0x7f6d7019e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.759+0000 7f6d762b6700 1 --2- 172.21.15.70:0/895601844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d701030c0 0x7f6d7019e610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d60005780 tx=0x7f6d600057b0 comp rx=0 tx=0).stop 2024-04-26T20:18:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.759+0000 7f6d762b6700 1 -- 172.21.15.70:0/895601844 shutdown_connections 2024-04-26T20:18:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.759+0000 7f6d762b6700 1 --2- 172.21.15.70:0/895601844 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6d5c039650 0x7f6d5c03bb10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.759+0000 7f6d762b6700 1 --2- 172.21.15.70:0/895601844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d701030c0 0x7f6d7019e610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.759+0000 7f6d762b6700 1 -- 172.21.15.70:0/895601844 >> 172.21.15.70:0/895601844 conn(0x7f6d700fe950 msgr2=0x7f6d70104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.759+0000 7f6d762b6700 1 -- 172.21.15.70:0/895601844 shutdown_connections 2024-04-26T20:18:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:18:44.759+0000 7f6d762b6700 1 -- 172.21.15.70:0/895601844 wait complete. 2024-04-26T20:18:44.762 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-04-26T20:18:45.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:44 smithi070 ceph-mon[29124]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:45.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:44 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/895601844' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T20:18:45.423 INFO:tasks.cephadm:Adding mon.a on smithi070 2024-04-26T20:18:45.424 INFO:tasks.cephadm:Adding mon.b on smithi080 2024-04-26T20:18:45.424 INFO:tasks.cephadm:Adding mon.c on smithi098 2024-04-26T20:18:45.424 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi070:172.21.15.70=a;smithi080:172.21.15.80=b;smithi098:172.21.15.98=c' 2024-04-26T20:18:45.669 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:18:46.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:45 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/895601844' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T20:18:46.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:45 smithi070 ceph-mon[29124]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:18:46.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:45 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:46.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:45 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:46.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:45 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:46.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:45 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:46.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:45 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:46.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:45 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:46.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:45 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:47.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.117+0000 7fd675b57700 1 -- 172.21.15.98:0/2976686381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd670104070 msgr2=0x7fd670104450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:47.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.117+0000 7fd675b57700 1 --2- 172.21.15.98:0/2976686381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd670104070 0x7fd670104450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd660009910 tx=0x7fd660009c20 comp rx=0 tx=0).stop 2024-04-26T20:18:47.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.117+0000 7fd675b57700 1 -- 172.21.15.98:0/2976686381 shutdown_connections 2024-04-26T20:18:47.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.117+0000 7fd675b57700 1 --2- 172.21.15.98:0/2976686381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd670104070 0x7fd670104450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:47.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.117+0000 7fd675b57700 1 -- 172.21.15.98:0/2976686381 >> 172.21.15.98:0/2976686381 conn(0x7fd6700fd820 msgr2=0x7fd6700ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:47.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.117+0000 7fd675b57700 1 -- 172.21.15.98:0/2976686381 shutdown_connections 2024-04-26T20:18:47.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.117+0000 7fd675b57700 1 -- 172.21.15.98:0/2976686381 wait complete. 2024-04-26T20:18:47.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.118+0000 7fd675b57700 1 Processor -- start 2024-04-26T20:18:47.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.118+0000 7fd675b57700 1 -- start start 2024-04-26T20:18:47.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.118+0000 7fd675b57700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd670104070 0x7fd670101cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:47.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.118+0000 7fd675b57700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd67010d4b0 con 0x7fd670104070 2024-04-26T20:18:47.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.118+0000 7fd66f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd670104070 0x7fd670101cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:47.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.118+0000 7fd66f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd670104070 0x7fd670101cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.98:49668/0 (socket says 172.21.15.98:49668) 2024-04-26T20:18:47.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.118+0000 7fd66f7fe700 1 -- 172.21.15.98:0/3650368263 learned_addr learned my addr 172.21.15.98:0/3650368263 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-04-26T20:18:47.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.119+0000 7fd66f7fe700 1 -- 172.21.15.98:0/3650368263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd670103bc0 con 0x7fd670104070 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.119+0000 7fd66f7fe700 1 --2- 172.21.15.98:0/3650368263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd670104070 0x7fd670101cd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6600057a0 tx=0x7fd660005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.119+0000 7fd66cff9700 1 -- 172.21.15.98:0/3650368263 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd660026070 con 0x7fd670104070 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.119+0000 7fd675b57700 1 -- 172.21.15.98:0/3650368263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd670102210 con 0x7fd670104070 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.119+0000 7fd66cff9700 1 -- 172.21.15.98:0/3650368263 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd660004370 con 0x7fd670104070 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.119+0000 7fd66cff9700 1 -- 172.21.15.98:0/3650368263 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd660003b90 con 0x7fd670104070 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.119+0000 7fd675b57700 1 -- 172.21.15.98:0/3650368263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6701026d0 con 0x7fd670104070 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.120+0000 7fd675b57700 1 -- 172.21.15.98:0/3650368263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67006bb30 con 0x7fd670104070 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.120+0000 7fd66cff9700 1 -- 172.21.15.98:0/3650368263 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fd660029070 con 0x7fd670104070 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.120+0000 7fd66cff9700 1 --2- 172.21.15.98:0/3650368263 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd658039650 0x7fd65803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.120+0000 7fd66cff9700 1 -- 172.21.15.98:0/3650368263 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd66001e070 con 0x7fd670104070 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.120+0000 7fd66effd700 1 --2- 172.21.15.98:0/3650368263 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd658039650 0x7fd65803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:47.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.121+0000 7fd66effd700 1 --2- 172.21.15.98:0/3650368263 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd658039650 0x7fd65803bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd664006fd0 tx=0x7fd664006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:47.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.125+0000 7fd66cff9700 1 -- 172.21.15.98:0/3650368263 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd660013070 con 0x7fd670104070 2024-04-26T20:18:47.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:46 smithi070 ceph-mon[29124]: Updating smithi098:/etc/ceph/ceph.conf 2024-04-26T20:18:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:46 smithi070 ceph-mon[29124]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:18:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:46 smithi070 ceph-mon[29124]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:18:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:46 smithi070 ceph-mon[29124]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:18:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:46 smithi070 ceph-mon[29124]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:47.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.335+0000 7fd675b57700 1 -- 172.21.15.98:0/3650368263 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi080:172.21.15.80=b;smithi098:172.21.15.98=c", "target": ["mon-mgr", ""]}) -- 0x7fd6701032b0 con 0x7fd658039650 2024-04-26T20:18:47.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.342+0000 7fd66cff9700 1 -- 172.21.15.98:0/3650368263 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd66400a040 con 0x7fd658039650 2024-04-26T20:18:47.343 INFO:teuthology.orchestra.run.smithi098.stdout:Scheduled mon update... 2024-04-26T20:18:47.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.344+0000 7fd675b57700 1 -- 172.21.15.98:0/3650368263 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd658039650 msgr2=0x7fd65803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:47.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.344+0000 7fd675b57700 1 --2- 172.21.15.98:0/3650368263 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd658039650 0x7fd65803bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd664006fd0 tx=0x7fd664006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:47.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.344+0000 7fd675b57700 1 -- 172.21.15.98:0/3650368263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd670104070 msgr2=0x7fd670101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:47.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.344+0000 7fd675b57700 1 --2- 172.21.15.98:0/3650368263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd670104070 0x7fd670101cd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6600057a0 tx=0x7fd660005dc0 comp rx=0 tx=0).stop 2024-04-26T20:18:47.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.344+0000 7fd675b57700 1 -- 172.21.15.98:0/3650368263 shutdown_connections 2024-04-26T20:18:47.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.344+0000 7fd675b57700 1 --2- 172.21.15.98:0/3650368263 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd658039650 0x7fd65803bb10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:47.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.344+0000 7fd675b57700 1 --2- 172.21.15.98:0/3650368263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd670104070 0x7fd670101cd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:47.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.344+0000 7fd675b57700 1 -- 172.21.15.98:0/3650368263 >> 172.21.15.98:0/3650368263 conn(0x7fd6700fd820 msgr2=0x7fd670104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:47.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.344+0000 7fd675b57700 1 -- 172.21.15.98:0/3650368263 shutdown_connections 2024-04-26T20:18:47.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:47.344+0000 7fd675b57700 1 -- 172.21.15.98:0/3650368263 wait complete. 2024-04-26T20:18:47.886 DEBUG:teuthology.orchestra.run.smithi080:mon.b> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.b.service 2024-04-26T20:18:47.889 DEBUG:teuthology.orchestra.run.smithi098:mon.c> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.c.service 2024-04-26T20:18:47.891 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T20:18:47.891 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:18:48.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:48 smithi070 ceph-mon[29124]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi080:172.21.15.80=b;smithi098:172.21.15.98=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:48.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:48 smithi070 ceph-mon[29124]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi080:172.21.15.80=b;smithi098:172.21.15.98=c;count:3 2024-04-26T20:18:48.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:48.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:48.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:48.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:48.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:48.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:18:48.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:48.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:48 smithi070 ceph-mon[29124]: Deploying daemon mon.c on smithi098 2024-04-26T20:18:48.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:48 smithi070 ceph-mon[29124]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:48.924 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:18:51.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:50 smithi070 ceph-mon[29124]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:51.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.767+0000 7f31f12db700 1 -- 172.21.15.98:0/2571808277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec108ec0 msgr2=0x7f31ec1092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:51.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.767+0000 7f31f12db700 1 --2- 172.21.15.98:0/2571808277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec108ec0 0x7f31ec1092a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009910 tx=0x7f31dc009c20 comp rx=0 tx=0).stop 2024-04-26T20:18:51.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.767+0000 7f31f12db700 1 -- 172.21.15.98:0/2571808277 shutdown_connections 2024-04-26T20:18:51.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.767+0000 7f31f12db700 1 --2- 172.21.15.98:0/2571808277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec108ec0 0x7f31ec1092a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:51.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.767+0000 7f31f12db700 1 -- 172.21.15.98:0/2571808277 >> 172.21.15.98:0/2571808277 conn(0x7f31ec077880 msgr2=0x7f31ec077c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:51.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.767+0000 7f31f12db700 1 -- 172.21.15.98:0/2571808277 shutdown_connections 2024-04-26T20:18:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.767+0000 7f31f12db700 1 -- 172.21.15.98:0/2571808277 wait complete. 2024-04-26T20:18:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.767+0000 7f31f12db700 1 Processor -- start 2024-04-26T20:18:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.767+0000 7f31f12db700 1 -- start start 2024-04-26T20:18:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.768+0000 7f31f12db700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec108ec0 0x7f31ec19e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.768+0000 7f31f12db700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec10d440 con 0x7f31ec108ec0 2024-04-26T20:18:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.768+0000 7f31eaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec108ec0 0x7f31ec19e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.768+0000 7f31eaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec108ec0 0x7f31ec19e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.98:53884/0 (socket says 172.21.15.98:53884) 2024-04-26T20:18:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.768+0000 7f31eaffd700 1 -- 172.21.15.98:0/3220414368 learned_addr learned my addr 172.21.15.98:0/3220414368 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-04-26T20:18:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.768+0000 7f31eaffd700 1 -- 172.21.15.98:0/3220414368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec19ebe0 con 0x7f31ec108ec0 2024-04-26T20:18:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.768+0000 7f31eaffd700 1 --2- 172.21.15.98:0/3220414368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec108ec0 0x7f31ec19e6a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31dc005780 tx=0x7f31dc0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:51.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.768+0000 7f31d3fff700 1 -- 172.21.15.98:0/3220414368 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc026070 con 0x7f31ec108ec0 2024-04-26T20:18:51.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.769+0000 7f31d3fff700 1 -- 172.21.15.98:0/3220414368 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f31dc004370 con 0x7f31ec108ec0 2024-04-26T20:18:51.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.769+0000 7f31f12db700 1 -- 172.21.15.98:0/3220414368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ec19ee70 con 0x7f31ec108ec0 2024-04-26T20:18:51.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.769+0000 7f31d3fff700 1 -- 172.21.15.98:0/3220414368 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc003a30 con 0x7f31ec108ec0 2024-04-26T20:18:51.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.769+0000 7f31f12db700 1 -- 172.21.15.98:0/3220414368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ec198800 con 0x7f31ec108ec0 2024-04-26T20:18:51.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.769+0000 7f31d3fff700 1 -- 172.21.15.98:0/3220414368 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f31dc029070 con 0x7f31ec108ec0 2024-04-26T20:18:51.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.769+0000 7f31f12db700 1 -- 172.21.15.98:0/3220414368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ec104570 con 0x7f31ec108ec0 2024-04-26T20:18:51.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.770+0000 7f31d3fff700 1 --2- 172.21.15.98:0/3220414368 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f31d4039650 0x7f31d403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:51.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.770+0000 7f31d3fff700 1 -- 172.21.15.98:0/3220414368 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f31dc01e070 con 0x7f31ec108ec0 2024-04-26T20:18:51.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.770+0000 7f31ea7fc700 1 --2- 172.21.15.98:0/3220414368 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f31d4039650 0x7f31d403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:51.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.770+0000 7f31ea7fc700 1 --2- 172.21.15.98:0/3220414368 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f31d4039650 0x7f31d403bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f31e0006fd0 tx=0x7f31e0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:51.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:51.775+0000 7f31d3fff700 1 -- 172.21.15.98:0/3220414368 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f31dc013070 con 0x7f31ec108ec0 2024-04-26T20:18:51.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:51 smithi098 podman[32547]: 2024-04-26 20:18:51.876323038 +0000 UTC m=+0.362390245 container create fc5a964d39891b78083d5ba0e0ba046558d398a52d6535ced6e3f1d5dc317f4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:18:52.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.071+0000 7f31f12db700 1 -- 172.21.15.98:0/3220414368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f31ec064a80 con 0x7f31ec108ec0 2024-04-26T20:18:52.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.072+0000 7f31d3fff700 1 -- 172.21.15.98:0/3220414368 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f31dc030020 con 0x7f31ec108ec0 2024-04-26T20:18:52.074 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:18:52.074 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","modified":"2024-04-26T20:17:07.726728Z","created":"2024-04-26T20:17:07.726728Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:18:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.074+0000 7f31f12db700 1 -- 172.21.15.98:0/3220414368 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f31d4039650 msgr2=0x7f31d403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.074+0000 7f31f12db700 1 --2- 172.21.15.98:0/3220414368 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f31d4039650 0x7f31d403bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f31e0006fd0 tx=0x7f31e0006e40 comp rx=0 tx=0).stop 2024-04-26T20:18:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.074+0000 7f31f12db700 1 -- 172.21.15.98:0/3220414368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec108ec0 msgr2=0x7f31ec19e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.074+0000 7f31f12db700 1 --2- 172.21.15.98:0/3220414368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec108ec0 0x7f31ec19e6a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31dc005780 tx=0x7f31dc0057b0 comp rx=0 tx=0).stop 2024-04-26T20:18:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.075+0000 7f31f12db700 1 -- 172.21.15.98:0/3220414368 shutdown_connections 2024-04-26T20:18:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.075+0000 7f31f12db700 1 --2- 172.21.15.98:0/3220414368 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f31d4039650 0x7f31d403bb10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.075+0000 7f31f12db700 1 --2- 172.21.15.98:0/3220414368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31ec108ec0 0x7f31ec19e6a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.075+0000 7f31f12db700 1 -- 172.21.15.98:0/3220414368 >> 172.21.15.98:0/3220414368 conn(0x7f31ec077880 msgr2=0x7f31ec0ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.075+0000 7f31f12db700 1 -- 172.21.15.98:0/3220414368 shutdown_connections 2024-04-26T20:18:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:52.075+0000 7f31f12db700 1 -- 172.21.15.98:0/3220414368 wait complete. 2024-04-26T20:18:52.077 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-04-26T20:18:52.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 podman[32547]: 2024-04-26 20:18:52.08707329 +0000 UTC m=+0.573140506 container init fc5a964d39891b78083d5ba0e0ba046558d398a52d6535ced6e3f1d5dc317f4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-c, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-26T20:18:52.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 podman[32547]: 2024-04-26 20:18:52.090205453 +0000 UTC m=+0.576272664 container start fc5a964d39891b78083d5ba0e0ba046558d398a52d6535ced6e3f1d5dc317f4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T20:18:52.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T20:18:52.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev), process ceph-mon, pid 2 2024-04-26T20:18:52.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: pidfile_write: ignore empty --pid-file 2024-04-26T20:18:52.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: load: jerasure load: lrc 2024-04-26T20:18:52.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: RocksDB version: 7.9.2 2024-04-26T20:18:52.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Git sha 0 2024-04-26T20:18:52.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Compile date 2024-04-26 11:39:23 2024-04-26T20:18:52.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: DB SUMMARY 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: DB Session ID: YQNG6WORTRFPR4H4P77P 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: CURRENT file: CURRENT 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.error_if_exists: 0 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.create_if_missing: 0 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.paranoid_checks: 1 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.env: 0x556496647cc0 2024-04-26T20:18:52.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T20:18:52.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.info_log: 0x5564985c7d80 2024-04-26T20:18:52.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T20:18:52.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.statistics: (nil) 2024-04-26T20:18:52.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.use_fsync: 0 2024-04-26T20:18:52.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_log_file_size: 0 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.allow_fallocate: 1 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.use_direct_reads: 0 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.db_log_dir: 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.wal_dir: 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T20:18:52.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.write_buffer_manager: 0x5564985990e0 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T20:18:52.464 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.unordered_write: 0 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.row_cache: None 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.wal_filter: None 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.two_write_queues: 0 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.wal_compression: 0 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.atomic_flush: 0 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T20:18:52.465 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.log_readahead_size: 0 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_background_jobs: 2 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_background_compactions: -1 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_subcompactions: 1 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T20:18:52.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_open_files: -1 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_background_flushes: -1 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Compression algorithms supported: 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: kZSTD supported: 0 2024-04-26T20:18:52.467 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: kXpressCompression supported: 0 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: kZlibCompression supported: 1 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: kSnappyCompression supported: 1 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: kLZ4Compression supported: 1 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: kBZip2Compression supported: 0 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.merge_operator: 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_filter: None 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T20:18:52.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5564985c7f40) 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: cache_index_and_filter_blocks: 1 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: pin_top_level_index_and_filter: 1 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: index_type: 0 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: data_block_index_type: 0 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: index_shortening: 1 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: checksum: 4 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: no_block_cache: 0 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_cache: 0x5564985cb1f0 2024-04-26T20:18:52.469 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_cache_name: BinnedLRUCache 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_cache_options: 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: capacity : 536870912 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: num_shard_bits : 4 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: strict_capacity_limit : 0 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: high_pri_pool_ratio: 0.000 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_cache_compressed: (nil) 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: persistent_cache: (nil) 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_size: 4096 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_size_deviation: 10 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_restart_interval: 16 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: index_block_restart_interval: 1 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: metadata_block_size: 4096 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: partition_filters: 0 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: use_delta_encoding: 1 2024-04-26T20:18:52.470 INFO:journalctl@ceph.mon.c.smithi098.stdout: filter_policy: bloomfilter 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout: whole_key_filtering: 1 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout: verify_compression: 0 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout: read_amp_bytes_per_bit: 0 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout: format_version: 5 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout: enable_index_compression: 1 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_align: 0 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout: max_auto_readahead_size: 262144 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout: prepopulate_block_cache: 0 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout: initial_auto_readahead_size: 8192 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compression: NoCompression 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T20:18:52.471 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.num_levels: 7 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:18:52.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T20:18:52.473 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T20:18:52.474 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T20:18:52.474 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T20:18:52.474 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T20:18:52.474 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T20:18:52.474 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T20:18:52.474 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T20:18:52.474 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T20:18:52.474 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T20:18:52.474 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T20:18:52.474 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T20:18:52.475 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.inplace_update_support: 0 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.bloom_locality: 0 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.max_successive_merges: 0 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.ttl: 2592000 2024-04-26T20:18:52.476 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.enable_blob_files: false 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.min_blob_size: 0 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-26T20:18:52.477 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6f4598b8-8c16-4899-979b-a6b24c38938e 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162732121160, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162732121599, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714162732, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6f4598b8-8c16-4899-979b-a6b24c38938e", "db_session_id": "YQNG6WORTRFPR4H4P77P", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162732121676, "job": 1, "event": "recovery_finished"} 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5564986e8000 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: DB pointer 0x5564986d4000 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout: ** DB Stats ** 2024-04-26T20:18:52.478 INFO:journalctl@ceph.mon.c.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: ** Compaction Stats [default] ** 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:18:52.479 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: ** Compaction Stats [default] ** 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: Cumulative compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:18:52.480 INFO:journalctl@ceph.mon.c.smithi098.stdout: Interval compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout: Block cache BinnedLRUCache@0x5564985cb1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: using public_addr v2:172.21.15.98:0/0 -> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: starting mon.c rank -1 at public addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] at bind addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(???) e0 preinit fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).mds e1 new map 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout: e1 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T20:18:52.481 INFO:journalctl@ceph.mon.c.smithi098.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout: legacy client fscid: -1 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout: No filesystems configured 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.482 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi080", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Deploying cephadm binary to smithi098 2024-04-26T20:18:52.483 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Added host smithi098 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:18:52.484 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/895601844' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/895601844' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Updating smithi098:/etc/ceph/ceph.conf 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:18:52.485 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi080:172.21.15.80=b;smithi098:172.21.15.98=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi080:172.21.15.80=b;smithi098:172.21.15.98=c;count:3 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:52.486 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: Deploying daemon mon.c on smithi098 2024-04-26T20:18:52.487 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:52.487 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:52.487 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 ceph-mon[32591]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-26T20:18:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 bash[32547]: fc5a964d39891b78083d5ba0e0ba046558d398a52d6535ced6e3f1d5dc317f4f 2024-04-26T20:18:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:52 smithi098 systemd[1]: Started Ceph mon.c for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:18:53.750 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T20:18:53.750 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:18:53.984 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:18:57.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:18:57.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: mon.a calling monitor election 2024-04-26T20:18:57.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: mon.c calling monitor election 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: monmap epoch 2 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: last_changed 2024-04-26T20:18:52.147221+0000 2024-04-26T20:18:57.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: created 2024-04-26T20:17:07.726728+0000 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: min_mon_release 19 (squid) 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: election_strategy: 1 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: fsmap 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: mgrmap e13: x(active, since 49s) 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: overall HEALTH_OK 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:18:57.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:57.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:18:57.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: mon.a calling monitor election 2024-04-26T20:18:57.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:57.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: mon.c calling monitor election 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: monmap epoch 2 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: last_changed 2024-04-26T20:18:52.147221+0000 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: created 2024-04-26T20:17:07.726728+0000 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: min_mon_release 19 (squid) 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: election_strategy: 1 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-04-26T20:18:57.710 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-04-26T20:18:57.711 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: fsmap 2024-04-26T20:18:57.711 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:18:57.711 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: mgrmap e13: x(active, since 49s) 2024-04-26T20:18:57.711 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: overall HEALTH_OK 2024-04-26T20:18:57.711 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:57.711 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:57.711 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:18:57.711 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:18:57.711 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.502+0000 7f56fcdc8700 1 -- 172.21.15.98:0/2593474025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56e00035c0 msgr2=0x7f56e0005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.502+0000 7f56fcdc8700 1 --2- 172.21.15.98:0/2593474025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56e00035c0 0x7f56e0005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f56f806b710 tx=0x7f56e800feb0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.503+0000 7f56fcdc8700 1 -- 172.21.15.98:0/2593474025 shutdown_connections 2024-04-26T20:18:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.503+0000 7f56fcdc8700 1 --2- 172.21.15.98:0/2593474025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56e00035c0 0x7f56e0005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.503+0000 7f56fcdc8700 1 -- 172.21.15.98:0/2593474025 >> 172.21.15.98:0/2593474025 conn(0x7f56f80fd960 msgr2=0x7f56f80ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.503+0000 7f56fcdc8700 1 -- 172.21.15.98:0/2593474025 shutdown_connections 2024-04-26T20:18:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.503+0000 7f56fcdc8700 1 -- 172.21.15.98:0/2593474025 wait complete. 2024-04-26T20:18:58.505 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:58 smithi098 ceph-mon[32591]: Deploying daemon mon.b on smithi080 2024-04-26T20:18:58.505 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:58 smithi098 ceph-mon[32591]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:58.505 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:58.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.504+0000 7f56fcdc8700 1 Processor -- start 2024-04-26T20:18:58.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.504+0000 7f56fcdc8700 1 -- start start 2024-04-26T20:18:58.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.504+0000 7f56fcdc8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56e00035c0 0x7f56f819e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:58.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.504+0000 7f56fcdc8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56f819ec80 0x7f56f8198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:58.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.504+0000 7f56fcdc8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f56f810afd0 con 0x7f56e00035c0 2024-04-26T20:18:58.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.504+0000 7f56fcdc8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f56f810ae50 con 0x7f56f819ec80 2024-04-26T20:18:58.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f5d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56f819ec80 0x7f56f8198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:58.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f5d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56f819ec80 0x7f56f8198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58094/0 (socket says 172.21.15.98:58094) 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f5d9b700 1 -- 172.21.15.98:0/375572359 learned_addr learned my addr 172.21.15.98:0/375572359 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f659c700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56e00035c0 0x7f56f819e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f5d9b700 1 -- 172.21.15.98:0/375572359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56f819ec80 msgr2=0x7f56f8198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f5d9b700 1 -- 172.21.15.98:0/375572359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56f819ec80 msgr2=0x7f56f8198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f5d9b700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56f819ec80 0x7f56f8198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f5d9b700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56f819ec80 0x7f56f8198900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f659c700 1 -- 172.21.15.98:0/375572359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56f819ec80 msgr2=0x7f56f8198900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f659c700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56f819ec80 0x7f56f8198900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f659c700 1 -- 172.21.15.98:0/375572359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f819f2c0 con 0x7f56e00035c0 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56f659c700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56e00035c0 0x7f56f819e740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f56e8000c00 tx=0x7f56e8004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56e77fe700 1 -- 172.21.15.98:0/375572359 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f56e8005170 con 0x7f56e00035c0 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56e77fe700 1 -- 172.21.15.98:0/375572359 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f56e8004030 con 0x7f56e00035c0 2024-04-26T20:18:58.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.505+0000 7f56fcdc8700 1 -- 172.21.15.98:0/375572359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f8198e40 con 0x7f56e00035c0 2024-04-26T20:18:58.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.506+0000 7f56e77fe700 1 -- 172.21.15.98:0/375572359 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f56e8011c60 con 0x7f56e00035c0 2024-04-26T20:18:58.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.506+0000 7f56fcdc8700 1 -- 172.21.15.98:0/375572359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f81993d0 con 0x7f56e00035c0 2024-04-26T20:18:58.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.506+0000 7f56e77fe700 1 -- 172.21.15.98:0/375572359 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f56e8023070 con 0x7f56e00035c0 2024-04-26T20:18:58.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.507+0000 7f56fcdc8700 1 -- 172.21.15.98:0/375572359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f806bf10 con 0x7f56e00035c0 2024-04-26T20:18:58.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.507+0000 7f56e77fe700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56d8039440 0x7f56d803b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:58.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.507+0000 7f56e77fe700 1 -- 172.21.15.98:0/375572359 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f56e8020050 con 0x7f56e00035c0 2024-04-26T20:18:58.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.507+0000 7f56f5d9b700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56d8039440 0x7f56d803b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:58.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.508+0000 7f56f5d9b700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56d8039440 0x7f56d803b900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009180 tx=0x7f56ec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:58.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.513+0000 7f56e77fe700 1 -- 172.21.15.98:0/375572359 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f56e8028020 con 0x7f56e00035c0 2024-04-26T20:18:58.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:58 smithi070 ceph-mon[29124]: Deploying daemon mon.b on smithi080 2024-04-26T20:18:58.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:58 smithi070 ceph-mon[29124]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:18:58.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:18:58.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.793+0000 7f56fcdc8700 1 -- 172.21.15.98:0/375572359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f56f8199e30 con 0x7f56e00035c0 2024-04-26T20:18:58.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.793+0000 7f56e77fe700 1 -- 172.21.15.98:0/375572359 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f56e8011e00 con 0x7f56e00035c0 2024-04-26T20:18:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:18:58.795 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":2,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","modified":"2024-04-26T20:18:52.147221Z","created":"2024-04-26T20:17:07.726728Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T20:18:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.795+0000 7f56fcdc8700 1 -- 172.21.15.98:0/375572359 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56d8039440 msgr2=0x7f56d803b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.795+0000 7f56fcdc8700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56d8039440 0x7f56d803b900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009180 tx=0x7f56ec008040 comp rx=0 tx=0).stop 2024-04-26T20:18:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.795+0000 7f56fcdc8700 1 -- 172.21.15.98:0/375572359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56e00035c0 msgr2=0x7f56f819e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.795+0000 7f56fcdc8700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56e00035c0 0x7f56f819e740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f56e8000c00 tx=0x7f56e8004f60 comp rx=0 tx=0).stop 2024-04-26T20:18:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.796+0000 7f56fcdc8700 1 -- 172.21.15.98:0/375572359 shutdown_connections 2024-04-26T20:18:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.796+0000 7f56fcdc8700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56d8039440 0x7f56d803b900 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.796+0000 7f56fcdc8700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56e00035c0 0x7f56f819e740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.796+0000 7f56fcdc8700 1 --2- 172.21.15.98:0/375572359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56f819ec80 0x7f56f8198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.796+0000 7f56fcdc8700 1 -- 172.21.15.98:0/375572359 >> 172.21.15.98:0/375572359 conn(0x7f56f80fd960 msgr2=0x7f56f80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.796+0000 7f56fcdc8700 1 -- 172.21.15.98:0/375572359 shutdown_connections 2024-04-26T20:18:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:18:58.796+0000 7f56fcdc8700 1 -- 172.21.15.98:0/375572359 wait complete. 2024-04-26T20:18:58.798 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 2 2024-04-26T20:18:59.398 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:18:59 smithi098 ceph-mon[32591]: from='client.? 172.21.15.98:0/375572359' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:18:59.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:18:59 smithi070 ceph-mon[29124]: from='client.? 172.21.15.98:0/375572359' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:19:00.430 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T20:19:00.431 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:19:00.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:00 smithi070 ceph-mon[29124]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:00.682 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:19:00.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:00 smithi098 ceph-mon[32591]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.104 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: load: jerasure load: lrc 2024-04-26T20:19:01.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: RocksDB version: 7.9.2 2024-04-26T20:19:01.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Git sha 0 2024-04-26T20:19:01.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Compile date 2024-04-26 11:39:23 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: DB SUMMARY 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: DB Session ID: G80EMV2HL7ECV789ORX8 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: CURRENT file: CURRENT 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.error_if_exists: 0 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.create_if_missing: 0 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.paranoid_checks: 1 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T20:19:01.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.env: 0x55c2b4f66cc0 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.info_log: 0x55c2b5cbbd80 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.statistics: (nil) 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.use_fsync: 0 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_log_file_size: 0 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.allow_fallocate: 1 2024-04-26T20:19:01.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.use_direct_reads: 0 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.db_log_dir: 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.wal_dir: 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T20:19:01.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.write_buffer_manager: 0x55c2b5c8d0e0 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.unordered_write: 0 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T20:19:01.474 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.row_cache: None 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.wal_filter: None 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.two_write_queues: 0 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.wal_compression: 0 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.atomic_flush: 0 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T20:19:01.475 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.log_readahead_size: 0 2024-04-26T20:19:01.476 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T20:19:01.476 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T20:19:01.476 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T20:19:01.476 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T20:19:01.476 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T20:19:01.476 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T20:19:01.476 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T20:19:01.476 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_background_jobs: 2 2024-04-26T20:19:01.476 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_background_compactions: -1 2024-04-26T20:19:01.476 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_subcompactions: 1 2024-04-26T20:19:01.476 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T20:19:01.478 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T20:19:01.478 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T20:19:01.478 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T20:19:01.478 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T20:19:01.478 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T20:19:01.478 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T20:19:01.478 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T20:19:01.478 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_open_files: -1 2024-04-26T20:19:01.478 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T20:19:01.479 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T20:19:01.479 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T20:19:01.479 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T20:19:01.479 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_background_flushes: -1 2024-04-26T20:19:01.479 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Compression algorithms supported: 2024-04-26T20:19:01.479 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T20:19:01.479 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: kZSTD supported: 0 2024-04-26T20:19:01.479 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: kXpressCompression supported: 0 2024-04-26T20:19:01.479 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T20:19:01.479 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: kZlibCompression supported: 1 2024-04-26T20:19:01.479 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: kSnappyCompression supported: 1 2024-04-26T20:19:01.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: kLZ4Compression supported: 1 2024-04-26T20:19:01.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: kBZip2Compression supported: 0 2024-04-26T20:19:01.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T20:19:01.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T20:19:01.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-04-26T20:19:01.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T20:19:01.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T20:19:01.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.merge_operator: 2024-04-26T20:19:01.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_filter: None 2024-04-26T20:19:01.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T20:19:01.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c2b5cbbf40) 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout: cache_index_and_filter_blocks: 1 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout: pin_top_level_index_and_filter: 1 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout: index_type: 0 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout: data_block_index_type: 0 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout: index_shortening: 1 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout: checksum: 4 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout: no_block_cache: 0 2024-04-26T20:19:01.481 INFO:journalctl@ceph.mon.b.smithi080.stdout: block_cache: 0x55c2b5cbf1f0 2024-04-26T20:19:01.482 INFO:journalctl@ceph.mon.b.smithi080.stdout: block_cache_name: BinnedLRUCache 2024-04-26T20:19:01.482 INFO:journalctl@ceph.mon.b.smithi080.stdout: block_cache_options: 2024-04-26T20:19:01.482 INFO:journalctl@ceph.mon.b.smithi080.stdout: capacity : 536870912 2024-04-26T20:19:01.482 INFO:journalctl@ceph.mon.b.smithi080.stdout: num_shard_bits : 4 2024-04-26T20:19:01.482 INFO:journalctl@ceph.mon.b.smithi080.stdout: strict_capacity_limit : 0 2024-04-26T20:19:01.482 INFO:journalctl@ceph.mon.b.smithi080.stdout: high_pri_pool_ratio: 0.000 2024-04-26T20:19:01.482 INFO:journalctl@ceph.mon.b.smithi080.stdout: block_cache_compressed: (nil) 2024-04-26T20:19:01.482 INFO:journalctl@ceph.mon.b.smithi080.stdout: persistent_cache: (nil) 2024-04-26T20:19:01.482 INFO:journalctl@ceph.mon.b.smithi080.stdout: block_size: 4096 2024-04-26T20:19:01.482 INFO:journalctl@ceph.mon.b.smithi080.stdout: block_size_deviation: 10 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: block_restart_interval: 16 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: index_block_restart_interval: 1 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: metadata_block_size: 4096 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: partition_filters: 0 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: use_delta_encoding: 1 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: filter_policy: bloomfilter 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: whole_key_filtering: 1 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: verify_compression: 0 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: read_amp_bytes_per_bit: 0 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: format_version: 5 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: enable_index_compression: 1 2024-04-26T20:19:01.483 INFO:journalctl@ceph.mon.b.smithi080.stdout: block_align: 0 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout: max_auto_readahead_size: 262144 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout: prepopulate_block_cache: 0 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout: initial_auto_readahead_size: 8192 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compression: NoCompression 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.num_levels: 7 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T20:19:01.484 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T20:19:01.485 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T20:19:01.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T20:19:01.487 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T20:19:01.488 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.inplace_update_support: 0 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.bloom_locality: 0 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.max_successive_merges: 0 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.ttl: 2592000 2024-04-26T20:19:01.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.enable_blob_files: false 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.min_blob_size: 0 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T20:19:01.490 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e4c22063-a2ec-4b4e-8436-89df6124b682 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162741116824, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162741117222, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714162741, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e4c22063-a2ec-4b4e-8436-89df6124b682", "db_session_id": "G80EMV2HL7ECV789ORX8", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162741117298, "job": 1, "event": "recovery_finished"} 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c2b5ddc000 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: DB pointer 0x55c2b5dc8000 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T20:19:01.491 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: ** DB Stats ** 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: ** Compaction Stats [default] ** 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:19:01.492 INFO:journalctl@ceph.mon.b.smithi080.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T20:19:01.493 INFO:journalctl@ceph.mon.b.smithi080.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:19:01.493 INFO:journalctl@ceph.mon.b.smithi080.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:19:01.493 INFO:journalctl@ceph.mon.b.smithi080.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:19:01.493 INFO:journalctl@ceph.mon.b.smithi080.stdout: 2024-04-26T20:19:01.493 INFO:journalctl@ceph.mon.b.smithi080.stdout: ** Compaction Stats [default] ** 2024-04-26T20:19:01.493 INFO:journalctl@ceph.mon.b.smithi080.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:19:01.493 INFO:journalctl@ceph.mon.b.smithi080.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T20:19:01.493 INFO:journalctl@ceph.mon.b.smithi080.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:19:01.493 INFO:journalctl@ceph.mon.b.smithi080.stdout: 2024-04-26T20:19:01.493 INFO:journalctl@ceph.mon.b.smithi080.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T20:19:01.494 INFO:journalctl@ceph.mon.b.smithi080.stdout: 2024-04-26T20:19:01.494 INFO:journalctl@ceph.mon.b.smithi080.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:19:01.494 INFO:journalctl@ceph.mon.b.smithi080.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T20:19:01.494 INFO:journalctl@ceph.mon.b.smithi080.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T20:19:01.494 INFO:journalctl@ceph.mon.b.smithi080.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T20:19:01.494 INFO:journalctl@ceph.mon.b.smithi080.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T20:19:01.494 INFO:journalctl@ceph.mon.b.smithi080.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T20:19:01.494 INFO:journalctl@ceph.mon.b.smithi080.stdout: Cumulative compaction: 0.00 GB write, 0.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:19:01.494 INFO:journalctl@ceph.mon.b.smithi080.stdout: Interval compaction: 0.00 GB write, 0.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:19:01.494 INFO:journalctl@ceph.mon.b.smithi080.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T20:19:01.494 INFO:journalctl@ceph.mon.b.smithi080.stdout: Block cache BinnedLRUCache@0x55c2b5cbf1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-26T20:19:01.496 INFO:journalctl@ceph.mon.b.smithi080.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-26T20:19:01.496 INFO:journalctl@ceph.mon.b.smithi080.stdout: 2024-04-26T20:19:01.496 INFO:journalctl@ceph.mon.b.smithi080.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T20:19:01.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-04-26T20:19:01.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: using public_addr v2:172.21.15.80:0/0 -> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] 2024-04-26T20:19:01.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: starting mon.b rank -1 at public addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] at bind addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:19:01.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(???) e0 preinit fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:19:01.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).mds e1 new map 2024-04-26T20:19:01.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).mds e1 print_map 2024-04-26T20:19:01.496 INFO:journalctl@ceph.mon.b.smithi080.stdout: e1 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout: legacy client fscid: -1 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout: 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout: No filesystems configured 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T20:19:01.497 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi080", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:01.498 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Deploying cephadm binary to smithi098 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Added host smithi098 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.499 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/895601844' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/895601844' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:01.500 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Updating smithi098:/etc/ceph/ceph.conf 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi080:172.21.15.80=b;smithi098:172.21.15.98=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi080:172.21.15.80=b;smithi098:172.21.15.98=c;count:3 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:01.501 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Deploying daemon mon.c on smithi098 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.a calling monitor election 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:19:01.502 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.c calling monitor election 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: monmap epoch 2 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: last_changed 2024-04-26T20:18:52.147221+0000 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: created 2024-04-26T20:17:07.726728+0000 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: min_mon_release 19 (squid) 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: election_strategy: 1 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: fsmap 2024-04-26T20:19:01.503 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mgrmap e13: x(active, since 49s) 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: overall HEALTH_OK 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: Deploying daemon mon.b on smithi080 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: from='client.? 172.21.15.98:0/375572359' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 ceph-mon[32278]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-26T20:19:01.504 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 bash[32259]: 370a2df9f6d978e9fcd7e4e7f988724ca83800935b1d2d4595c68cb27ee58e66 2024-04-26T20:19:01.505 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:01 smithi080 systemd[1]: Started Ceph mon.b for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:19:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:19:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: mon.a calling monitor election 2024-04-26T20:19:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: mon.c calling monitor election 2024-04-26T20:19:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:19:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: monmap epoch 3 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: last_changed 2024-04-26T20:19:01.139520+0000 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: created 2024-04-26T20:17:07.726728+0000 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: min_mon_release 19 (squid) 2024-04-26T20:19:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: election_strategy: 1 2024-04-26T20:19:06.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-04-26T20:19:06.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-04-26T20:19:06.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: 2: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.b 2024-04-26T20:19:06.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: fsmap 2024-04-26T20:19:06.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:19:06.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: mgrmap e13: x(active, since 58s) 2024-04-26T20:19:06.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: overall HEALTH_OK 2024-04-26T20:19:06.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:06.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:06.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:06.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:06.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.515+0000 7fcdedb80700 1 -- 172.21.15.98:0/2809501760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd40035c0 msgr2=0x7fcdd4005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:06.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.515+0000 7fcdedb80700 1 --2- 172.21.15.98:0/2809501760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd40035c0 0x7fcdd4005a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcde8102e70 tx=0x7fcdd000fe60 comp rx=0 tx=0).stop 2024-04-26T20:19:06.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.515+0000 7fcdedb80700 1 -- 172.21.15.98:0/2809501760 shutdown_connections 2024-04-26T20:19:06.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.515+0000 7fcdedb80700 1 --2- 172.21.15.98:0/2809501760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd40035c0 0x7fcdd4005a50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.515+0000 7fcdedb80700 1 -- 172.21.15.98:0/2809501760 >> 172.21.15.98:0/2809501760 conn(0x7fcde80fea30 msgr2=0x7fcde8100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:06.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.515+0000 7fcdedb80700 1 -- 172.21.15.98:0/2809501760 shutdown_connections 2024-04-26T20:19:06.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.515+0000 7fcdedb80700 1 -- 172.21.15.98:0/2809501760 wait complete. 2024-04-26T20:19:06.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcdedb80700 1 Processor -- start 2024-04-26T20:19:06.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcdedb80700 1 -- start start 2024-04-26T20:19:06.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcdedb80700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd40035c0 0x7fcde8075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:06.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcdedb80700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde8075c60 0x7fcde80760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:06.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcdedb80700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcde81a4d70 0x7fcde81a7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcdedb80700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcde810af70 con 0x7fcdd40035c0 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcdedb80700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcde810adf0 con 0x7fcde8075c60 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcdedb80700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcde810b0f0 con 0x7fcde81a4d70 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcde81a4d70 0x7fcde81a7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcde81a4d70 0x7fcde81a7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40868/0 (socket says 172.21.15.98:40868) 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcde7fff700 1 -- 172.21.15.98:0/1036435236 learned_addr learned my addr 172.21.15.98:0/1036435236 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcde7fff700 1 -- 172.21.15.98:0/1036435236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcde81a4d70 msgr2=0x7fcde81a7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcde7fff700 1 -- 172.21.15.98:0/1036435236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcde81a4d70 msgr2=0x7fcde81a7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcde7fff700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcde81a4d70 0x7fcde81a7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.516+0000 7fcde77fe700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd40035c0 0x7fcde8075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde7fff700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcde81a4d70 0x7fcde81a7160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde6ffd700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde8075c60 0x7fcde80760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:06.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde6ffd700 1 -- 172.21.15.98:0/1036435236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde8075c60 msgr2=0x7fcde80760e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde6ffd700 1 -- 172.21.15.98:0/1036435236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde8075c60 msgr2=0x7fcde80760e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde6ffd700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde8075c60 0x7fcde80760e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde6ffd700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde8075c60 0x7fcde80760e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde77fe700 1 -- 172.21.15.98:0/1036435236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcde81a4d70 msgr2=0x7fcde81a7160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde77fe700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcde81a4d70 0x7fcde81a7160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde77fe700 1 -- 172.21.15.98:0/1036435236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde8075c60 msgr2=0x7fcde80760e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde77fe700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde8075c60 0x7fcde80760e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde77fe700 1 -- 172.21.15.98:0/1036435236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde81a7890 con 0x7fcdd40035c0 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde77fe700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd40035c0 0x7fcde8075720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcdd001f000 tx=0x7fcdd00056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde4ff9700 1 -- 172.21.15.98:0/1036435236 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd002b020 con 0x7fcdd40035c0 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde4ff9700 1 -- 172.21.15.98:0/1036435236 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcdd0014540 con 0x7fcdd40035c0 2024-04-26T20:19:06.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcde4ff9700 1 -- 172.21.15.98:0/1036435236 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0022040 con 0x7fcdd40035c0 2024-04-26T20:19:06.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.517+0000 7fcdedb80700 1 -- 172.21.15.98:0/1036435236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde81a7b20 con 0x7fcdd40035c0 2024-04-26T20:19:06.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.518+0000 7fcdedb80700 1 -- 172.21.15.98:0/1036435236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde81a8010 con 0x7fcdd40035c0 2024-04-26T20:19:06.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.518+0000 7fcde4ff9700 1 -- 172.21.15.98:0/1036435236 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fcdd002e020 con 0x7fcdd40035c0 2024-04-26T20:19:06.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.519+0000 7fcde4ff9700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcdc8039ae0 0x7fcdc803bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:06.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.519+0000 7fcde4ff9700 1 -- 172.21.15.98:0/1036435236 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcdd004f440 con 0x7fcdd40035c0 2024-04-26T20:19:06.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.519+0000 7fcde6ffd700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcdc8039ae0 0x7fcdc803bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:06.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.519+0000 7fcdedb80700 1 -- 172.21.15.98:0/1036435236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde8064a80 con 0x7fcdd40035c0 2024-04-26T20:19:06.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.519+0000 7fcde6ffd700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcdc8039ae0 0x7fcdc803bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009850 tx=0x7fcdd8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:06.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.524+0000 7fcde4ff9700 1 -- 172.21.15.98:0/1036435236 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fcdd0035020 con 0x7fcdd40035c0 2024-04-26T20:19:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:19:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: mon.a calling monitor election 2024-04-26T20:19:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: mon.c calling monitor election 2024-04-26T20:19:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:19:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: monmap epoch 3 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: last_changed 2024-04-26T20:19:01.139520+0000 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: created 2024-04-26T20:17:07.726728+0000 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: min_mon_release 19 (squid) 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: election_strategy: 1 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: 2: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.b 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: fsmap 2024-04-26T20:19:06.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:19:06.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: mgrmap e13: x(active, since 58s) 2024-04-26T20:19:06.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: overall HEALTH_OK 2024-04-26T20:19:06.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:06.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:06.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:06.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:06.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.823+0000 7fcdedb80700 1 -- 172.21.15.98:0/1036435236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fcde802e490 con 0x7fcdd40035c0 2024-04-26T20:19:06.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.824+0000 7fcde4ff9700 1 -- 172.21.15.98:0/1036435236 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7fcdd0012b50 con 0x7fcdd40035c0 2024-04-26T20:19:06.825 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T20:19:06.826 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":3,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","modified":"2024-04-26T20:19:01.139520Z","created":"2024-04-26T20:17:07.726728Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T20:19:06.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.826+0000 7fcdedb80700 1 -- 172.21.15.98:0/1036435236 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcdc8039ae0 msgr2=0x7fcdc803bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:06.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.826+0000 7fcdedb80700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcdc8039ae0 0x7fcdc803bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009850 tx=0x7fcdd8008040 comp rx=0 tx=0).stop 2024-04-26T20:19:06.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.826+0000 7fcdedb80700 1 -- 172.21.15.98:0/1036435236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd40035c0 msgr2=0x7fcde8075720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:06.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.826+0000 7fcdedb80700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd40035c0 0x7fcde8075720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcdd001f000 tx=0x7fcdd00056c0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.827+0000 7fcdedb80700 1 -- 172.21.15.98:0/1036435236 shutdown_connections 2024-04-26T20:19:06.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.827+0000 7fcdedb80700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcdc8039ae0 0x7fcdc803bfa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.827+0000 7fcdedb80700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcde81a4d70 0x7fcde81a7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.827+0000 7fcdedb80700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd40035c0 0x7fcde8075720 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.827+0000 7fcdedb80700 1 --2- 172.21.15.98:0/1036435236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde8075c60 0x7fcde80760e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.827+0000 7fcdedb80700 1 -- 172.21.15.98:0/1036435236 >> 172.21.15.98:0/1036435236 conn(0x7fcde80fea30 msgr2=0x7fcde80ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:06.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.827+0000 7fcdedb80700 1 -- 172.21.15.98:0/1036435236 shutdown_connections 2024-04-26T20:19:06.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:06.827+0000 7fcdedb80700 1 -- 172.21.15.98:0/1036435236 wait complete. 2024-04-26T20:19:06.829 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 3 2024-04-26T20:19:07.356 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-26T20:19:07.356 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-26T20:19:07.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:07.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:07 smithi098 ceph-mon[32591]: from='client.? 172.21.15.98:0/1036435236' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:19:07.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:07.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:07.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:07 smithi070 ceph-mon[29124]: from='client.? 172.21.15.98:0/1036435236' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:19:07.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:07.616 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:19:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:19:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: mon.a calling monitor election 2024-04-26T20:19:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: mon.c calling monitor election 2024-04-26T20:19:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:19:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: monmap epoch 3 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: last_changed 2024-04-26T20:19:01.139520+0000 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: created 2024-04-26T20:17:07.726728+0000 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: min_mon_release 19 (squid) 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: election_strategy: 1 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: 2: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.b 2024-04-26T20:19:08.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: fsmap 2024-04-26T20:19:08.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:19:08.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: mgrmap e13: x(active, since 58s) 2024-04-26T20:19:08.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: overall HEALTH_OK 2024-04-26T20:19:08.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:08.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:08.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:08.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:08.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:08.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='client.? 172.21.15.98:0/1036435236' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:19:08.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:09.369 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: mon.b calling monitor election 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: Updating smithi070:/etc/ceph/ceph.conf 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: Updating smithi098:/etc/ceph/ceph.conf 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: mon.b calling monitor election 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: mon.c calling monitor election 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: mon.a calling monitor election 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: monmap epoch 3 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: last_changed 2024-04-26T20:19:01.139520+0000 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: created 2024-04-26T20:17:07.726728+0000 2024-04-26T20:19:09.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: min_mon_release 19 (squid) 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: election_strategy: 1 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: 2: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.b 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: fsmap 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: mgrmap e13: x(active, since 60s) 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: overall HEALTH_OK 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: Updating smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T20:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:09 smithi070 ceph-mon[29124]: Reconfiguring daemon mon.a on smithi070 2024-04-26T20:19:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.394+0000 7f7490a69700 1 -- 172.21.15.70:0/376036898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c101f70 msgr2=0x7f748c102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.394+0000 7f7490a69700 1 --2- 172.21.15.70:0/376036898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c101f70 0x7f748c102350 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f747c009910 tx=0x7f747c009c20 comp rx=0 tx=0).stop 2024-04-26T20:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.395+0000 7f7490a69700 1 -- 172.21.15.70:0/376036898 shutdown_connections 2024-04-26T20:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.395+0000 7f7490a69700 1 --2- 172.21.15.70:0/376036898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c101f70 0x7f748c102350 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.395+0000 7f7490a69700 1 -- 172.21.15.70:0/376036898 >> 172.21.15.70:0/376036898 conn(0x7f748c0fd820 msgr2=0x7f748c0ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.395+0000 7f7490a69700 1 -- 172.21.15.70:0/376036898 shutdown_connections 2024-04-26T20:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.395+0000 7f7490a69700 1 -- 172.21.15.70:0/376036898 wait complete. 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7490a69700 1 Processor -- start 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7490a69700 1 -- start start 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7490a69700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f748c101f70 0x7f748c1999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7490a69700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c199ef0 0x7f748c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7490a69700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c1a2a20 0x7f748c1a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7490a69700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f748c10c2f0 con 0x7f748c199ef0 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7490a69700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f748c10c170 con 0x7f748c101f70 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7490a69700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f748c10c470 con 0x7f748c1a2a20 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7489d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c199ef0 0x7f748c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7489d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c199ef0 0x7f748c19a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40198/0 (socket says 172.21.15.70:40198) 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7489d9b700 1 -- 172.21.15.70:0/530358003 learned_addr learned my addr 172.21.15.70:0/530358003 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f748a59c700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f748c101f70 0x7f748c1999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f748ad9d700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c1a2a20 0x7f748c1a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7489d9b700 1 -- 172.21.15.70:0/530358003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c1a2a20 msgr2=0x7f748c1a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7489d9b700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c1a2a20 0x7f748c1a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7489d9b700 1 -- 172.21.15.70:0/530358003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f748c101f70 msgr2=0x7f748c1999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7489d9b700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f748c101f70 0x7f748c1999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f7489d9b700 1 -- 172.21.15.70:0/530358003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c1a5680 con 0x7f748c199ef0 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.396+0000 7f748ad9d700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c1a2a20 0x7f748c1a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.397+0000 7f7489d9b700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c199ef0 0x7f748c19a370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f748000b780 tx=0x7f748000ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.397+0000 7f747b7fe700 1 -- 172.21.15.70:0/530358003 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480004230 con 0x7f748c199ef0 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.397+0000 7f747b7fe700 1 -- 172.21.15.70:0/530358003 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f74800043d0 con 0x7f748c199ef0 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.397+0000 7f7490a69700 1 -- 172.21.15.70:0/530358003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748c1a5970 con 0x7f748c199ef0 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.397+0000 7f747b7fe700 1 -- 172.21.15.70:0/530358003 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480011c20 con 0x7f748c199ef0 2024-04-26T20:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.397+0000 7f7490a69700 1 -- 172.21.15.70:0/530358003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f748c1a5eb0 con 0x7f748c199ef0 2024-04-26T20:19:09.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.398+0000 7f747b7fe700 1 -- 172.21.15.70:0/530358003 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f748001a400 con 0x7f748c199ef0 2024-04-26T20:19:09.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.398+0000 7f7490a69700 1 -- 172.21.15.70:0/530358003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f748c064a80 con 0x7f748c199ef0 2024-04-26T20:19:09.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.398+0000 7f747b7fe700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7474039ae0 0x7f747403bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:09.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.398+0000 7f747b7fe700 1 -- 172.21.15.70:0/530358003 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f748004c3b0 con 0x7f748c199ef0 2024-04-26T20:19:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.398+0000 7f748a59c700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7474039ae0 0x7f747403bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.399+0000 7f748a59c700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7474039ae0 0x7f747403bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f747c009750 tx=0x7f747c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:09.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.403+0000 7f747b7fe700 1 -- 172.21.15.70:0/530358003 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7480020500 con 0x7f748c199ef0 2024-04-26T20:19:09.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: mon.b calling monitor election 2024-04-26T20:19:09.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: Updating smithi070:/etc/ceph/ceph.conf 2024-04-26T20:19:09.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T20:19:09.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: Updating smithi098:/etc/ceph/ceph.conf 2024-04-26T20:19:09.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: mon.b calling monitor election 2024-04-26T20:19:09.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: mon.c calling monitor election 2024-04-26T20:19:09.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: mon.a calling monitor election 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: monmap epoch 3 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: last_changed 2024-04-26T20:19:01.139520+0000 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: created 2024-04-26T20:17:07.726728+0000 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: min_mon_release 19 (squid) 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: election_strategy: 1 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: 2: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.b 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: fsmap 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:19:09.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: mgrmap e13: x(active, since 60s) 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: overall HEALTH_OK 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: Updating smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.461 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T20:19:09.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:19:09.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:19:09.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:09.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:09 smithi098 ceph-mon[32591]: Reconfiguring daemon mon.a on smithi070 2024-04-26T20:19:09.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: mon.b calling monitor election 2024-04-26T20:19:09.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: Updating smithi070:/etc/ceph/ceph.conf 2024-04-26T20:19:09.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T20:19:09.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: Updating smithi098:/etc/ceph/ceph.conf 2024-04-26T20:19:09.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: mon.b calling monitor election 2024-04-26T20:19:09.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: mon.c calling monitor election 2024-04-26T20:19:09.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: mon.a calling monitor election 2024-04-26T20:19:09.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T20:19:09.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: monmap epoch 3 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: last_changed 2024-04-26T20:19:01.139520+0000 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: created 2024-04-26T20:17:07.726728+0000 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: min_mon_release 19 (squid) 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: election_strategy: 1 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: 2: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.b 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: fsmap 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: mgrmap e13: x(active, since 60s) 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: overall HEALTH_OK 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: Updating smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:19:09.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:19:09.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:19:09.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:09.473 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:09 smithi080 ceph-mon[32278]: Reconfiguring daemon mon.a on smithi070 2024-04-26T20:19:09.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.618+0000 7f7490a69700 1 -- 172.21.15.70:0/530358003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f748c1a6240 con 0x7f748c199ef0 2024-04-26T20:19:09.620 INFO:teuthology.orchestra.run.smithi070.stdout:# minimal ceph.conf for cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:19:09.620 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-04-26T20:19:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:19:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: mon_host = [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-04-26T20:19:09.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.619+0000 7f747b7fe700 1 -- 172.21.15.70:0/530358003 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7f74800202a0 con 0x7f748c199ef0 2024-04-26T20:19:09.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 -- 172.21.15.70:0/530358003 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7474039ae0 msgr2=0x7f747403bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:09.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7474039ae0 0x7f747403bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f747c009750 tx=0x7f747c00b540 comp rx=0 tx=0).stop 2024-04-26T20:19:09.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 -- 172.21.15.70:0/530358003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c199ef0 msgr2=0x7f748c19a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:09.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c199ef0 0x7f748c19a370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f748000b780 tx=0x7f748000ba90 comp rx=0 tx=0).stop 2024-04-26T20:19:09.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 -- 172.21.15.70:0/530358003 shutdown_connections 2024-04-26T20:19:09.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7474039ae0 0x7f747403bfa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:09.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c1a2a20 0x7f748c1a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:09.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f748c101f70 0x7f748c1999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:09.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 --2- 172.21.15.70:0/530358003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c199ef0 0x7f748c19a370 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:09.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 -- 172.21.15.70:0/530358003 >> 172.21.15.70:0/530358003 conn(0x7f748c0fd820 msgr2=0x7f748c103940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:09.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 -- 172.21.15.70:0/530358003 shutdown_connections 2024-04-26T20:19:09.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:09.621+0000 7f7490a69700 1 -- 172.21.15.70:0/530358003 wait complete. 2024-04-26T20:19:10.367 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:10.368 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:10 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/530358003' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:10.368 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:10 smithi070 ceph-mon[29124]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:10.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:10.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:10 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/530358003' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:10.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:10 smithi098 ceph-mon[32591]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:10.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:19:10.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:10 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/530358003' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:10.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:10 smithi080 ceph-mon[32278]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:10.697 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-26T20:19:10.697 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:19:10.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T20:19:10.725 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:19:10.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:19:10.790 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T20:19:10.790 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T20:19:10.823 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T20:19:10.823 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:19:10.892 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T20:19:10.893 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T20:19:10.925 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T20:19:10.925 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:19:10.994 INFO:tasks.cephadm:Adding mgr.x on smithi070 2024-04-26T20:19:10.994 INFO:tasks.cephadm:Adding mgr.y on smithi080 2024-04-26T20:19:10.994 INFO:tasks.cephadm:Adding mgr.z on smithi098 2024-04-26T20:19:10.994 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi070=x;smithi080=y;smithi098=z' 2024-04-26T20:19:11.269 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:19:12.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:12.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:12.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:12 smithi070 ceph-mon[29124]: Reconfiguring mon.b (monmap changed)... 2024-04-26T20:19:12.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:19:12.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:19:12.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:12.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:12 smithi070 ceph-mon[29124]: Reconfiguring daemon mon.b on smithi080 2024-04-26T20:19:12.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:12 smithi070 ceph-mon[29124]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:12.381 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:12.381 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:12.381 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:12 smithi098 ceph-mon[32591]: Reconfiguring mon.b (monmap changed)... 2024-04-26T20:19:12.382 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:19:12.382 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:19:12.382 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:12.382 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:12 smithi098 ceph-mon[32591]: Reconfiguring daemon mon.b on smithi080 2024-04-26T20:19:12.382 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:12 smithi098 ceph-mon[32591]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:12.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:12.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:12.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:12 smithi080 ceph-mon[32278]: Reconfiguring mon.b (monmap changed)... 2024-04-26T20:19:12.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:19:12.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:19:12.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:12.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:12 smithi080 ceph-mon[32278]: Reconfiguring daemon mon.b on smithi080 2024-04-26T20:19:12.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:12 smithi080 ceph-mon[32278]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:12.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.576+0000 7f26a1bf4700 1 -- 172.21.15.98:0/2829787916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f269c0773d0 msgr2=0x7f269c075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.576+0000 7f26a1bf4700 1 --2- 172.21.15.98:0/2829787916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f269c0773d0 0x7f269c075830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f268c009910 tx=0x7f268c009c20 comp rx=0 tx=0).stop 2024-04-26T20:19:12.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.576+0000 7f26a1bf4700 1 -- 172.21.15.98:0/2829787916 shutdown_connections 2024-04-26T20:19:12.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.576+0000 7f26a1bf4700 1 --2- 172.21.15.98:0/2829787916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f269c0773d0 0x7f269c075830 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.576+0000 7f26a1bf4700 1 -- 172.21.15.98:0/2829787916 >> 172.21.15.98:0/2829787916 conn(0x7f269c0fe550 msgr2=0x7f269c100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:12.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.576+0000 7f26a1bf4700 1 -- 172.21.15.98:0/2829787916 shutdown_connections 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.576+0000 7f26a1bf4700 1 -- 172.21.15.98:0/2829787916 wait complete. 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.576+0000 7f26a1bf4700 1 Processor -- start 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f26a1bf4700 1 -- start start 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f26a1bf4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f269c0773d0 0x7f269c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f26a1bf4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c19aea0 0x7f269c19ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f26a1bf4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f269c19b320 0x7f269c1a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f26a1bf4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f269c10b220 con 0x7f269c0773d0 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f26a1bf4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f269c10b0a0 con 0x7f269c19aea0 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f26a1bf4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f269c10b3a0 con 0x7f269c19b320 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f269affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c19aea0 0x7f269c19ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f269affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c19aea0 0x7f269c19ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.98:56328/0 (socket says 172.21.15.98:56328) 2024-04-26T20:19:12.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f269affd700 1 -- 172.21.15.98:0/1077136960 learned_addr learned my addr 172.21.15.98:0/1077136960 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f269b7fe700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f269c0773d0 0x7f269c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f269bfff700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f269c19b320 0x7f269c1a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f269affd700 1 -- 172.21.15.98:0/1077136960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f269c19b320 msgr2=0x7f269c1a24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f269affd700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f269c19b320 0x7f269c1a24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f269affd700 1 -- 172.21.15.98:0/1077136960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f269c0773d0 msgr2=0x7f269c19a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f269affd700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f269c0773d0 0x7f269c19a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f269affd700 1 -- 172.21.15.98:0/1077136960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c1a2d70 con 0x7f269c19aea0 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.577+0000 7f269b7fe700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f269c0773d0 0x7f269c19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.578+0000 7f269affd700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c19aea0 0x7f269c19ff10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f269000b780 tx=0x7f269000ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.578+0000 7f2698ff9700 1 -- 172.21.15.98:0/1077136960 <== mon.2 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690016070 con 0x7f269c19aea0 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.578+0000 7f2698ff9700 1 -- 172.21.15.98:0/1077136960 <== mon.2 v2:172.21.15.80:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f26900036a0 con 0x7f269c19aea0 2024-04-26T20:19:12.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.578+0000 7f26a1bf4700 1 -- 172.21.15.98:0/1077136960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269c1a3060 con 0x7f269c19aea0 2024-04-26T20:19:12.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.578+0000 7f2698ff9700 1 -- 172.21.15.98:0/1077136960 <== mon.2 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690011ad0 con 0x7f269c19aea0 2024-04-26T20:19:12.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.578+0000 7f26a1bf4700 1 -- 172.21.15.98:0/1077136960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269c1a3620 con 0x7f269c19aea0 2024-04-26T20:19:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.579+0000 7f2698ff9700 1 -- 172.21.15.98:0/1077136960 <== mon.2 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f2690019070 con 0x7f269c19aea0 2024-04-26T20:19:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.579+0000 7f26a1bf4700 1 -- 172.21.15.98:0/1077136960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269c064a80 con 0x7f269c19aea0 2024-04-26T20:19:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.579+0000 7f2698ff9700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2684039ae0 0x7f268403bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.579+0000 7f2698ff9700 1 -- 172.21.15.98:0/1077136960 <== mon.2 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f269004b360 con 0x7f269c19aea0 2024-04-26T20:19:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.579+0000 7f269b7fe700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2684039ae0 0x7f268403bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.579+0000 7f269b7fe700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2684039ae0 0x7f268403bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b5c0 tx=0x7f268c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:12.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.584+0000 7f2698ff9700 1 -- 172.21.15.98:0/1077136960 <== mon.2 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2690015170 con 0x7f269c19aea0 2024-04-26T20:19:12.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.797+0000 7f26a1bf4700 1 -- 172.21.15.98:0/1077136960 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi080=y;smithi098=z", "target": ["mon-mgr", ""]}) -- 0x7f269c063860 con 0x7f2684039ae0 2024-04-26T20:19:12.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.803+0000 7f2698ff9700 1 -- 172.21.15.98:0/1077136960 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f269c063860 con 0x7f2684039ae0 2024-04-26T20:19:12.805 INFO:teuthology.orchestra.run.smithi098.stdout:Scheduled mgr update... 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.805+0000 7f26a1bf4700 1 -- 172.21.15.98:0/1077136960 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2684039ae0 msgr2=0x7f268403bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.805+0000 7f26a1bf4700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2684039ae0 0x7f268403bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b5c0 tx=0x7f268c01a040 comp rx=0 tx=0).stop 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.805+0000 7f26a1bf4700 1 -- 172.21.15.98:0/1077136960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c19aea0 msgr2=0x7f269c19ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.805+0000 7f26a1bf4700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c19aea0 0x7f269c19ff10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f269000b780 tx=0x7f269000ba90 comp rx=0 tx=0).stop 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.806+0000 7f26a1bf4700 1 -- 172.21.15.98:0/1077136960 shutdown_connections 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.806+0000 7f26a1bf4700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2684039ae0 0x7f268403bfa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.806+0000 7f26a1bf4700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f269c19b320 0x7f269c1a24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.806+0000 7f26a1bf4700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f269c0773d0 0x7f269c19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.806+0000 7f26a1bf4700 1 --2- 172.21.15.98:0/1077136960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f269c19aea0 0x7f269c19ff10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.806+0000 7f26a1bf4700 1 -- 172.21.15.98:0/1077136960 >> 172.21.15.98:0/1077136960 conn(0x7f269c0fe550 msgr2=0x7f269c0ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.806+0000 7f26a1bf4700 1 -- 172.21.15.98:0/1077136960 shutdown_connections 2024-04-26T20:19:12.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:19:12.806+0000 7f26a1bf4700 1 -- 172.21.15.98:0/1077136960 wait complete. 2024-04-26T20:19:13.406 DEBUG:teuthology.orchestra.run.smithi080:mgr.y> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.y.service 2024-04-26T20:19:13.409 DEBUG:teuthology.orchestra.run.smithi098:mgr.z> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.z.service 2024-04-26T20:19:13.411 INFO:tasks.cephadm:Deploying OSDs... 2024-04-26T20:19:13.411 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:19:13.411 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:19:13.431 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:19:13.431 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-04-26T20:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-26T20:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-26 20:18:20.223056992 +0000 2024-04-26T20:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-26 20:12:56.810240765 +0000 2024-04-26T20:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-26 20:12:56.810240765 +0000 2024-04-26T20:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-04-26 20:12:56.810240765 +0000 2024-04-26T20:19:13.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:19:13.557 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-26T20:19:13.557 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-26T20:19:13.557 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000108336 s, 4.7 MB/s 2024-04-26T20:19:13.558 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:19:13.617 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-04-26T20:19:13.674 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:19:13.674 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:13.674 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-04-26T20:19:13.674 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:13.675 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:13.675 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-26 20:18:20.257055987 +0000 2024-04-26T20:19:13.675 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-26 20:12:57.146230486 +0000 2024-04-26T20:19:13.675 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-26 20:12:57.146230486 +0000 2024-04-26T20:19:13.675 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-04-26 20:12:57.146230486 +0000 2024-04-26T20:19:13.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:19:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-26T20:19:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-26T20:19:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000123587 s, 4.1 MB/s 2024-04-26T20:19:13.743 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:19:13.799 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-04-26T20:19:13.855 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:19:13.855 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:13.855 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-26T20:19:13.855 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:13.855 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:13.856 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-26 20:18:20.290055013 +0000 2024-04-26T20:19:13.856 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-26 20:12:57.474220452 +0000 2024-04-26T20:19:13.856 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-26 20:12:57.474220452 +0000 2024-04-26T20:19:13.856 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-04-26 20:12:57.474220452 +0000 2024-04-26T20:19:13.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:19:13.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:13 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:13.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:13 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:13.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:13 smithi070 ceph-mon[29124]: Reconfiguring mon.c (monmap changed)... 2024-04-26T20:19:13.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:13 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:19:13.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:13 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:19:13.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:13 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:13.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:13 smithi070 ceph-mon[29124]: Reconfiguring daemon mon.c on smithi098 2024-04-26T20:19:13.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:13 smithi070 ceph-mon[29124]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi080=y;smithi098=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:13.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:13 smithi070 ceph-mon[29124]: Saving service mgr spec with placement smithi070=x;smithi080=y;smithi098=z;count:3 2024-04-26T20:19:13.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:13 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:13.919 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-26T20:19:13.919 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-26T20:19:13.919 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 8.8361e-05 s, 5.8 MB/s 2024-04-26T20:19:13.920 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:19:13.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:13 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:13.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:13 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:13.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:13 smithi098 ceph-mon[32591]: Reconfiguring mon.c (monmap changed)... 2024-04-26T20:19:13.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:13 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:19:13.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:13 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:19:13.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:13 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:13.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:13 smithi098 ceph-mon[32591]: Reconfiguring daemon mon.c on smithi098 2024-04-26T20:19:13.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:13 smithi098 ceph-mon[32591]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi080=y;smithi098=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:13.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:13 smithi098 ceph-mon[32591]: Saving service mgr spec with placement smithi070=x;smithi080=y;smithi098=z;count:3 2024-04-26T20:19:13.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:13 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:13.977 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-04-26T20:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-26T20:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-26 20:18:20.323054038 +0000 2024-04-26T20:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-26 20:12:57.796210601 +0000 2024-04-26T20:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-26 20:12:57.796210601 +0000 2024-04-26T20:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-04-26 20:12:57.796210601 +0000 2024-04-26T20:19:14.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:19:14.097 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-26T20:19:14.097 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-26T20:19:14.097 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000122018 s, 4.2 MB/s 2024-04-26T20:19:14.099 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:19:14.155 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T20:19:14.156 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:19:14.174 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:19:14.174 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-04-26T20:19:14.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:13 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:14.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:13 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:14.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:13 smithi080 ceph-mon[32278]: Reconfiguring mon.c (monmap changed)... 2024-04-26T20:19:14.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:13 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:19:14.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:13 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:19:14.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:13 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:14.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:13 smithi080 ceph-mon[32278]: Reconfiguring daemon mon.c on smithi098 2024-04-26T20:19:14.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:13 smithi080 ceph-mon[32278]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi080=y;smithi098=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:14.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:13 smithi080 ceph-mon[32278]: Saving service mgr spec with placement smithi070=x;smithi080=y;smithi098=z;count:3 2024-04-26T20:19:14.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:13 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:14.231 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:19:14.231 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:14.231 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-26T20:19:14.231 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:14.231 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:14.231 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-26 20:19:00.565048281 +0000 2024-04-26T20:19:14.231 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-26 20:13:25.269898492 +0000 2024-04-26T20:19:14.232 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-26 20:13:25.269898492 +0000 2024-04-26T20:19:14.232 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-26 20:13:25.269898492 +0000 2024-04-26T20:19:14.232 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:19:14.297 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-26T20:19:14.297 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-26T20:19:14.297 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000260953 s, 2.0 MB/s 2024-04-26T20:19:14.299 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:19:14.357 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-04-26T20:19:14.414 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:19:14.414 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:14.414 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-26T20:19:14.414 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:14.414 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:14.414 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-26 20:19:00.566048258 +0000 2024-04-26T20:19:14.414 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-26 20:13:25.591890650 +0000 2024-04-26T20:19:14.414 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-26 20:13:25.591890650 +0000 2024-04-26T20:19:14.414 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-26 20:13:25.591890650 +0000 2024-04-26T20:19:14.415 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:19:14.478 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-26T20:19:14.478 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-26T20:19:14.478 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000189632 s, 2.7 MB/s 2024-04-26T20:19:14.479 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:19:14.536 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-04-26T20:19:14.592 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:19:14.592 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:14.592 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-26T20:19:14.592 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:14.592 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:14.592 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-26 20:19:00.566048258 +0000 2024-04-26T20:19:14.592 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-26 20:13:25.936882248 +0000 2024-04-26T20:19:14.592 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-26 20:13:25.936882248 +0000 2024-04-26T20:19:14.592 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-26 20:13:25.936882248 +0000 2024-04-26T20:19:14.593 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:19:14.655 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-26T20:19:14.655 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-26T20:19:14.655 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000240267 s, 2.1 MB/s 2024-04-26T20:19:14.656 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:19:14.712 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-04-26T20:19:14.767 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:19:14.767 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:14.767 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-26T20:19:14.767 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:14.767 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:14.767 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-26 20:19:00.566048258 +0000 2024-04-26T20:19:14.768 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-26 20:13:26.284873773 +0000 2024-04-26T20:19:14.768 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-26 20:13:26.284873773 +0000 2024-04-26T20:19:14.768 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-26 20:13:26.284873773 +0000 2024-04-26T20:19:14.768 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:19:14.829 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-26T20:19:14.830 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-26T20:19:14.830 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000215778 s, 2.4 MB/s 2024-04-26T20:19:14.831 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:19:14.887 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T20:19:14.887 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:19:14.904 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:19:14.905 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-04-26T20:19:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:19:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-26T20:19:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-04-26 20:18:50.955579760 +0000 2024-04-26T20:19:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-04-26 20:13:20.846074127 +0000 2024-04-26T20:19:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-04-26 20:13:20.846074127 +0000 2024-04-26T20:19:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-04-26 20:13:20.846074127 +0000 2024-04-26T20:19:14.962 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:19:14.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:14 smithi080 ceph-mon[32278]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:14.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:14.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:14.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:15.026 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-04-26T20:19:15.026 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-04-26T20:19:15.026 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00028215 s, 1.8 MB/s 2024-04-26T20:19:15.027 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:19:15.084 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-04-26T20:19:15.140 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:19:15.140 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-26T20:19:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-04-26 20:18:50.955579760 +0000 2024-04-26T20:19:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-04-26 20:13:21.205069045 +0000 2024-04-26T20:19:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-04-26 20:13:21.205069045 +0000 2024-04-26T20:19:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-04-26 20:13:21.205069045 +0000 2024-04-26T20:19:15.141 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:19:15.199 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:14 smithi098 ceph-mon[32591]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:15.200 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:15.200 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:15.200 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:15.202 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-04-26T20:19:15.202 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-04-26T20:19:15.202 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000173531 s, 3.0 MB/s 2024-04-26T20:19:15.203 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:19:15.259 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-04-26T20:19:15.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:14 smithi070 ceph-mon[29124]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:15.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:15.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:15.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:15.313 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:19:15.314 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:15.314 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-26T20:19:15.314 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:15.314 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:15.314 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-04-26 20:18:50.955579760 +0000 2024-04-26T20:19:15.314 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-04-26 20:13:21.545064233 +0000 2024-04-26T20:19:15.314 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-04-26 20:13:21.545064233 +0000 2024-04-26T20:19:15.314 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-04-26 20:13:21.545064233 +0000 2024-04-26T20:19:15.314 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:19:15.376 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-04-26T20:19:15.376 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-04-26T20:19:15.376 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000201965 s, 2.5 MB/s 2024-04-26T20:19:15.377 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:19:15.433 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-04-26T20:19:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:19:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:19:15.489 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-26T20:19:15.489 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:19:15.489 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:19:15.489 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-04-26 20:18:50.956579747 +0000 2024-04-26T20:19:15.489 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-04-26 20:13:21.886059406 +0000 2024-04-26T20:19:15.489 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-04-26 20:13:21.886059406 +0000 2024-04-26T20:19:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-04-26 20:13:21.886059406 +0000 2024-04-26T20:19:15.489 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:19:15.551 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-04-26T20:19:15.551 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-04-26T20:19:15.551 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000196755 s, 2.6 MB/s 2024-04-26T20:19:15.552 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:19:15.608 INFO:tasks.cephadm:Deploying osd.0 on smithi070 with /dev/vg_nvme/lv_4... 2024-04-26T20:19:15.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T20:19:15.839 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:19:15.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:15.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:15.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:15.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:19:15.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:19:15.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:19:15.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:16.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:16.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:16.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:16.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:19:16.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:19:16.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:19:16.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:16.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:19:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:19:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:19:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:16.914 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:16 smithi098 ceph-mon[32591]: Deploying daemon mgr.z on smithi098 2024-04-26T20:19:16.914 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:16 smithi098 ceph-mon[32591]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:17.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:16 smithi070 ceph-mon[29124]: Deploying daemon mgr.z on smithi098 2024-04-26T20:19:17.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:16 smithi070 ceph-mon[29124]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:17.209 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:17 smithi098 systemd[1]: Starting Ceph mgr.z for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:19:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:16 smithi080 ceph-mon[32278]: Deploying daemon mgr.z on smithi098 2024-04-26T20:19:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:16 smithi080 ceph-mon[32278]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:17.547 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:17 smithi098 podman[34440]: 2024-04-26 20:19:17.198934757 +0000 UTC m=+0.017845391 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:19:17.547 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:17 smithi098 podman[34440]: 2024-04-26 20:19:17.320070539 +0000 UTC m=+0.138981149 container create b82314337253928e117005c64db48eadad517bc8e00af65fd633d8feaea08ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:19:17.547 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:17 smithi098 podman[34440]: 2024-04-26 20:19:17.547428427 +0000 UTC m=+0.366339049 container init b82314337253928e117005c64db48eadad517bc8e00af65fd633d8feaea08ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:19:17.723 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T20:19:17.723 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T20:19:17.723 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2024-04-26T20:19:17.723 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2024-04-26T20:19:17.723 INFO:teuthology.orchestra.run.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00860526 s, 1.2 GB/s 2024-04-26T20:19:17.723 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2024-04-26T20:19:17.891 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:17 smithi098 podman[34440]: 2024-04-26 20:19:17.549947301 +0000 UTC m=+0.368857909 container start b82314337253928e117005c64db48eadad517bc8e00af65fd633d8feaea08ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-26T20:19:17.891 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:17 smithi098 ceph-mgr[34459]: -- 172.21.15.98:0/1728556032 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56211349a5a0 con 0x56211346ec00 2024-04-26T20:19:17.891 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:17 smithi098 bash[34440]: b82314337253928e117005c64db48eadad517bc8e00af65fd633d8feaea08ba2 2024-04-26T20:19:17.891 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:17 smithi098 systemd[1]: Started Ceph mgr.z for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:19:17.891 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:17.704+0000 7f2e950a0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:19:17.891 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:17.890+0000 7f2e950a0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:19:18.208 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:17.993+0000 7f2e950a0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:19:18.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_4 2024-04-26T20:19:18.583 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:19:18.682 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:18 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:18.302+0000 7f2e950a0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:19:18.682 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:18 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:18.386+0000 7f2e950a0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:19:18.934 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:18 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:18.935 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:18 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:18.935 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:18 smithi070 ceph-mon[29124]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:18.935 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:18 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:18.935 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:18 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:19:18.935 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:18 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:19:18.935 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:18 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:19:18.935 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:18 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:18.935 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:18 smithi070 ceph-mon[29124]: Deploying daemon mgr.y on smithi080 2024-04-26T20:19:18.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:18 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:19.032 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:18 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:19.033 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:18 smithi098 ceph-mon[32591]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:19.033 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:18 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:19.033 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:18 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:19:19.033 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:18 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:19:19.033 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:18 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:19:19.033 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:18 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:19.033 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:18 smithi098 ceph-mon[32591]: Deploying daemon mgr.y on smithi080 2024-04-26T20:19:19.034 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:18 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:19.034 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:18 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:19.034 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:18 smithi080 ceph-mon[32278]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:19.034 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:18 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:19.034 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:18 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:19:19.034 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:18 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:19:19.034 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:18 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:19:19.034 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:18 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:19.034 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:18 smithi080 ceph-mon[32278]: Deploying daemon mgr.y on smithi080 2024-04-26T20:19:19.720 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:19 smithi080 systemd[1]: Starting Ceph mgr.y for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:19:19.930 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:19 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:19.579+0000 7f2e950a0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:19:19.930 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:19 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:19.752+0000 7f2e950a0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:19:19.930 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:19 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:19.930+0000 7f2e950a0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:19:20.070 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:19 smithi080 podman[33644]: 2024-04-26 20:19:19.708940733 +0000 UTC m=+0.017948775 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:19:20.071 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:19 smithi080 podman[33644]: 2024-04-26 20:19:19.839581295 +0000 UTC m=+0.148589324 container create 19002b95cc562f06195983f2094d3daa05b6a13a1ba52df44781ba932f8fd35a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-26T20:19:20.071 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:20 smithi080 podman[33644]: 2024-04-26 20:19:20.042865622 +0000 UTC m=+0.351873655 container init 19002b95cc562f06195983f2094d3daa05b6a13a1ba52df44781ba932f8fd35a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T20:19:20.071 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:20 smithi080 podman[33644]: 2024-04-26 20:19:20.045755462 +0000 UTC m=+0.354763491 container start 19002b95cc562f06195983f2094d3daa05b6a13a1ba52df44781ba932f8fd35a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-26T20:19:20.071 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-mgr[33663]: -- 172.21.15.80:0/3544869409 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5610d6f345a0 con 0x5610d6f08800 2024-04-26T20:19:20.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.203+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3188456762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f01068e0 msgr2=0x7fa9f0108cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.203+0000 7fa9f83bc700 1 --2- 172.21.15.70:0/3188456762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f01068e0 0x7fa9f0108cd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009990 tx=0x7fa9e0009ca0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.204+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3188456762 shutdown_connections 2024-04-26T20:19:20.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.204+0000 7fa9f83bc700 1 --2- 172.21.15.70:0/3188456762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0109210 0x7fa9f010b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.204+0000 7fa9f83bc700 1 --2- 172.21.15.70:0/3188456762 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f0103fb0 0x7fa9f01063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.204+0000 7fa9f83bc700 1 --2- 172.21.15.70:0/3188456762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f01068e0 0x7fa9f0108cd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.204+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3188456762 >> 172.21.15.70:0/3188456762 conn(0x7fa9f00fd940 msgr2=0x7fa9f00ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.204+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3188456762 shutdown_connections 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.204+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3188456762 wait complete. 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.204+0000 7fa9f83bc700 1 Processor -- start 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.204+0000 7fa9f83bc700 1 -- start start 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.204+0000 7fa9f83bc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f0103fb0 0x7fa9f0199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.204+0000 7fa9f83bc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f01068e0 0x7fa9f0199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f83bc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0109210 0x7fa9f01a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f83bc700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f010f020 con 0x7fa9f01068e0 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f83bc700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f010eea0 con 0x7fa9f0103fb0 2024-04-26T20:19:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f83bc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f010f1a0 con 0x7fa9f0109210 2024-04-26T20:19:20.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f5957700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f01068e0 0x7fa9f0199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f5957700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f01068e0 0x7fa9f0199bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55846/0 (socket says 172.21.15.70:55846) 2024-04-26T20:19:20.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f5957700 1 -- 172.21.15.70:0/3102537780 learned_addr learned my addr 172.21.15.70:0/3102537780 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:19:20.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f6158700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f0103fb0 0x7fa9f0199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f6959700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0109210 0x7fa9f01a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f5957700 1 -- 172.21.15.70:0/3102537780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0109210 msgr2=0x7fa9f01a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f5957700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0109210 0x7fa9f01a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f5957700 1 -- 172.21.15.70:0/3102537780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f0103fb0 msgr2=0x7fa9f0199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f5957700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f0103fb0 0x7fa9f0199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f5957700 1 -- 172.21.15.70:0/3102537780 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f0101da0 con 0x7fa9f01068e0 2024-04-26T20:19:20.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.205+0000 7fa9f5957700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f01068e0 0x7fa9f0199bb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0000c00 tx=0x7fa9e0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:20.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.206+0000 7fa9e77fe700 1 -- 172.21.15.70:0/3102537780 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0026070 con 0x7fa9f01068e0 2024-04-26T20:19:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.206+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3102537780 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f0102030 con 0x7fa9f01068e0 2024-04-26T20:19:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.206+0000 7fa9e77fe700 1 -- 172.21.15.70:0/3102537780 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9e0021410 con 0x7fa9f01068e0 2024-04-26T20:19:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.206+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3102537780 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f0102560 con 0x7fa9f01068e0 2024-04-26T20:19:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.206+0000 7fa9e77fe700 1 -- 172.21.15.70:0/3102537780 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0030060 con 0x7fa9f01068e0 2024-04-26T20:19:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.207+0000 7fa9e77fe700 1 -- 172.21.15.70:0/3102537780 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fa9e0029070 con 0x7fa9f01068e0 2024-04-26T20:19:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.207+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3102537780 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d4005360 con 0x7fa9f01068e0 2024-04-26T20:19:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.207+0000 7fa9e77fe700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa9dc039890 0x7fa9dc03bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.207+0000 7fa9e77fe700 1 -- 172.21.15.70:0/3102537780 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa9e004d600 con 0x7fa9f01068e0 2024-04-26T20:19:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.207+0000 7fa9f6158700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa9dc039890 0x7fa9dc03bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.208+0000 7fa9f6158700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa9dc039890 0x7fa9dc03bd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009c60 tx=0x7fa9ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:20.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.212+0000 7fa9e77fe700 1 -- 172.21.15.70:0/3102537780 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa9e0013070 con 0x7fa9f01068e0 2024-04-26T20:19:20.393 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:20 smithi080 bash[33644]: 19002b95cc562f06195983f2094d3daa05b6a13a1ba52df44781ba932f8fd35a 2024-04-26T20:19:20.394 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:20 smithi080 systemd[1]: Started Ceph mgr.y for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:19:20.394 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:20.199+0000 7fdabb3ba200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:19:20.394 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:20.392+0000 7fdabb3ba200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:19:20.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:20.427+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3102537780 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa9d4000bf0 con 0x7fa9dc039890 2024-04-26T20:19:20.545 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:20.234+0000 7f2e950a0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:19:20.545 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:20.331+0000 7f2e950a0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:19:20.545 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:20.544+0000 7f2e950a0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:19:20.720 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:20.504+0000 7fdabb3ba200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:19:20.941 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:20.747+0000 7f2e950a0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:19:20.941 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-mon[32591]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:20.941 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:20.942 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:20.942 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:20.942 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:20.942 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:20.942 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:19:20.942 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:19:20.942 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:20 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:21.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:20 smithi070 ceph-mon[29124]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:21.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:21.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:21.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:19:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:19:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:21.181 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:20.844+0000 7fdabb3ba200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:19:21.181 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:20.969+0000 7fdabb3ba200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:19:21.182 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-mon[32278]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:21.182 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:21.182 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:21.182 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:21.182 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:21.182 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:21.182 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:19:21.182 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:19:21.182 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:20 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:21.708 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:21.380+0000 7f2e950a0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:19:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:21 smithi070 ceph-mon[29124]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:21 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:21 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:21 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:21 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:21 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:21 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:21 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.115 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:21.814+0000 7f2e950a0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:19:22.116 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:21.912+0000 7f2e950a0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:19:22.116 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:22.115+0000 7f2e950a0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:19:22.116 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:21 smithi098 ceph-mon[32591]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:22.116 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:21 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.116 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:21 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.116 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:21 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.116 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:21 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.116 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:21 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:22.116 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:21 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:22.116 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:21 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.192 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:21 smithi080 ceph-mon[32278]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:22.192 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:21 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.192 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:21 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.192 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:21 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.192 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:21 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.192 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:21 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:22.192 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:21 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:22.192 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:21 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.469 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:22.190+0000 7fdabb3ba200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:19:22.469 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:22.359+0000 7fdabb3ba200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:19:22.815 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:22.528+0000 7fdabb3ba200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:19:22.815 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:22.814+0000 7fdabb3ba200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:19:22.815 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-mon[32278]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:22.815 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-mon[32278]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T20:19:22.815 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:19:22.815 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:19:22.816 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:22.816 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-mon[32278]: Reconfiguring daemon mgr.x on smithi070 2024-04-26T20:19:22.816 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:22.958 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:22.637+0000 7f2e950a0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:19:22.959 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:22.730+0000 7f2e950a0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:19:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:22 smithi098 ceph-mon[32591]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:22 smithi098 ceph-mon[32591]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T20:19:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:22 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:19:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:22 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:19:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:22 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:22 smithi098 ceph-mon[32591]: Reconfiguring daemon mgr.x on smithi070 2024-04-26T20:19:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:22 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:23.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:22 smithi070 ceph-mon[29124]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:22 smithi070 ceph-mon[29124]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T20:19:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:22 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:19:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:22 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:19:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:22 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:22 smithi070 ceph-mon[29124]: Reconfiguring daemon mgr.x on smithi070 2024-04-26T20:19:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:22 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:23.109 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:22 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:22.906+0000 7fdabb3ba200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:19:23.109 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:23 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:23.108+0000 7fdabb3ba200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:19:23.317 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:22.975+0000 7f2e950a0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:19:23.318 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:23.107+0000 7f2e950a0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:19:23.318 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:23.202+0000 7f2e950a0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:19:23.318 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:23.317+0000 7f2e950a0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:19:23.469 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:23 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:23.299+0000 7fdabb3ba200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:19:23.958 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:23.637+0000 7f2e950a0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:19:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:23 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2673120883' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d5da62f-a10b-4799-89d0-24ceef513b9c"}]: dispatch 2024-04-26T20:19:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:23 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2673120883' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d5da62f-a10b-4799-89d0-24ceef513b9c"}]': finished 2024-04-26T20:19:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:23 smithi098 ceph-mon[32591]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T20:19:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:23 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1598025692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:19:24.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:23 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2673120883' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d5da62f-a10b-4799-89d0-24ceef513b9c"}]: dispatch 2024-04-26T20:19:24.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:23 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2673120883' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d5da62f-a10b-4799-89d0-24ceef513b9c"}]': finished 2024-04-26T20:19:24.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:23 smithi070 ceph-mon[29124]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T20:19:24.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:24.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:23 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1598025692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:19:24.219 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:23 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:23.894+0000 7fdabb3ba200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:19:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:23 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2673120883' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d5da62f-a10b-4799-89d0-24ceef513b9c"}]: dispatch 2024-04-26T20:19:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:23 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2673120883' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d5da62f-a10b-4799-89d0-24ceef513b9c"}]': finished 2024-04-26T20:19:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:23 smithi080 ceph-mon[32278]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T20:19:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:23 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1598025692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:19:24.605 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:24 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:24.309+0000 7fdabb3ba200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:19:24.605 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:24 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:24.406+0000 7fdabb3ba200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:19:24.605 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:24 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:24.604+0000 7fdabb3ba200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:19:24.708 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:24 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:24.239+0000 7f2e950a0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:19:24.708 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:19:24 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:19:24.454+0000 7f2e950a0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:19:24.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:24 smithi080 ceph-mon[32278]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:24.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:24 smithi080 ceph-mon[32278]: Standby manager daemon z started 2024-04-26T20:19:24.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:24 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T20:19:24.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:24 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:19:24.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:24 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T20:19:24.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:24 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:19:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:24 smithi070 ceph-mon[29124]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:24 smithi070 ceph-mon[29124]: Standby manager daemon z started 2024-04-26T20:19:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:24 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T20:19:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:24 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:19:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:24 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T20:19:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:24 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:19:25.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:25.065+0000 7fa9e77fe700 1 -- 172.21.15.70:0/3102537780 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 14) ==== 92602+0+0 (secure 0 0 0) 0x7fa9e0009d10 con 0x7fa9f01068e0 2024-04-26T20:19:25.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:24 smithi098 ceph-mon[32591]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:24 smithi098 ceph-mon[32591]: Standby manager daemon z started 2024-04-26T20:19:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:24 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T20:19:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:24 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:19:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:24 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T20:19:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:24 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.98:0/2533750731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:19:25.469 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:25.144+0000 7fdabb3ba200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:19:25.469 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:25.235+0000 7fdabb3ba200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:19:25.820 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:25.478+0000 7fdabb3ba200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:19:25.820 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:25.610+0000 7fdabb3ba200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:19:25.820 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:25.704+0000 7fdabb3ba200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:19:25.820 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:25.819+0000 7fdabb3ba200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:19:26.146 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:26 smithi080 ceph-mon[32278]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-26T20:19:26.147 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:26 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T20:19:26.147 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:26 smithi080 ceph-mon[32278]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:26.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:26 smithi098 ceph-mon[32591]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-26T20:19:26.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:26 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T20:19:26.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:26 smithi098 ceph-mon[32591]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:26.469 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:26 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:26.146+0000 7fdabb3ba200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:19:26.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:26 smithi070 ceph-mon[29124]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-26T20:19:26.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:26 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T20:19:26.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:26 smithi070 ceph-mon[29124]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:27.068 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:26 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:26.743+0000 7fdabb3ba200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:19:27.068 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:19:26 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:19:26.958+0000 7fdabb3ba200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:19:27.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:27.075+0000 7fa9e77fe700 1 -- 172.21.15.70:0/3102537780 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7fa9e0027bd0 con 0x7fa9f01068e0 2024-04-26T20:19:27.213 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:27 smithi070 ceph-mon[29124]: Standby manager daemon y started 2024-04-26T20:19:27.213 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:27 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T20:19:27.213 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:27 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:19:27.213 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:27 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T20:19:27.213 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:27 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:19:27.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:27 smithi098 ceph-mon[32591]: Standby manager daemon y started 2024-04-26T20:19:27.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:27 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T20:19:27.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:27 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:19:27.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:27 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T20:19:27.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:27 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:19:27.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:27 smithi080 ceph-mon[32278]: Standby manager daemon y started 2024-04-26T20:19:27.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:27 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T20:19:27.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:27 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:19:27.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:27 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T20:19:27.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:27 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.80:0/4089540588' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:19:28.453 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:28 smithi070 ceph-mon[29124]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-26T20:19:28.453 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:28 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T20:19:28.453 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:28 smithi070 ceph-mon[29124]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:28.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:28 smithi098 ceph-mon[32591]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-26T20:19:28.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:28 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T20:19:28.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:28 smithi098 ceph-mon[32591]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:28.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:28 smithi080 ceph-mon[32278]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-26T20:19:28.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:28 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T20:19:28.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:28 smithi080 ceph-mon[32278]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:29 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:29 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:29 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:29 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:29 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:29 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:29.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:29 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:29.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:29 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:29.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:29 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:29.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:29 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:29.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:29 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:29.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:29 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:29.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:29 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:29.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:29 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:29.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:29 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:29.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:29 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:29.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:29 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:29.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:29 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:30.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:30 smithi098 ceph-mon[32591]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:30.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:30 smithi070 ceph-mon[29124]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:30.863 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:30 smithi080 ceph-mon[32278]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:31.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:31 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T20:19:31.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:31 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:31.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:31 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T20:19:31.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:31 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:31.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:31 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T20:19:31.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:31 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:32.782 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:32 smithi070 ceph-mon[29124]: Deploying daemon osd.0 on smithi070 2024-04-26T20:19:32.782 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:32 smithi070 ceph-mon[29124]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:32.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:32 smithi098 ceph-mon[32591]: Deploying daemon osd.0 on smithi070 2024-04-26T20:19:32.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:32 smithi098 ceph-mon[32591]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:32.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:32 smithi080 ceph-mon[32278]: Deploying daemon osd.0 on smithi070 2024-04-26T20:19:32.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:32 smithi080 ceph-mon[32278]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:34 smithi070 ceph-mon[29124]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:35.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:34 smithi098 ceph-mon[32591]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:35.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:34 smithi080 ceph-mon[32278]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:36.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:36 smithi070 ceph-mon[29124]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:36.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:36.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:36.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:37.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:36 smithi098 ceph-mon[32591]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:37.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:37.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:37.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:37.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:36 smithi080 ceph-mon[32278]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:37.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:37.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:37.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:38.991 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:38 smithi070 ceph-mon[29124]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:38.991 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:38.991 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:38.991 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:38.991 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:38.991 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:38 smithi098 ceph-mon[32591]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:39.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:38 smithi080 ceph-mon[32278]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:39.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:39.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:39.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:39.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:39.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:40.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.034+0000 7fa9e77fe700 1 -- 172.21.15.70:0/3102537780 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa9d4000bf0 con 0x7fa9dc039890 2024-04-26T20:19:40.035 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 0 on host 'smithi070' 2024-04-26T20:19:40.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.036+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3102537780 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa9dc039890 msgr2=0x7fa9dc03bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:40.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.036+0000 7fa9f83bc700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa9dc039890 0x7fa9dc03bd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009c60 tx=0x7fa9ec009260 comp rx=0 tx=0).stop 2024-04-26T20:19:40.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.036+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3102537780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f01068e0 msgr2=0x7fa9f0199bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:40.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.036+0000 7fa9f83bc700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f01068e0 0x7fa9f0199bb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0000c00 tx=0x7fa9e0009580 comp rx=0 tx=0).stop 2024-04-26T20:19:40.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.036+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3102537780 shutdown_connections 2024-04-26T20:19:40.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.036+0000 7fa9f83bc700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa9dc039890 0x7fa9dc03bd50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.036+0000 7fa9f83bc700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f0109210 0x7fa9f01a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.036+0000 7fa9f83bc700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f0103fb0 0x7fa9f0199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.036+0000 7fa9f83bc700 1 --2- 172.21.15.70:0/3102537780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f01068e0 0x7fa9f0199bb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.036+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3102537780 >> 172.21.15.70:0/3102537780 conn(0x7fa9f00fd940 msgr2=0x7fa9f01049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:40.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.037+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3102537780 shutdown_connections 2024-04-26T20:19:40.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:19:40.037+0000 7fa9f83bc700 1 -- 172.21.15.70:0/3102537780 wait complete. 2024-04-26T20:19:40.707 DEBUG:teuthology.orchestra.run.smithi070:osd.0> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.0.service 2024-04-26T20:19:40.709 INFO:tasks.cephadm:Deploying osd.1 on smithi080 with /dev/vg_nvme/lv_4... 2024-04-26T20:19:40.710 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T20:19:40.952 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:40 smithi070 ceph-mon[29124]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:40.952 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:40 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:40.952 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:40 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:40.952 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:40 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:40.952 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:40 smithi070 ceph-mon[29124]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T20:19:40.956 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:19:41.078 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:40 smithi080 ceph-mon[32278]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:41.078 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:40 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:41.079 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:40 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:41.079 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:40 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:41.079 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:40 smithi080 ceph-mon[32278]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T20:19:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:40 smithi098 ceph-mon[32591]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:40 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:40 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:41.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:40 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:41.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:40 smithi098 ceph-mon[32591]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T20:19:42.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:42 smithi070 ceph-mon[29124]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T20:19:42.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:42 smithi070 ceph-mon[29124]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T20:19:42.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:42 smithi070 ceph-mon[29124]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:19:42.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:42 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:42.215 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:42 smithi070 ceph-mon[29124]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:42.216 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:19:42 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0[43900]: 2024-04-26T20:19:42.006+0000 7fe942f85700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T20:19:42.216 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:19:42 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0[43900]: 2024-04-26T20:19:42.009+0000 7fe93ed78700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:19:42.264 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:42 smithi080 ceph-mon[32278]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T20:19:42.264 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:42 smithi080 ceph-mon[32278]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T20:19:42.264 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:42 smithi080 ceph-mon[32278]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:19:42.264 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:42 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:42.264 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:42 smithi080 ceph-mon[32278]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:42.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:42 smithi098 ceph-mon[32591]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T20:19:42.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:42 smithi098 ceph-mon[32591]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T20:19:42.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:42 smithi098 ceph-mon[32591]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:19:42.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:42 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:42.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:42 smithi098 ceph-mon[32591]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:42.892 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T20:19:42.892 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T20:19:42.893 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-26T20:19:42.893 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-26T20:19:42.893 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113735 s, 922 MB/s 2024-04-26T20:19:42.893 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-26T20:19:43.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:43 smithi080 ceph-mon[32278]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:19:43.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:43 smithi080 ceph-mon[32278]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T20:19:43.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:43 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:43.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:43 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:43.267 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:43 smithi070 ceph-mon[29124]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:19:43.267 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:43 smithi070 ceph-mon[29124]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T20:19:43.267 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:43 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:43.267 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:43 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:43.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:43 smithi098 ceph-mon[32591]: from='osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:19:43.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:43 smithi098 ceph-mon[32591]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T20:19:43.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:43 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:43.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:43 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:43.527 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_4 2024-04-26T20:19:43.782 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845] boot 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi070 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi070 to 17088M 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:44.121 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:44.121 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.121 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:44 smithi080 ceph-mon[32278]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845] boot 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi070 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi070 to 17088M 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:44.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:44.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:44 smithi070 ceph-mon[29124]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:44.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: osd.0 [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845] boot 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi070 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi070 to 17088M 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:44.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:44.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:19:44.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:44 smithi098 ceph-mon[32591]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:19:45.143 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:45 smithi080 ceph-mon[32278]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T20:19:45.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:45 smithi070 ceph-mon[29124]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T20:19:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.369+0000 7f3dc5938700 1 -- 172.21.15.80:0/2663112450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dc0103470 msgr2=0x7f3dc0103890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.369+0000 7f3dc5938700 1 --2- 172.21.15.80:0/2663112450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dc0103470 0x7f3dc0103890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3db40099c0 tx=0x7f3db4009cd0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.369+0000 7f3dc5938700 1 -- 172.21.15.80:0/2663112450 shutdown_connections 2024-04-26T20:19:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.369+0000 7f3dc5938700 1 --2- 172.21.15.80:0/2663112450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc0105010 0x7f3dc010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.369+0000 7f3dc5938700 1 --2- 172.21.15.80:0/2663112450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dc0103470 0x7f3dc0103890 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.369+0000 7f3dc5938700 1 --2- 172.21.15.80:0/2663112450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc0104670 0x7f3dc0104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.369+0000 7f3dc5938700 1 -- 172.21.15.80:0/2663112450 >> 172.21.15.80:0/2663112450 conn(0x7f3dc00fea10 msgr2=0x7f3dc0100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.369+0000 7f3dc5938700 1 -- 172.21.15.80:0/2663112450 shutdown_connections 2024-04-26T20:19:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.369+0000 7f3dc5938700 1 -- 172.21.15.80:0/2663112450 wait complete. 2024-04-26T20:19:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dc5938700 1 Processor -- start 2024-04-26T20:19:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dc5938700 1 -- start start 2024-04-26T20:19:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dc5938700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc0103470 0x7f3dc019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dc5938700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dc0104670 0x7f3dc019beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dc5938700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc0105010 0x7f3dc01a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dc5938700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc010f120 con 0x7f3dc0105010 2024-04-26T20:19:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dc5938700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc010efa0 con 0x7f3dc0104670 2024-04-26T20:19:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dc5938700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc010f2a0 con 0x7f3dc0103470 2024-04-26T20:19:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dbe7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dc0104670 0x7f3dc019beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dbe7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dc0104670 0x7f3dc019beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39142/0 (socket says 172.21.15.80:39142) 2024-04-26T20:19:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dbe7fc700 1 -- 172.21.15.80:0/2818880829 learned_addr learned my addr 172.21.15.80:0/2818880829 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T20:19:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dbeffd700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc0103470 0x7f3dc019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dbf7fe700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc0105010 0x7f3dc01a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dbe7fc700 1 -- 172.21.15.80:0/2818880829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc0103470 msgr2=0x7f3dc019b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dbe7fc700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc0103470 0x7f3dc019b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dbe7fc700 1 -- 172.21.15.80:0/2818880829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc0105010 msgr2=0x7f3dc01a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dbe7fc700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc0105010 0x7f3dc01a2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.370+0000 7f3dbe7fc700 1 -- 172.21.15.80:0/2818880829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc01a35d0 con 0x7f3dc0104670 2024-04-26T20:19:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.371+0000 7f3dbe7fc700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dc0104670 0x7f3dc019beb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3db000b530 tx=0x7f3db000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.371+0000 7f3dc4936700 1 -- 172.21.15.80:0/2818880829 <== mon.2 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0015020 con 0x7f3dc0104670 2024-04-26T20:19:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.371+0000 7f3dc4936700 1 -- 172.21.15.80:0/2818880829 <== mon.2 v2:172.21.15.80:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3db0011d00 con 0x7f3dc0104670 2024-04-26T20:19:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.371+0000 7f3dc4936700 1 -- 172.21.15.80:0/2818880829 <== mon.2 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db000f2e0 con 0x7f3dc0104670 2024-04-26T20:19:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.371+0000 7f3dc5938700 1 -- 172.21.15.80:0/2818880829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc01a38c0 con 0x7f3dc0104670 2024-04-26T20:19:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.371+0000 7f3dc5938700 1 -- 172.21.15.80:0/2818880829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc01a3e80 con 0x7f3dc0104670 2024-04-26T20:19:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.372+0000 7f3dc5938700 1 -- 172.21.15.80:0/2818880829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc006a110 con 0x7f3dc0104670 2024-04-26T20:19:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.373+0000 7f3dc4936700 1 -- 172.21.15.80:0/2818880829 <== mon.2 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f3db0018020 con 0x7f3dc0104670 2024-04-26T20:19:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.373+0000 7f3dc4936700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3da80a3bb0 0x7f3da80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.373+0000 7f3dc4936700 1 -- 172.21.15.80:0/2818880829 <== mon.2 v2:172.21.15.80:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f3db00ce6d0 con 0x7f3dc0104670 2024-04-26T20:19:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.373+0000 7f3dbeffd700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3da80a3bb0 0x7f3da80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.374+0000 7f3dbeffd700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3da80a3bb0 0x7f3da80a6070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3db4006010 tx=0x7f3db4009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:45.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.377+0000 7f3dc4936700 1 -- 172.21.15.80:0/2818880829 <== mon.2 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f3db001f020 con 0x7f3dc0104670 2024-04-26T20:19:45.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:45 smithi098 ceph-mon[32591]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T20:19:45.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:19:45.586+0000 7f3dc5938700 1 -- 172.21.15.80:0/2818880829 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3dc0076d70 con 0x7f3da80a3bb0 2024-04-26T20:19:46.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:46 smithi070 ceph-mon[29124]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:46.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:19:46.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:19:46.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:46.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:46 smithi070 ceph-mon[29124]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:46.334 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:46 smithi080 ceph-mon[32278]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:46.334 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:46 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:19:46.334 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:46 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:19:46.334 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:46 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:46.334 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:46 smithi080 ceph-mon[32278]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:46.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:46 smithi098 ceph-mon[32591]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:46.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:46 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:19:46.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:46 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:19:46.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:46 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:46.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:46 smithi098 ceph-mon[32591]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:48.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:48 smithi080 ceph-mon[32278]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:48.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:48 smithi080 ceph-mon[32278]: from='client.? 172.21.15.80:0/1472060202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cf2db0-33a9-490b-905b-207a44bdccde"}]: dispatch 2024-04-26T20:19:48.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:48 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cf2db0-33a9-490b-905b-207a44bdccde"}]: dispatch 2024-04-26T20:19:48.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:48 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76cf2db0-33a9-490b-905b-207a44bdccde"}]': finished 2024-04-26T20:19:48.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:48 smithi080 ceph-mon[32278]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T20:19:48.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:48 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:19:49.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:48 smithi070 ceph-mon[29124]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:49.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:48 smithi070 ceph-mon[29124]: from='client.? 172.21.15.80:0/1472060202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cf2db0-33a9-490b-905b-207a44bdccde"}]: dispatch 2024-04-26T20:19:49.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:48 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cf2db0-33a9-490b-905b-207a44bdccde"}]: dispatch 2024-04-26T20:19:49.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:48 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76cf2db0-33a9-490b-905b-207a44bdccde"}]': finished 2024-04-26T20:19:49.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:48 smithi070 ceph-mon[29124]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T20:19:49.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:19:49.162 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:48 smithi098 ceph-mon[32591]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:49.162 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:48 smithi098 ceph-mon[32591]: from='client.? 172.21.15.80:0/1472060202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cf2db0-33a9-490b-905b-207a44bdccde"}]: dispatch 2024-04-26T20:19:49.162 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:48 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76cf2db0-33a9-490b-905b-207a44bdccde"}]: dispatch 2024-04-26T20:19:49.162 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:48 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76cf2db0-33a9-490b-905b-207a44bdccde"}]': finished 2024-04-26T20:19:49.162 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:48 smithi098 ceph-mon[32591]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T20:19:49.162 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:48 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:19:50.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:49 smithi070 ceph-mon[29124]: from='client.? 172.21.15.80:0/1958185834' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:19:50.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:49 smithi098 ceph-mon[32591]: from='client.? 172.21.15.80:0/1958185834' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:19:50.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:49 smithi080 ceph-mon[32278]: from='client.? 172.21.15.80:0/1958185834' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:19:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:50 smithi070 ceph-mon[29124]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:51.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:50 smithi098 ceph-mon[32591]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:50 smithi080 ceph-mon[32278]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:53.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:52 smithi070 ceph-mon[29124]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:53.080 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:52 smithi080 ceph-mon[32278]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:52 smithi098 ceph-mon[32591]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:54.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:54 smithi080 ceph-mon[32278]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:55.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:54 smithi070 ceph-mon[29124]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:55.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:54 smithi098 ceph-mon[32591]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:56.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:55 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T20:19:56.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:55 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:56.110 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:55 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T20:19:56.110 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:55 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:56.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:55 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T20:19:56.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:55 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:56.839 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:56 smithi080 ceph-mon[32278]: Deploying daemon osd.1 on smithi080 2024-04-26T20:19:56.839 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:56 smithi080 ceph-mon[32278]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:57.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:56 smithi070 ceph-mon[29124]: Deploying daemon osd.1 on smithi080 2024-04-26T20:19:57.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:56 smithi070 ceph-mon[29124]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:57.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:56 smithi098 ceph-mon[32591]: Deploying daemon osd.1 on smithi080 2024-04-26T20:19:57.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:56 smithi098 ceph-mon[32591]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:58.933 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:19:58 smithi080 ceph-mon[32278]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:19:58 smithi098 ceph-mon[32591]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:19:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:19:58 smithi070 ceph-mon[29124]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:00 smithi098 ceph-mon[32591]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:00 smithi098 ceph-mon[32591]: overall HEALTH_OK 2024-04-26T20:20:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:00 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:01.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:00 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:01.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:00 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:00 smithi080 ceph-mon[32278]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:00 smithi080 ceph-mon[32278]: overall HEALTH_OK 2024-04-26T20:20:01.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:00 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:01.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:00 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:01.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:00 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:01.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:00 smithi070 ceph-mon[29124]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:01.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:00 smithi070 ceph-mon[29124]: overall HEALTH_OK 2024-04-26T20:20:01.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:00 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:01.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:00 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:01.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:00 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:02.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:02 smithi080 ceph-mon[32278]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:02 smithi098 ceph-mon[32591]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:03.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:02 smithi070 ceph-mon[29124]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:04.303 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:04.303 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:04.303 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:04.303 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:04.303 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:04.303 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:04 smithi080 ceph-mon[32278]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:04.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.349+0000 7f3dc4936700 1 -- 172.21.15.80:0/2818880829 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3dc0076d70 con 0x7f3da80a3bb0 2024-04-26T20:20:04.351 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 1 on host 'smithi080' 2024-04-26T20:20:04.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 -- 172.21.15.80:0/2818880829 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3da80a3bb0 msgr2=0x7f3da80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:04.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3da80a3bb0 0x7f3da80a6070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3db4006010 tx=0x7f3db4009f10 comp rx=0 tx=0).stop 2024-04-26T20:20:04.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 -- 172.21.15.80:0/2818880829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dc0104670 msgr2=0x7f3dc019beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:04.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dc0104670 0x7f3dc019beb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3db000b530 tx=0x7f3db000b840 comp rx=0 tx=0).stop 2024-04-26T20:20:04.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 -- 172.21.15.80:0/2818880829 shutdown_connections 2024-04-26T20:20:04.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3da80a3bb0 0x7f3da80a6070 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:04.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc0105010 0x7f3dc01a2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:04.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dc0103470 0x7f3dc019b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:04.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 --2- 172.21.15.80:0/2818880829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dc0104670 0x7f3dc019beb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:04.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 -- 172.21.15.80:0/2818880829 >> 172.21.15.80:0/2818880829 conn(0x7f3dc00fea10 msgr2=0x7f3dc0075650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:04.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 -- 172.21.15.80:0/2818880829 shutdown_connections 2024-04-26T20:20:04.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:04.352+0000 7f3dc5938700 1 -- 172.21.15.80:0/2818880829 wait complete. 2024-04-26T20:20:04.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:04.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:04.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:04.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:04.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:04.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:04 smithi098 ceph-mon[32591]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:04.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:04.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:04.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:04.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:04.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:04.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:04 smithi070 ceph-mon[29124]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:04.906 DEBUG:teuthology.orchestra.run.smithi080:osd.1> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.1.service 2024-04-26T20:20:04.908 INFO:tasks.cephadm:Deploying osd.2 on smithi098 with /dev/vg_nvme/lv_4... 2024-04-26T20:20:04.908 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T20:20:05.149 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:20:05.569 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:05 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:05.569 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:05 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:05.569 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:05 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:05.569 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:05 smithi098 ceph-mon[32591]: from='osd.1 [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:20:05.569 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:05 smithi098 ceph-mon[32591]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:20:05.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:05 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:05.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:05 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:05.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:05 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:05.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:05 smithi080 ceph-mon[32278]: from='osd.1 [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:20:05.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:05 smithi080 ceph-mon[32278]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:20:05.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:05 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:05.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:05 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:05.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:05 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:05.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:05 smithi070 ceph-mon[29124]: from='osd.1 [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:20:05.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:05 smithi070 ceph-mon[29124]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:20:06.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:06 smithi098 ceph-mon[32591]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T20:20:06.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:06 smithi098 ceph-mon[32591]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T20:20:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:06 smithi098 ceph-mon[32591]: from='osd.1 [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:20:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:06 smithi098 ceph-mon[32591]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:20:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:06 smithi098 ceph-mon[32591]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:06.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:06 smithi080 ceph-mon[32278]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T20:20:06.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:06 smithi080 ceph-mon[32278]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T20:20:06.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:06.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:06 smithi080 ceph-mon[32278]: from='osd.1 [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:20:06.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:06 smithi080 ceph-mon[32278]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:20:06.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:06 smithi080 ceph-mon[32278]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:06.720 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:20:06 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1[36856]: 2024-04-26T20:20:06.355+0000 7fa6741a6700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T20:20:06.720 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:20:06 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1[36856]: 2024-04-26T20:20:06.358+0000 7fa66ff99700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:20:06.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:06 smithi070 ceph-mon[29124]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T20:20:06.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:06 smithi070 ceph-mon[29124]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T20:20:06.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:06.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:06 smithi070 ceph-mon[29124]: from='osd.1 [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:20:06.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:06 smithi070 ceph-mon[29124]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:20:06.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:06 smithi070 ceph-mon[29124]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:07.141 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T20:20:07.141 INFO:teuthology.orchestra.run.smithi098.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T20:20:07.141 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10+0 records in 2024-04-26T20:20:07.141 INFO:teuthology.orchestra.run.smithi098.stderr:10+0 records out 2024-04-26T20:20:07.141 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114043 s, 919 MB/s 2024-04-26T20:20:07.141 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping successful for: 2024-04-26T20:20:07.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:07 smithi080 ceph-mon[32278]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:20:07.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:07 smithi080 ceph-mon[32278]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T20:20:07.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:07.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:07.609 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:07 smithi098 ceph-mon[32591]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:20:07.609 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:07 smithi098 ceph-mon[32591]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T20:20:07.609 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:07.609 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:07.740 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_4 2024-04-26T20:20:07.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:07 smithi070 ceph-mon[29124]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:20:07.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:07 smithi070 ceph-mon[29124]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T20:20:07.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:07.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:07.985 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:20:08.374 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:20:08.374 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:20:08.374 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:08.374 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: osd.1 [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375] boot 2024-04-26T20:20:08.374 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T20:20:08.374 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:08.374 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:08.375 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:08.375 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:08.375 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:08.375 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:08.375 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:08.375 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:08.375 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:08.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:20:08.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:20:08.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:08.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: osd.1 [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375] boot 2024-04-26T20:20:08.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T20:20:08.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:08.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:08.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:08.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:08.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:08.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:08.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:08.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:08.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:08.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:20:08.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:20:08.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:08.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: osd.1 [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375] boot 2024-04-26T20:20:08.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T20:20:08.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:20:08.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:20:08.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:08.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:08.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:08.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:08.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:08.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:08.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:09.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.482+0000 7f65d3898700 1 -- 172.21.15.98:0/737283942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65cc103f20 msgr2=0x7f65cc10a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.482+0000 7f65d3898700 1 --2- 172.21.15.98:0/737283942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65cc103f20 0x7f65cc10a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009990 tx=0x7f65c4009ca0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.482+0000 7f65d3898700 1 -- 172.21.15.98:0/737283942 shutdown_connections 2024-04-26T20:20:09.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.482+0000 7f65d3898700 1 --2- 172.21.15.98:0/737283942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65cc103f20 0x7f65cc10a7d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.482+0000 7f65d3898700 1 --2- 172.21.15.98:0/737283942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65cc102380 0x7f65cc1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.482+0000 7f65d3898700 1 --2- 172.21.15.98:0/737283942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65cc103580 0x7f65cc1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.482+0000 7f65d3898700 1 -- 172.21.15.98:0/737283942 >> 172.21.15.98:0/737283942 conn(0x7f65cc0fd920 msgr2=0x7f65cc0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.482+0000 7f65d3898700 1 -- 172.21.15.98:0/737283942 shutdown_connections 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.482+0000 7f65d3898700 1 -- 172.21.15.98:0/737283942 wait complete. 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d3898700 1 Processor -- start 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d3898700 1 -- start start 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d3898700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65cc102380 0x7f65cc06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d3898700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65cc103580 0x7f65cc19e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d3898700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65cc103f20 0x7f65cc1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d3898700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc10e050 con 0x7f65cc103580 2024-04-26T20:20:09.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d3898700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc10ded0 con 0x7f65cc102380 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d3898700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc10e1d0 con 0x7f65cc103f20 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d1e35700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65cc103f20 0x7f65cc1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d1e35700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65cc103f20 0x7f65cc1a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58698/0 (socket says 172.21.15.98:58698) 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d1e35700 1 -- 172.21.15.98:0/3521919630 learned_addr learned my addr 172.21.15.98:0/3521919630 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d1634700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65cc102380 0x7f65cc06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d0e33700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65cc103580 0x7f65cc19e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d1e35700 1 -- 172.21.15.98:0/3521919630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65cc102380 msgr2=0x7f65cc06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d1e35700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65cc102380 0x7f65cc06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d1e35700 1 -- 172.21.15.98:0/3521919630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65cc103580 msgr2=0x7f65cc19e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d1e35700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65cc103580 0x7f65cc19e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d1e35700 1 -- 172.21.15.98:0/3521919630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc1a1460 con 0x7f65cc103f20 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.483+0000 7f65d1634700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65cc102380 0x7f65cc06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.484+0000 7f65d1e35700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65cc103f20 0x7f65cc1a0b90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f65c40039a0 tx=0x7f65c4004580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:09.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.484+0000 7f65c27fc700 1 -- 172.21.15.98:0/3521919630 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4027070 con 0x7f65cc103f20 2024-04-26T20:20:09.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.484+0000 7f65c27fc700 1 -- 172.21.15.98:0/3521919630 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f65c40041a0 con 0x7f65cc103f20 2024-04-26T20:20:09.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.484+0000 7f65d3898700 1 -- 172.21.15.98:0/3521919630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65cc1a16f0 con 0x7f65cc103f20 2024-04-26T20:20:09.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.484+0000 7f65c27fc700 1 -- 172.21.15.98:0/3521919630 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c400f460 con 0x7f65cc103f20 2024-04-26T20:20:09.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.484+0000 7f65d3898700 1 -- 172.21.15.98:0/3521919630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65cc1a1c20 con 0x7f65cc103f20 2024-04-26T20:20:09.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.485+0000 7f65d3898700 1 -- 172.21.15.98:0/3521919630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65cc06a110 con 0x7f65cc103f20 2024-04-26T20:20:09.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.486+0000 7f65c27fc700 1 -- 172.21.15.98:0/3521919630 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f65c402a070 con 0x7f65cc103f20 2024-04-26T20:20:09.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.486+0000 7f65c27fc700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65b80a3c30 0x7f65b80a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.486+0000 7f65c27fc700 1 -- 172.21.15.98:0/3521919630 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f65c40cfa20 con 0x7f65cc103f20 2024-04-26T20:20:09.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.486+0000 7f65d1634700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65b80a3c30 0x7f65b80a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.487+0000 7f65d1634700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65b80a3c30 0x7f65b80a60f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65cc1033e0 tx=0x7f65c8009570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:09.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.491+0000 7f65c27fc700 1 -- 172.21.15.98:0/3521919630 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f65c4013070 con 0x7f65cc103f20 2024-04-26T20:20:09.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:09.698+0000 7f65d3898700 1 -- 172.21.15.98:0/3521919630 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f65cc063860 con 0x7f65b80a3c30 2024-04-26T20:20:09.700 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:09 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi080 2024-04-26T20:20:09.700 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:09 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi080 to 17088M 2024-04-26T20:20:09.700 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:09 smithi098 ceph-mon[32591]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T20:20:09.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:09 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi080 2024-04-26T20:20:09.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:09 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi080 to 17088M 2024-04-26T20:20:09.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:09 smithi080 ceph-mon[32278]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T20:20:09.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:09 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi080 2024-04-26T20:20:09.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:09 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi080 to 17088M 2024-04-26T20:20:09.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:09 smithi070 ceph-mon[29124]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T20:20:10.633 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:10 smithi098 ceph-mon[32591]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:10.634 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:20:10.634 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:20:10.634 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:10.634 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:10 smithi098 ceph-mon[32591]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:10.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:10 smithi080 ceph-mon[32278]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:10.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:20:10.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:20:10.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:10.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:10 smithi080 ceph-mon[32278]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:10.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:10 smithi070 ceph-mon[29124]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:10.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:20:10.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:20:10.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:10.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:10 smithi070 ceph-mon[29124]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:12 smithi070 ceph-mon[29124]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:12 smithi070 ceph-mon[29124]: from='client.? 172.21.15.98:0/1527259913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c05d101-5533-40fc-b51a-3f427309846d"}]: dispatch 2024-04-26T20:20:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:12 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c05d101-5533-40fc-b51a-3f427309846d"}]: dispatch 2024-04-26T20:20:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:12 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c05d101-5533-40fc-b51a-3f427309846d"}]': finished 2024-04-26T20:20:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:12 smithi070 ceph-mon[29124]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T20:20:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:13.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:12 smithi098 ceph-mon[32591]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:12 smithi098 ceph-mon[32591]: from='client.? 172.21.15.98:0/1527259913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c05d101-5533-40fc-b51a-3f427309846d"}]: dispatch 2024-04-26T20:20:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:12 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c05d101-5533-40fc-b51a-3f427309846d"}]: dispatch 2024-04-26T20:20:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:12 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c05d101-5533-40fc-b51a-3f427309846d"}]': finished 2024-04-26T20:20:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:12 smithi098 ceph-mon[32591]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T20:20:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:12 smithi080 ceph-mon[32278]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:12 smithi080 ceph-mon[32278]: from='client.? 172.21.15.98:0/1527259913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c05d101-5533-40fc-b51a-3f427309846d"}]: dispatch 2024-04-26T20:20:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:12 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c05d101-5533-40fc-b51a-3f427309846d"}]: dispatch 2024-04-26T20:20:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:12 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c05d101-5533-40fc-b51a-3f427309846d"}]': finished 2024-04-26T20:20:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:12 smithi080 ceph-mon[32278]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T20:20:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:14.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:13 smithi070 ceph-mon[29124]: from='client.? 172.21.15.98:0/1207137031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:20:14.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:13 smithi098 ceph-mon[32591]: from='client.? 172.21.15.98:0/1207137031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:20:14.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:13 smithi080 ceph-mon[32278]: from='client.? 172.21.15.98:0/1207137031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:20:15.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:14 smithi070 ceph-mon[29124]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:15.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:14 smithi098 ceph-mon[32591]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:15.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:14 smithi080 ceph-mon[32278]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:17.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:16 smithi070 ceph-mon[29124]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:16 smithi098 ceph-mon[32591]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:16 smithi080 ceph-mon[32278]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:19.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:18 smithi070 ceph-mon[29124]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:19.036 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:18 smithi080 ceph-mon[32278]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:18 smithi098 ceph-mon[32591]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:20.043 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:19 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T20:20:20.043 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:19 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:20.210 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:19 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T20:20:20.210 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:19 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T20:20:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:20 smithi098 ceph-mon[32591]: Deploying daemon osd.2 on smithi098 2024-04-26T20:20:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:20 smithi098 ceph-mon[32591]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:20 smithi080 ceph-mon[32278]: Deploying daemon osd.2 on smithi098 2024-04-26T20:20:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:20 smithi080 ceph-mon[32278]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:21.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:20 smithi070 ceph-mon[29124]: Deploying daemon osd.2 on smithi098 2024-04-26T20:20:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:20 smithi070 ceph-mon[29124]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:22.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:22 smithi098 ceph-mon[32591]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:23.087 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:22 smithi070 ceph-mon[29124]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:23.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:22 smithi080 ceph-mon[32278]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:25.116 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:24 smithi098 ceph-mon[32591]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:25.116 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:25.116 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:25.117 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:25.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:24 smithi080 ceph-mon[32278]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:25.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:24 smithi070 ceph-mon[29124]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:25.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:25.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:25.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:26.937 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:26 smithi098 ceph-mon[32591]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:27.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:26 smithi080 ceph-mon[32278]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:26 smithi070 ceph-mon[29124]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:28.417 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:28 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:28.417 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:28 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:28.418 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:28 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:28.418 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:28 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:28.418 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:28 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:28.418 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:28 smithi098 ceph-mon[32591]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:28.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.462+0000 7f65c27fc700 1 -- 172.21.15.98:0/3521919630 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f65cc063860 con 0x7f65b80a3c30 2024-04-26T20:20:28.463 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 2 on host 'smithi098' 2024-04-26T20:20:28.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 -- 172.21.15.98:0/3521919630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65b80a3c30 msgr2=0x7f65b80a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:28.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65b80a3c30 0x7f65b80a60f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65cc1033e0 tx=0x7f65c8009570 comp rx=0 tx=0).stop 2024-04-26T20:20:28.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 -- 172.21.15.98:0/3521919630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65cc103f20 msgr2=0x7f65cc1a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:28.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65cc103f20 0x7f65cc1a0b90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f65c40039a0 tx=0x7f65c4004580 comp rx=0 tx=0).stop 2024-04-26T20:20:28.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 -- 172.21.15.98:0/3521919630 shutdown_connections 2024-04-26T20:20:28.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65b80a3c30 0x7f65b80a60f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:28.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65cc103f20 0x7f65cc1a0b90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:28.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65cc102380 0x7f65cc06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:28.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 --2- 172.21.15.98:0/3521919630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65cc103580 0x7f65cc19e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:28.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 -- 172.21.15.98:0/3521919630 >> 172.21.15.98:0/3521919630 conn(0x7f65cc0fd920 msgr2=0x7f65cc106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:28.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 -- 172.21.15.98:0/3521919630 shutdown_connections 2024-04-26T20:20:28.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:20:28.465+0000 7f65d3898700 1 -- 172.21.15.98:0/3521919630 wait complete. 2024-04-26T20:20:28.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:28 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:28.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:28 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:28.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:28 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:28.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:28 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:28.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:28 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:28.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:28 smithi080 ceph-mon[32278]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:28.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:28 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:28.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:28 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:28.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:28 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:28.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:28 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:28.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:28 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:28.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:28 smithi070 ceph-mon[29124]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:29.113 DEBUG:teuthology.orchestra.run.smithi098:osd.2> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.2.service 2024-04-26T20:20:29.115 INFO:tasks.cephadm:Deploying osd.3 on smithi070 with /dev/vg_nvme/lv_3... 2024-04-26T20:20:29.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T20:20:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:29.413 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:29 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:29.413 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:29 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:29.413 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:29 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:29.413 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:29 smithi098 ceph-mon[32591]: from='osd.2 [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:20:29.413 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:29 smithi098 ceph-mon[32591]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:20:29.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:29 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:29.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:29 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:29.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:29 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:29.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:29 smithi070 ceph-mon[29124]: from='osd.2 [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:20:29.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:29 smithi070 ceph-mon[29124]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:20:29.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:29 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:29.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:29 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:29.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:29 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:29.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:29 smithi080 ceph-mon[32278]: from='osd.2 [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:20:29.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:29 smithi080 ceph-mon[32278]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:20:30.567 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:30 smithi098 ceph-mon[32591]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T20:20:30.567 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:30 smithi098 ceph-mon[32591]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T20:20:30.567 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:30 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:30.567 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:30 smithi098 ceph-mon[32591]: from='osd.2 [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:20:30.568 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:30 smithi098 ceph-mon[32591]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:20:30.568 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:30 smithi098 ceph-mon[32591]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:30.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:30 smithi080 ceph-mon[32278]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T20:20:30.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:30 smithi080 ceph-mon[32278]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T20:20:30.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:30 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:30.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:30 smithi080 ceph-mon[32278]: from='osd.2 [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:20:30.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:30 smithi080 ceph-mon[32278]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:20:30.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:30 smithi080 ceph-mon[32278]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:30.775 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:30 smithi070 ceph-mon[29124]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T20:20:30.775 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:30 smithi070 ceph-mon[29124]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T20:20:30.775 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:30 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:30.775 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:30 smithi070 ceph-mon[29124]: from='osd.2 [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:20:30.775 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:30 smithi070 ceph-mon[29124]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:20:30.775 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:30 smithi070 ceph-mon[29124]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:31.209 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:20:30 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2[37735]: 2024-04-26T20:20:30.905+0000 7f3aa88ed700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T20:20:31.209 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:20:30 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2[37735]: 2024-04-26T20:20:30.909+0000 7f3aa06d8700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:20:31.351 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T20:20:31.351 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T20:20:31.351 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2024-04-26T20:20:31.351 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2024-04-26T20:20:31.351 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00831669 s, 1.3 GB/s 2024-04-26T20:20:31.351 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2024-04-26T20:20:31.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:31 smithi098 ceph-mon[32591]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:20:31.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:31 smithi098 ceph-mon[32591]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T20:20:31.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:31 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:31.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:31 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:31.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:31 smithi098 ceph-mon[32591]: from='osd.2 ' entity='osd.2' 2024-04-26T20:20:31.717 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:31 smithi080 ceph-mon[32278]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:20:31.717 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:31 smithi080 ceph-mon[32278]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T20:20:31.717 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:31 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:31.717 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:31 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:31.717 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:31 smithi080 ceph-mon[32278]: from='osd.2 ' entity='osd.2' 2024-04-26T20:20:31.740 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:31 smithi070 ceph-mon[29124]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:20:31.740 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:31 smithi070 ceph-mon[29124]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T20:20:31.740 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:31 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:31.740 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:31 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:31.740 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:31 smithi070 ceph-mon[29124]: from='osd.2 ' entity='osd.2' 2024-04-26T20:20:32.069 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_3 2024-04-26T20:20:32.313 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:32.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:20:32.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:20:32.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:32.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:32.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: osd.2 [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241] boot 2024-04-26T20:20:32.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T20:20:32.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:32.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:32.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:32.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:32.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:32.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:32.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:32.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: osd.2 [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241] boot 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:32.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:20:32.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:20:32.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:32.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:20:32.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: osd.2 [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241] boot 2024-04-26T20:20:32.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T20:20:32.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:20:32.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:32.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:32.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:32.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:32.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:32.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:32.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:33.755 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:33 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi098 2024-04-26T20:20:33.755 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:33 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi098 to 17088M 2024-04-26T20:20:33.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:33 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi098 2024-04-26T20:20:33.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:33 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi098 to 17088M 2024-04-26T20:20:33.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:33 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi098 2024-04-26T20:20:33.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:33 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi098 to 17088M 2024-04-26T20:20:33.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.970+0000 7f0c73449700 1 -- 172.21.15.70:0/1209715100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c6c1014d0 msgr2=0x7f0c6c101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:33.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.970+0000 7f0c73449700 1 --2- 172.21.15.70:0/1209715100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c6c1014d0 0x7f0c6c101930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009990 tx=0x7f0c5c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.970+0000 7f0c73449700 1 -- 172.21.15.70:0/1209715100 shutdown_connections 2024-04-26T20:20:33.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.970+0000 7f0c73449700 1 --2- 172.21.15.70:0/1209715100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c6c101e70 0x7f0c6c10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.970+0000 7f0c73449700 1 --2- 172.21.15.70:0/1209715100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c104a50 0x7f0c6c104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.970+0000 7f0c73449700 1 --2- 172.21.15.70:0/1209715100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c6c1014d0 0x7f0c6c101930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.970+0000 7f0c73449700 1 -- 172.21.15.70:0/1209715100 >> 172.21.15.70:0/1209715100 conn(0x7f0c6c0fd0b0 msgr2=0x7f0c6c0ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:33.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.970+0000 7f0c73449700 1 -- 172.21.15.70:0/1209715100 shutdown_connections 2024-04-26T20:20:33.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.970+0000 7f0c73449700 1 -- 172.21.15.70:0/1209715100 wait complete. 2024-04-26T20:20:33.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c73449700 1 Processor -- start 2024-04-26T20:20:33.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c73449700 1 -- start start 2024-04-26T20:20:33.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c73449700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c6c1014d0 0x7f0c6c104150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:33.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c73449700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c6c101e70 0x7f0c6c1027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:33.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c73449700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c104a50 0x7f0c6c102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:33.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c73449700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c10f0a0 con 0x7f0c6c1014d0 2024-04-26T20:20:33.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c73449700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c10ef20 con 0x7f0c6c104a50 2024-04-26T20:20:33.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c73449700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c10f220 con 0x7f0c6c101e70 2024-04-26T20:20:33.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c711e5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c6c1014d0 0x7f0c6c104150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:33.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c711e5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c6c1014d0 0x7f0c6c104150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58252/0 (socket says 172.21.15.70:58252) 2024-04-26T20:20:33.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c711e5700 1 -- 172.21.15.70:0/3410286286 learned_addr learned my addr 172.21.15.70:0/3410286286 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:20:33.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c709e4700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c6c101e70 0x7f0c6c1027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:33.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c719e6700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c104a50 0x7f0c6c102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:33.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c711e5700 1 -- 172.21.15.70:0/3410286286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c6c101e70 msgr2=0x7f0c6c1027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:33.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c711e5700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c6c101e70 0x7f0c6c1027a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c711e5700 1 -- 172.21.15.70:0/3410286286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c104a50 msgr2=0x7f0c6c102ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:33.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c711e5700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c104a50 0x7f0c6c102ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.971+0000 7f0c711e5700 1 -- 172.21.15.70:0/3410286286 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c103590 con 0x7f0c6c1014d0 2024-04-26T20:20:33.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.972+0000 7f0c711e5700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c6c1014d0 0x7f0c6c104150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800efc0 tx=0x7f0c6800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:33.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.972+0000 7f0c627fc700 1 -- 172.21.15.70:0/3410286286 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c680092e0 con 0x7f0c6c1014d0 2024-04-26T20:20:33.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.972+0000 7f0c627fc700 1 -- 172.21.15.70:0/3410286286 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0c68003a00 con 0x7f0c6c1014d0 2024-04-26T20:20:33.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.972+0000 7f0c627fc700 1 -- 172.21.15.70:0/3410286286 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68004720 con 0x7f0c6c1014d0 2024-04-26T20:20:33.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.972+0000 7f0c73449700 1 -- 172.21.15.70:0/3410286286 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c1a37b0 con 0x7f0c6c1014d0 2024-04-26T20:20:33.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.972+0000 7f0c73449700 1 -- 172.21.15.70:0/3410286286 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c1a3d40 con 0x7f0c6c1014d0 2024-04-26T20:20:33.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.973+0000 7f0c73449700 1 -- 172.21.15.70:0/3410286286 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c6c06a110 con 0x7f0c6c1014d0 2024-04-26T20:20:33.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.974+0000 7f0c627fc700 1 -- 172.21.15.70:0/3410286286 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f0c6801b030 con 0x7f0c6c1014d0 2024-04-26T20:20:33.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.974+0000 7f0c627fc700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c580a3bb0 0x7f0c580a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:33.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.975+0000 7f0c709e4700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c580a3bb0 0x7f0c580a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:33.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.975+0000 7f0c627fc700 1 -- 172.21.15.70:0/3410286286 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2851+0+0 (secure 0 0 0) 0x7f0c680cf5e0 con 0x7f0c6c1014d0 2024-04-26T20:20:33.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.975+0000 7f0c709e4700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c580a3bb0 0x7f0c580a6070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00b6c0 tx=0x7f0c5c00b790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:33.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:33.978+0000 7f0c627fc700 1 -- 172.21.15.70:0/3410286286 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f0c68022020 con 0x7f0c6c1014d0 2024-04-26T20:20:34.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:34.185+0000 7f0c73449700 1 -- 172.21.15.70:0/3410286286 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0c6c063860 con 0x7f0c580a3bb0 2024-04-26T20:20:34.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:34 smithi070 ceph-mon[29124]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T20:20:34.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:34 smithi070 ceph-mon[29124]: pgmap v82: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:34.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:20:34.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:20:34.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:20:34.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:34 smithi098 ceph-mon[32591]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T20:20:34.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:34 smithi098 ceph-mon[32591]: pgmap v82: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:34.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:20:34.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:20:34.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:20:34.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:34.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:34 smithi080 ceph-mon[32278]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T20:20:34.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:34 smithi080 ceph-mon[32278]: pgmap v82: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:34.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:20:34.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:20:34.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:20:34.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:35.739 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41520]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:20:35.739 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41520]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:35.739 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41520]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:35.739 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41520]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:35.739 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 ceph-mon[32591]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:35.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T20:20:35.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 ceph-mon[32591]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T20:20:35.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:20:35.782 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 ceph-mon[29124]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:35.783 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T20:20:35.783 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 ceph-mon[29124]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T20:20:35.783 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:20:35.783 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48280]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:20:35.783 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48280]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:35.783 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48280]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:35.783 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48280]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:35.783 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48283]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:20:35.783 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48283]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:35.783 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48283]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:35.784 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48283]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:35.861 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 ceph-mon[32278]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:35.861 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T20:20:35.861 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 ceph-mon[32278]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T20:20:35.861 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:20:35.862 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40560]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:20:35.862 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40560]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:35.862 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40560]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:35.862 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40560]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:35.862 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40563]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:20:35.862 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40563]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:35.862 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40563]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:35.863 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40563]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48286]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:20:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48286]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48286]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48286]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48291]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:20:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48291]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48291]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:35 smithi070 sudo[48291]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:36.209 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41523]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:20:36.209 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41523]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:36.209 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41523]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:36.209 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41523]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:36.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41526]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:20:36.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41526]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:36.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41526]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:36.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41526]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:36.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41529]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:20:36.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41529]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:36.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41529]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:36.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:35 smithi098 sudo[41529]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:36.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40566]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:20:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40566]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40566]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40566]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40569]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:20:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40569]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:20:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40569]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:20:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:35 smithi080 sudo[40569]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:20:36.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:36.719+0000 7f0c627fc700 1 -- 172.21.15.70:0/3410286286 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0c68012050 con 0x7f0c6c1014d0 2024-04-26T20:20:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:20:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T20:20:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:20:36.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:20:36.787 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:36 smithi070 ceph-mon[29124]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:20:36.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:20:36.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:20:36.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:20:36.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:20:36.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:20:36.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:20:36.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:20:36.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:20:36.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:20:36.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:36 smithi098 ceph-mon[32591]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:20:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:20:36.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:20:36.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:20:36.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:20:36.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:20:36.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:20:36.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:20:36.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:20:36.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:20:36.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:36 smithi080 ceph-mon[32278]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:20:37.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:37 smithi070 ceph-mon[29124]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T20:20:37.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:37 smithi070 ceph-mon[29124]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T20:20:37.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:37 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3196166595' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fdf9d5ab-8f4b-4078-b880-0a7a485e58fc"}]: dispatch 2024-04-26T20:20:37.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:37 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3196166595' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fdf9d5ab-8f4b-4078-b880-0a7a485e58fc"}]': finished 2024-04-26T20:20:37.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:37 smithi070 ceph-mon[29124]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T20:20:37.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:37 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:37.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:37 smithi098 ceph-mon[32591]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T20:20:37.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:37 smithi098 ceph-mon[32591]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T20:20:37.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:37 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3196166595' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fdf9d5ab-8f4b-4078-b880-0a7a485e58fc"}]: dispatch 2024-04-26T20:20:37.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:37 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3196166595' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fdf9d5ab-8f4b-4078-b880-0a7a485e58fc"}]': finished 2024-04-26T20:20:37.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:37 smithi098 ceph-mon[32591]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T20:20:37.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:37 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:37.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:37 smithi080 ceph-mon[32278]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T20:20:37.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:37 smithi080 ceph-mon[32278]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T20:20:37.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:37 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3196166595' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fdf9d5ab-8f4b-4078-b880-0a7a485e58fc"}]: dispatch 2024-04-26T20:20:37.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:37 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3196166595' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fdf9d5ab-8f4b-4078-b880-0a7a485e58fc"}]': finished 2024-04-26T20:20:37.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:37 smithi080 ceph-mon[32278]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T20:20:37.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:37 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:38.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:38 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/4224926082' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:20:38.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:38 smithi070 ceph-mon[29124]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:38.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:38 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/4224926082' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:20:38.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:38 smithi098 ceph-mon[32591]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:38.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:38 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/4224926082' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:20:38.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:38 smithi080 ceph-mon[32278]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:40.908 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:40 smithi070 ceph-mon[29124]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:40 smithi098 ceph-mon[32591]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:41.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:40 smithi080 ceph-mon[32278]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:43.032 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:42 smithi070 ceph-mon[29124]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:42 smithi098 ceph-mon[32591]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:43.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:42 smithi080 ceph-mon[32278]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:45.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:44 smithi070 ceph-mon[29124]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:45.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T20:20:45.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:44 smithi098 ceph-mon[32591]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:45.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T20:20:45.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:44 smithi080 ceph-mon[32278]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T20:20:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:45.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:45 smithi070 ceph-mon[29124]: Deploying daemon osd.3 on smithi070 2024-04-26T20:20:46.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:45 smithi098 ceph-mon[32591]: Deploying daemon osd.3 on smithi070 2024-04-26T20:20:46.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:45 smithi080 ceph-mon[32278]: Deploying daemon osd.3 on smithi070 2024-04-26T20:20:47.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:46 smithi070 ceph-mon[29124]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:47.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:46 smithi098 ceph-mon[32591]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:47.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:46 smithi080 ceph-mon[32278]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:49.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:48 smithi070 ceph-mon[29124]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:49.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:48 smithi098 ceph-mon[32591]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:49.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:48 smithi080 ceph-mon[32278]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:50 smithi070 ceph-mon[29124]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:51.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:50 smithi098 ceph-mon[32591]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:51.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:51.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:51.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:50 smithi080 ceph-mon[32278]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:53.112 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:52 smithi070 ceph-mon[29124]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:52 smithi098 ceph-mon[32591]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:53.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:52 smithi080 ceph-mon[32278]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:53.794 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 3 on host 'smithi070' 2024-04-26T20:20:53.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.793+0000 7f0c627fc700 1 -- 172.21.15.70:0/3410286286 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0c6c063860 con 0x7f0c580a3bb0 2024-04-26T20:20:53.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.795+0000 7f0c73449700 1 -- 172.21.15.70:0/3410286286 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c580a3bb0 msgr2=0x7f0c580a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:53.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.795+0000 7f0c73449700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c580a3bb0 0x7f0c580a6070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00b6c0 tx=0x7f0c5c00b790 comp rx=0 tx=0).stop 2024-04-26T20:20:53.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.795+0000 7f0c73449700 1 -- 172.21.15.70:0/3410286286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c6c1014d0 msgr2=0x7f0c6c104150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.795+0000 7f0c73449700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c6c1014d0 0x7f0c6c104150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800efc0 tx=0x7f0c6800c3a0 comp rx=0 tx=0).stop 2024-04-26T20:20:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.795+0000 7f0c73449700 1 -- 172.21.15.70:0/3410286286 shutdown_connections 2024-04-26T20:20:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.795+0000 7f0c73449700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c580a3bb0 0x7f0c580a6070 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.795+0000 7f0c73449700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c104a50 0x7f0c6c102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.795+0000 7f0c73449700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c6c1014d0 0x7f0c6c104150 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.795+0000 7f0c73449700 1 --2- 172.21.15.70:0/3410286286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c6c101e70 0x7f0c6c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.795+0000 7f0c73449700 1 -- 172.21.15.70:0/3410286286 >> 172.21.15.70:0/3410286286 conn(0x7f0c6c0fd0b0 msgr2=0x7f0c6c107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.796+0000 7f0c73449700 1 -- 172.21.15.70:0/3410286286 shutdown_connections 2024-04-26T20:20:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:20:53.796+0000 7f0c73449700 1 -- 172.21.15.70:0/3410286286 wait complete. 2024-04-26T20:20:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:53 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:53 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:53 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:53 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:53 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:53 smithi070 ceph-mon[29124]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:53 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:53 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:53 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:53 smithi070 ceph-mon[29124]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T20:20:54.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:53 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:53 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:53 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:54.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:53 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:54.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:53 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:53 smithi098 ceph-mon[32591]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:54.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:53 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:53 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:53 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:54.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:53 smithi098 ceph-mon[32591]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T20:20:54.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:53 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:53 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:53 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:54.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:53 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:54.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:53 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:53 smithi080 ceph-mon[32278]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:54.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:53 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:53 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:54.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:53 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:54.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:53 smithi080 ceph-mon[32278]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T20:20:54.492 DEBUG:teuthology.orchestra.run.smithi070:osd.3> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.3.service 2024-04-26T20:20:54.494 INFO:tasks.cephadm:Deploying osd.4 on smithi080 with /dev/vg_nvme/lv_3... 2024-04-26T20:20:54.495 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T20:20:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:20:55.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:55 smithi070 ceph-mon[29124]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T20:20:55.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:55 smithi070 ceph-mon[29124]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T20:20:55.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:55 smithi070 ceph-mon[29124]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:20:55.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:55 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:55.932 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:20:55 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3[50404]: 2024-04-26T20:20:55.789+0000 7fc63ad01700 -1 osd.3 0 waiting for initial osdmap 2024-04-26T20:20:55.932 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:20:55 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3[50404]: 2024-04-26T20:20:55.795+0000 7fc636af4700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:20:56.046 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:55 smithi080 ceph-mon[32278]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T20:20:56.046 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:55 smithi080 ceph-mon[32278]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T20:20:56.046 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:55 smithi080 ceph-mon[32278]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:20:56.047 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:55 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:56.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:55 smithi098 ceph-mon[32591]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T20:20:56.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:55 smithi098 ceph-mon[32591]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T20:20:56.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:55 smithi098 ceph-mon[32591]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:20:56.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:55 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:56.744 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T20:20:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T20:20:56.745 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-26T20:20:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-26T20:20:56.745 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011498 s, 912 MB/s 2024-04-26T20:20:56.745 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-26T20:20:57.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:56 smithi070 ceph-mon[29124]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:57.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:56 smithi070 ceph-mon[29124]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:20:57.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:56 smithi070 ceph-mon[29124]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T20:20:57.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:56 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:57.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:56 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:57.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:56 smithi080 ceph-mon[32278]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:57.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:56 smithi080 ceph-mon[32278]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:20:57.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:56 smithi080 ceph-mon[32278]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T20:20:57.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:56 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:57.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:56 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:57.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:56 smithi098 ceph-mon[32591]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:20:57.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:56 smithi098 ceph-mon[32591]: from='osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:20:57.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:56 smithi098 ceph-mon[32591]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T20:20:57.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:56 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:57.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:56 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:57.387 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_3 2024-04-26T20:20:57.639 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:20:57.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474] boot 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:57.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:57.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:57 smithi080 ceph-mon[32278]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T20:20:58.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474] boot 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:58.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:58.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:57 smithi098 ceph-mon[32591]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T20:20:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:20:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:20:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: osd.3 [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474] boot 2024-04-26T20:20:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T20:20:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:20:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:20:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:20:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:57 smithi070 ceph-mon[29124]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T20:20:58.923 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:58 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi070 2024-04-26T20:20:58.923 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:58 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi070 to 8544M 2024-04-26T20:20:58.923 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:58 smithi080 ceph-mon[32278]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:20:58.923 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:58 smithi080 ceph-mon[32278]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T20:20:59.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.147+0000 7fbdecf2f700 1 -- 172.21.15.80:0/3391452309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8109190 msgr2=0x7fbde810b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:59.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.147+0000 7fbdecf2f700 1 --2- 172.21.15.80:0/3391452309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8109190 0x7fbde810b600 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbde000b0a0 tx=0x7fbde000b3b0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.147+0000 7fbdecf2f700 1 -- 172.21.15.80:0/3391452309 shutdown_connections 2024-04-26T20:20:59.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.147+0000 7fbdecf2f700 1 --2- 172.21.15.80:0/3391452309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8109190 0x7fbde810b600 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.147+0000 7fbdecf2f700 1 --2- 172.21.15.80:0/3391452309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde8103f30 0x7fbde8106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.147+0000 7fbdecf2f700 1 --2- 172.21.15.80:0/3391452309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbde8106860 0x7fbde8108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.147+0000 7fbdecf2f700 1 -- 172.21.15.80:0/3391452309 >> 172.21.15.80:0/3391452309 conn(0x7fbde80fd940 msgr2=0x7fbde80ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:59.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.147+0000 7fbdecf2f700 1 -- 172.21.15.80:0/3391452309 shutdown_connections 2024-04-26T20:20:59.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.147+0000 7fbdecf2f700 1 -- 172.21.15.80:0/3391452309 wait complete. 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.147+0000 7fbdecf2f700 1 Processor -- start 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbdecf2f700 1 -- start start 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbdecf2f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8103f30 0x7fbde8199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbdecf2f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbde8106860 0x7fbde8199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbdecf2f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde8109190 0x7fbde81a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbdecf2f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbde810f060 con 0x7fbde8109190 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbdecf2f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbde810eee0 con 0x7fbde8103f30 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbdecf2f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbde810f1e0 con 0x7fbde8106860 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbde659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8103f30 0x7fbde8199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbde659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8103f30 0x7fbde8199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37956/0 (socket says 172.21.15.80:37956) 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbde659c700 1 -- 172.21.15.80:0/1349936351 learned_addr learned my addr 172.21.15.80:0/1349936351 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T20:20:59.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbdddd9b700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbde8106860 0x7fbde8199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbde659c700 1 -- 172.21.15.80:0/1349936351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbde8106860 msgr2=0x7fbde8199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbde6d9d700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde8109190 0x7fbde81a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbde659c700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbde8106860 0x7fbde8199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbde659c700 1 -- 172.21.15.80:0/1349936351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde8109190 msgr2=0x7fbde81a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbde659c700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde8109190 0x7fbde81a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbde659c700 1 -- 172.21.15.80:0/1349936351 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde81a12a0 con 0x7fbde8103f30 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbde6d9d700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde8109190 0x7fbde81a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbde659c700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8103f30 0x7fbde8199640 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800d980 tx=0x7fbdd800dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.148+0000 7fbddffff700 1 -- 172.21.15.80:0/1349936351 <== mon.2 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8016070 con 0x7fbde8103f30 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.149+0000 7fbddffff700 1 -- 172.21.15.80:0/1349936351 <== mon.2 v2:172.21.15.80:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbdd80044f0 con 0x7fbde8103f30 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.149+0000 7fbdecf2f700 1 -- 172.21.15.80:0/1349936351 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde81a1590 con 0x7fbde8103f30 2024-04-26T20:20:59.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.149+0000 7fbddffff700 1 -- 172.21.15.80:0/1349936351 <== mon.2 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8004d90 con 0x7fbde8103f30 2024-04-26T20:20:59.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.149+0000 7fbdecf2f700 1 -- 172.21.15.80:0/1349936351 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde81a1ad0 con 0x7fbde8103f30 2024-04-26T20:20:59.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.149+0000 7fbdecf2f700 1 -- 172.21.15.80:0/1349936351 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde806a110 con 0x7fbde8103f30 2024-04-26T20:20:59.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.151+0000 7fbddffff700 1 -- 172.21.15.80:0/1349936351 <== mon.2 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fbdd8004020 con 0x7fbde8103f30 2024-04-26T20:20:59.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.151+0000 7fbddffff700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbdd40a3c40 0x7fbdd40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:59.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.151+0000 7fbddffff700 1 -- 172.21.15.80:0/1349936351 <== mon.2 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3698+0+0 (secure 0 0 0) 0x7fbdd80cf630 con 0x7fbde8103f30 2024-04-26T20:20:59.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.151+0000 7fbdddd9b700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbdd40a3c40 0x7fbdd40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:59.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.152+0000 7fbdddd9b700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbdd40a3c40 0x7fbdd40a6100 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0005fd0 tx=0x7fbdd0005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:59.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.155+0000 7fbddffff700 1 -- 172.21.15.80:0/1349936351 <== mon.2 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fbdd801f020 con 0x7fbde8103f30 2024-04-26T20:20:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:58 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi070 2024-04-26T20:20:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:58 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi070 to 8544M 2024-04-26T20:20:59.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:58 smithi098 ceph-mon[32591]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:20:59.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:58 smithi098 ceph-mon[32591]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T20:20:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:58 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi070 2024-04-26T20:20:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:58 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi070 to 8544M 2024-04-26T20:20:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:58 smithi070 ceph-mon[29124]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:20:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:58 smithi070 ceph-mon[29124]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T20:20:59.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:20:59.361+0000 7fbdecf2f700 1 -- 172.21.15.80:0/1349936351 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbde8063860 con 0x7fbdd40a3c40 2024-04-26T20:21:00.069 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:59 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:21:00.069 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:59 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:21:00.069 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:20:59 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:00.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:59 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:21:00.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:59 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:21:00.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:20:59 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:00.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:59 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:21:00.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:59 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:21:00.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:20:59 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:00.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:00 smithi080 ceph-mon[32278]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:21:00.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:00 smithi080 ceph-mon[32278]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:00.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:00 smithi080 ceph-mon[32278]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T20:21:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:00 smithi098 ceph-mon[32591]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:21:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:00 smithi098 ceph-mon[32591]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:01.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:00 smithi098 ceph-mon[32591]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T20:21:01.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:00 smithi070 ceph-mon[29124]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:21:01.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:00 smithi070 ceph-mon[29124]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:01.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:00 smithi070 ceph-mon[29124]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T20:21:02.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:01 smithi098 ceph-mon[32591]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T20:21:02.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:01 smithi080 ceph-mon[32278]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T20:21:02.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:01 smithi070 ceph-mon[29124]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T20:21:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:02 smithi098 ceph-mon[32591]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:02 smithi098 ceph-mon[32591]: from='client.? 172.21.15.80:0/4209624808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47740d51-b10e-46d4-bb29-0d7d5dc763fd"}]: dispatch 2024-04-26T20:21:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:02 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47740d51-b10e-46d4-bb29-0d7d5dc763fd"}]: dispatch 2024-04-26T20:21:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:02 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47740d51-b10e-46d4-bb29-0d7d5dc763fd"}]': finished 2024-04-26T20:21:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:02 smithi098 ceph-mon[32591]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T20:21:03.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:03.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:02 smithi098 ceph-mon[32591]: from='client.? 172.21.15.80:0/2354478316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:21:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:02 smithi080 ceph-mon[32278]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:02 smithi080 ceph-mon[32278]: from='client.? 172.21.15.80:0/4209624808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47740d51-b10e-46d4-bb29-0d7d5dc763fd"}]: dispatch 2024-04-26T20:21:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:02 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47740d51-b10e-46d4-bb29-0d7d5dc763fd"}]: dispatch 2024-04-26T20:21:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:02 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47740d51-b10e-46d4-bb29-0d7d5dc763fd"}]': finished 2024-04-26T20:21:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:02 smithi080 ceph-mon[32278]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T20:21:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:02 smithi080 ceph-mon[32278]: from='client.? 172.21.15.80:0/2354478316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:21:03.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:02 smithi070 ceph-mon[29124]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:03.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:02 smithi070 ceph-mon[29124]: from='client.? 172.21.15.80:0/4209624808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47740d51-b10e-46d4-bb29-0d7d5dc763fd"}]: dispatch 2024-04-26T20:21:03.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:02 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47740d51-b10e-46d4-bb29-0d7d5dc763fd"}]: dispatch 2024-04-26T20:21:03.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:02 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47740d51-b10e-46d4-bb29-0d7d5dc763fd"}]': finished 2024-04-26T20:21:03.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:02 smithi070 ceph-mon[29124]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T20:21:03.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:03.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:02 smithi070 ceph-mon[29124]: from='client.? 172.21.15.80:0/2354478316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:21:05.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:04 smithi098 ceph-mon[32591]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-26T20:21:05.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:04 smithi080 ceph-mon[32278]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-26T20:21:05.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:04 smithi070 ceph-mon[29124]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-26T20:21:07.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:06 smithi080 ceph-mon[32278]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T20:21:07.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:06 smithi098 ceph-mon[32591]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T20:21:07.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:06 smithi070 ceph-mon[29124]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T20:21:08.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:08 smithi080 ceph-mon[32278]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-04-26T20:21:09.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:08 smithi098 ceph-mon[32591]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-04-26T20:21:09.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:08 smithi070 ceph-mon[29124]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-04-26T20:21:10.158 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T20:21:10.158 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:10.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T20:21:10.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:10.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T20:21:10.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:11.161 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:10 smithi080 ceph-mon[32278]: Deploying daemon osd.4 on smithi080 2024-04-26T20:21:11.161 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:10 smithi080 ceph-mon[32278]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-26T20:21:11.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:10 smithi098 ceph-mon[32591]: Deploying daemon osd.4 on smithi080 2024-04-26T20:21:11.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:10 smithi098 ceph-mon[32591]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-26T20:21:11.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:10 smithi070 ceph-mon[29124]: Deploying daemon osd.4 on smithi080 2024-04-26T20:21:11.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:10 smithi070 ceph-mon[29124]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-26T20:21:13.087 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:12 smithi080 ceph-mon[32278]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:21:13.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:12 smithi098 ceph-mon[32591]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:21:13.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:12 smithi070 ceph-mon[29124]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:21:15.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:14 smithi098 ceph-mon[32591]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-04-26T20:21:15.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:14 smithi080 ceph-mon[32278]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-04-26T20:21:15.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:14 smithi070 ceph-mon[29124]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-04-26T20:21:16.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:16.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:16.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:16.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:16.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:16.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:16.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:16.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:16 smithi080 ceph-mon[32278]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:16 smithi098 ceph-mon[32591]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:16 smithi070 ceph-mon[29124]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:18.227 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 4 on host 'smithi080' 2024-04-26T20:21:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.224+0000 7fbddffff700 1 -- 172.21.15.80:0/1349936351 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbde8063860 con 0x7fbdd40a3c40 2024-04-26T20:21:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.226+0000 7fbdecf2f700 1 -- 172.21.15.80:0/1349936351 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbdd40a3c40 msgr2=0x7fbdd40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.226+0000 7fbdecf2f700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbdd40a3c40 0x7fbdd40a6100 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0005fd0 tx=0x7fbdd0005d90 comp rx=0 tx=0).stop 2024-04-26T20:21:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.226+0000 7fbdecf2f700 1 -- 172.21.15.80:0/1349936351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8103f30 msgr2=0x7fbde8199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.226+0000 7fbdecf2f700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8103f30 0x7fbde8199640 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800d980 tx=0x7fbdd800dd40 comp rx=0 tx=0).stop 2024-04-26T20:21:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.226+0000 7fbdecf2f700 1 -- 172.21.15.80:0/1349936351 shutdown_connections 2024-04-26T20:21:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.227+0000 7fbdecf2f700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbdd40a3c40 0x7fbdd40a6100 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.227+0000 7fbdecf2f700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde8109190 0x7fbde81a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.227+0000 7fbdecf2f700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8103f30 0x7fbde8199640 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.227+0000 7fbdecf2f700 1 --2- 172.21.15.80:0/1349936351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbde8106860 0x7fbde8199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.227+0000 7fbdecf2f700 1 -- 172.21.15.80:0/1349936351 >> 172.21.15.80:0/1349936351 conn(0x7fbde80fd940 msgr2=0x7fbde81048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.227+0000 7fbdecf2f700 1 -- 172.21.15.80:0/1349936351 shutdown_connections 2024-04-26T20:21:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:21:18.227+0000 7fbdecf2f700 1 -- 172.21.15.80:0/1349936351 wait complete. 2024-04-26T20:21:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:18 smithi098 ceph-mon[32591]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:18 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:19.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:18 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:18 smithi080 ceph-mon[32278]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:18 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:18 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:19.275 DEBUG:teuthology.orchestra.run.smithi080:osd.4> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.4.service 2024-04-26T20:21:19.278 INFO:tasks.cephadm:Deploying osd.5 on smithi098 with /dev/vg_nvme/lv_3... 2024-04-26T20:21:19.278 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T20:21:19.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:18 smithi070 ceph-mon[29124]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:19.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:18 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:18 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:19.514 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:21:19.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:19 smithi098 ceph-mon[32591]: from='osd.4 [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:21:19.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:19 smithi098 ceph-mon[32591]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:21:19.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:19 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:19.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:19 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:20.195 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:19 smithi080 ceph-mon[32278]: from='osd.4 [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:21:20.195 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:19 smithi080 ceph-mon[32278]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:21:20.195 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:19 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:20.195 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:19 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:20.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:19 smithi070 ceph-mon[29124]: from='osd.4 [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:21:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:19 smithi070 ceph-mon[29124]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:21:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:20 smithi098 ceph-mon[32591]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:20 smithi098 ceph-mon[32591]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T20:21:20.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:20 smithi098 ceph-mon[32591]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T20:21:20.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:20 smithi098 ceph-mon[32591]: from='osd.4 [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:21:20.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:20 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:20.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:20 smithi098 ceph-mon[32591]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:21:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:20 smithi080 ceph-mon[32278]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:20 smithi080 ceph-mon[32278]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T20:21:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:20 smithi080 ceph-mon[32278]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T20:21:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:20 smithi080 ceph-mon[32278]: from='osd.4 [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:21:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:20 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:20 smithi080 ceph-mon[32278]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:21:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:20 smithi070 ceph-mon[29124]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:20 smithi070 ceph-mon[29124]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T20:21:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:20 smithi070 ceph-mon[29124]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T20:21:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:20 smithi070 ceph-mon[29124]: from='osd.4 [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:21:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:20 smithi070 ceph-mon[29124]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:21:21.550 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:21:21 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4[43396]: 2024-04-26T20:21:21.307+0000 7ffa12284700 -1 osd.4 0 waiting for initial osdmap 2024-04-26T20:21:21.551 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:21:21 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4[43396]: 2024-04-26T20:21:21.315+0000 7ffa0a06f700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:21:21.573 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T20:21:21.573 INFO:teuthology.orchestra.run.smithi098.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T20:21:21.573 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10+0 records in 2024-04-26T20:21:21.573 INFO:teuthology.orchestra.run.smithi098.stderr:10+0 records out 2024-04-26T20:21:21.573 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112575 s, 931 MB/s 2024-04-26T20:21:21.573 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping successful for: 2024-04-26T20:21:22.191 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:21 smithi098 ceph-mon[32591]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:21:22.191 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:21 smithi098 ceph-mon[32591]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T20:21:22.192 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:21 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:22.192 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:21 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:22.192 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:21 smithi098 ceph-mon[32591]: from='osd.4 ' entity='osd.4' 2024-04-26T20:21:22.209 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:21 smithi080 ceph-mon[32278]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:21:22.209 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:21 smithi080 ceph-mon[32278]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T20:21:22.209 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:21 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:22.209 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:21 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:22.209 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:21 smithi080 ceph-mon[32278]: from='osd.4 ' entity='osd.4' 2024-04-26T20:21:22.220 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_3 2024-04-26T20:21:22.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:21 smithi070 ceph-mon[29124]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:21:22.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:21 smithi070 ceph-mon[29124]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T20:21:22.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:21 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:22.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:21 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:22.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:21 smithi070 ceph-mon[29124]: from='osd.4 ' entity='osd.4' 2024-04-26T20:21:22.455 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:21:23.131 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:22 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:21:23.132 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:22 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:21:23.132 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:22 smithi098 ceph-mon[32591]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:23.132 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:22 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:23.132 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:22 smithi098 ceph-mon[32591]: osd.4 [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976] boot 2024-04-26T20:21:23.132 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:22 smithi098 ceph-mon[32591]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T20:21:23.132 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:22 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:23.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:22 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:21:23.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:22 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:21:23.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:22 smithi070 ceph-mon[29124]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:23.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:22 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:23.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:22 smithi070 ceph-mon[29124]: osd.4 [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976] boot 2024-04-26T20:21:23.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:22 smithi070 ceph-mon[29124]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T20:21:23.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:22 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:23.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:22 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:21:23.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:22 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:21:23.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:22 smithi080 ceph-mon[32278]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-26T20:21:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:22 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:22 smithi080 ceph-mon[32278]: osd.4 [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976] boot 2024-04-26T20:21:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:22 smithi080 ceph-mon[32278]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T20:21:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:22 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:21:23.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.936+0000 7f20a2816700 1 -- 172.21.15.98:0/1643492020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209c102380 msgr2=0x7f209c1027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.936+0000 7f20a2816700 1 --2- 172.21.15.98:0/1643492020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209c102380 0x7f209c1027a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2090009990 tx=0x7f2090009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.936+0000 7f20a2816700 1 -- 172.21.15.98:0/1643492020 shutdown_connections 2024-04-26T20:21:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.936+0000 7f20a2816700 1 --2- 172.21.15.98:0/1643492020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f209c103f20 0x7f209c10a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.936+0000 7f20a2816700 1 --2- 172.21.15.98:0/1643492020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209c102380 0x7f209c1027a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.936+0000 7f20a2816700 1 --2- 172.21.15.98:0/1643492020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f209c103580 0x7f209c1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.936+0000 7f20a2816700 1 -- 172.21.15.98:0/1643492020 >> 172.21.15.98:0/1643492020 conn(0x7f209c0fd940 msgr2=0x7f209c0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.936+0000 7f20a2816700 1 -- 172.21.15.98:0/1643492020 shutdown_connections 2024-04-26T20:21:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.936+0000 7f20a2816700 1 -- 172.21.15.98:0/1643492020 wait complete. 2024-04-26T20:21:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f20a2816700 1 Processor -- start 2024-04-26T20:21:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f20a2816700 1 -- start start 2024-04-26T20:21:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f20a2816700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f209c102380 0x7f209c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f20a2816700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209c103580 0x7f209c19e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f20a2816700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f209c103f20 0x7f209c1a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f20a2816700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10df70 con 0x7f209c103f20 2024-04-26T20:21:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f20a2816700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10ddf0 con 0x7f209c102380 2024-04-26T20:21:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f20a2816700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10e0f0 con 0x7f209c103580 2024-04-26T20:21:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f209b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209c103580 0x7f209c19e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f209b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209c103580 0x7f209c19e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47994/0 (socket says 172.21.15.98:47994) 2024-04-26T20:21:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f209b7fe700 1 -- 172.21.15.98:0/107809828 learned_addr learned my addr 172.21.15.98:0/107809828 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-04-26T20:21:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f20a0db3700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f209c103f20 0x7f209c1a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:23.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.937+0000 7f209bfff700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f209c102380 0x7f209c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:23.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.938+0000 7f209b7fe700 1 -- 172.21.15.98:0/107809828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f209c102380 msgr2=0x7f209c06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:23.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.938+0000 7f209b7fe700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f209c102380 0x7f209c06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.938+0000 7f209b7fe700 1 -- 172.21.15.98:0/107809828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f209c103f20 msgr2=0x7f209c1a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:23.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.938+0000 7f209b7fe700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f209c103f20 0x7f209c1a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.938+0000 7f209b7fe700 1 -- 172.21.15.98:0/107809828 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c1a1330 con 0x7f209c103580 2024-04-26T20:21:23.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.938+0000 7f209b7fe700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209c103580 0x7f209c19e420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f208c00d980 tx=0x7f208c00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:23.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.938+0000 7f20997fa700 1 -- 172.21.15.98:0/107809828 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c017070 con 0x7f209c103580 2024-04-26T20:21:23.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.938+0000 7f20a2816700 1 -- 172.21.15.98:0/107809828 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c1a1620 con 0x7f209c103580 2024-04-26T20:21:23.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.938+0000 7f20997fa700 1 -- 172.21.15.98:0/107809828 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f208c005020 con 0x7f209c103580 2024-04-26T20:21:23.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.938+0000 7f20997fa700 1 -- 172.21.15.98:0/107809828 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c00fb30 con 0x7f209c103580 2024-04-26T20:21:23.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.938+0000 7f20a2816700 1 -- 172.21.15.98:0/107809828 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c1a1b10 con 0x7f209c103580 2024-04-26T20:21:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.939+0000 7f20a2816700 1 -- 172.21.15.98:0/107809828 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c06a110 con 0x7f209c103580 2024-04-26T20:21:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.940+0000 7f20997fa700 1 -- 172.21.15.98:0/107809828 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f208c0051d0 con 0x7f209c103580 2024-04-26T20:21:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.941+0000 7f20997fa700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20840a3c40 0x7f20840a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.941+0000 7f20997fa700 1 -- 172.21.15.98:0/107809828 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f208c0cf590 con 0x7f209c103580 2024-04-26T20:21:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.941+0000 7f209bfff700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20840a3c40 0x7f20840a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.941+0000 7f209bfff700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20840a3c40 0x7f20840a6100 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f209000b7b0 tx=0x7f209000b880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:23.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:23.945+0000 7f20997fa700 1 -- 172.21.15.98:0/107809828 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f208c020020 con 0x7f209c103580 2024-04-26T20:21:23.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi080 2024-04-26T20:21:23.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:23.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:23.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:23.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi080 to 8544M 2024-04-26T20:21:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:23.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:23 smithi098 ceph-mon[32591]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:24.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:24.152+0000 7f20a2816700 1 -- 172.21.15.98:0/107809828 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f209c063860 con 0x7f20840a3c40 2024-04-26T20:21:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi080 2024-04-26T20:21:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi080 to 8544M 2024-04-26T20:21:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:24.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:24.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:24.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:24.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:24.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:24.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:23 smithi080 ceph-mon[32278]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:24.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi080 2024-04-26T20:21:24.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:24.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:24.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:24.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:24.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi080 to 8544M 2024-04-26T20:21:24.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:24.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:24.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:24.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:24.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:24.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:24.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:24.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:24.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:23 smithi070 ceph-mon[29124]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:25.021 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:24 smithi098 ceph-mon[32591]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T20:21:25.022 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:24 smithi098 ceph-mon[32591]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:21:25.022 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:21:25.022 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:21:25.022 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:25.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:24 smithi070 ceph-mon[29124]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T20:21:25.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:24 smithi070 ceph-mon[29124]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:21:25.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:21:25.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:21:25.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:25.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:24 smithi080 ceph-mon[32278]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T20:21:25.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:24 smithi080 ceph-mon[32278]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:21:25.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:21:25.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:21:25.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:26.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:25 smithi070 ceph-mon[29124]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:26.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:25 smithi098 ceph-mon[32591]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:26.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:25 smithi080 ceph-mon[32278]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:26 smithi070 ceph-mon[29124]: from='client.? 172.21.15.98:0/2365203633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42170565-473a-4cee-95f8-cc9f0d195ec5"}]: dispatch 2024-04-26T20:21:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:26 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42170565-473a-4cee-95f8-cc9f0d195ec5"}]: dispatch 2024-04-26T20:21:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:26 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42170565-473a-4cee-95f8-cc9f0d195ec5"}]': finished 2024-04-26T20:21:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:26 smithi070 ceph-mon[29124]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T20:21:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:26 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:27.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:26 smithi098 ceph-mon[32591]: from='client.? 172.21.15.98:0/2365203633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42170565-473a-4cee-95f8-cc9f0d195ec5"}]: dispatch 2024-04-26T20:21:27.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:26 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42170565-473a-4cee-95f8-cc9f0d195ec5"}]: dispatch 2024-04-26T20:21:27.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:26 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42170565-473a-4cee-95f8-cc9f0d195ec5"}]': finished 2024-04-26T20:21:27.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:26 smithi098 ceph-mon[32591]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T20:21:27.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:26 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:27.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:26 smithi080 ceph-mon[32278]: from='client.? 172.21.15.98:0/2365203633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42170565-473a-4cee-95f8-cc9f0d195ec5"}]: dispatch 2024-04-26T20:21:27.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:26 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42170565-473a-4cee-95f8-cc9f0d195ec5"}]: dispatch 2024-04-26T20:21:27.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:26 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42170565-473a-4cee-95f8-cc9f0d195ec5"}]': finished 2024-04-26T20:21:27.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:26 smithi080 ceph-mon[32278]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T20:21:27.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:26 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:28.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:27 smithi070 ceph-mon[29124]: from='client.? 172.21.15.98:0/2189931700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:21:28.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:27 smithi070 ceph-mon[29124]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:28.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:27 smithi098 ceph-mon[32591]: from='client.? 172.21.15.98:0/2189931700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:21:28.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:27 smithi098 ceph-mon[32591]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:28.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:27 smithi080 ceph-mon[32278]: from='client.? 172.21.15.98:0/2189931700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:21:28.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:27 smithi080 ceph-mon[32278]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:31.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:30 smithi070 ceph-mon[29124]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:31.093 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:30 smithi098 ceph-mon[32591]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:31.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:30 smithi080 ceph-mon[32278]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:32 smithi098 ceph-mon[32591]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:33.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:32 smithi080 ceph-mon[32278]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:33.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:32 smithi070 ceph-mon[29124]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:34 smithi098 ceph-mon[32591]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T20:21:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:35.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:34 smithi080 ceph-mon[32278]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T20:21:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:35.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:34 smithi070 ceph-mon[29124]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:35.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T20:21:35.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:35 smithi098 ceph-mon[32591]: Deploying daemon osd.5 on smithi098 2024-04-26T20:21:36.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:35 smithi080 ceph-mon[32278]: Deploying daemon osd.5 on smithi098 2024-04-26T20:21:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:35 smithi070 ceph-mon[29124]: Deploying daemon osd.5 on smithi098 2024-04-26T20:21:36.928 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:36 smithi098 ceph-mon[32591]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:37.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:36 smithi080 ceph-mon[32278]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:37.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:36 smithi070 ceph-mon[29124]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:38 smithi098 ceph-mon[32591]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:39.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:38 smithi080 ceph-mon[32278]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:39.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:38 smithi070 ceph-mon[29124]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:40.912 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:40 smithi098 ceph-mon[32591]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:40.912 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:40 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:40.912 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:40 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:40.912 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:40 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:41.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:40 smithi080 ceph-mon[32278]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:41.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:40 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:41.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:40 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:41.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:40 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:41.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:40 smithi070 ceph-mon[29124]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:41.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:40 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:41.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:40 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:41.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:40 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:42 smithi098 ceph-mon[32591]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:43.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:42 smithi080 ceph-mon[32278]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:43.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:42 smithi070 ceph-mon[29124]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:44.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.017+0000 7f20997fa700 1 -- 172.21.15.98:0/107809828 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f209c063860 con 0x7f20840a3c40 2024-04-26T20:21:44.018 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 5 on host 'smithi098' 2024-04-26T20:21:44.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 -- 172.21.15.98:0/107809828 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20840a3c40 msgr2=0x7f20840a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:44.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20840a3c40 0x7f20840a6100 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f209000b7b0 tx=0x7f209000b880 comp rx=0 tx=0).stop 2024-04-26T20:21:44.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 -- 172.21.15.98:0/107809828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209c103580 msgr2=0x7f209c19e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:44.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209c103580 0x7f209c19e420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f208c00d980 tx=0x7f208c00dc90 comp rx=0 tx=0).stop 2024-04-26T20:21:44.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 -- 172.21.15.98:0/107809828 shutdown_connections 2024-04-26T20:21:44.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20840a3c40 0x7f20840a6100 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:44.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f209c103f20 0x7f209c1a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:44.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f209c102380 0x7f209c06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:44.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 --2- 172.21.15.98:0/107809828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209c103580 0x7f209c19e420 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:44.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 -- 172.21.15.98:0/107809828 >> 172.21.15.98:0/107809828 conn(0x7f209c0fd940 msgr2=0x7f209c106950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:44.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 -- 172.21.15.98:0/107809828 shutdown_connections 2024-04-26T20:21:44.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:21:44.019+0000 7f20a2816700 1 -- 172.21.15.98:0/107809828 wait complete. 2024-04-26T20:21:44.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:44.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:44.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:44 smithi070 ceph-mon[29124]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:44.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.538 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:44.538 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:44 smithi070 ceph-mon[29124]: from='osd.5 [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:21:44.538 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:44 smithi070 ceph-mon[29124]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:21:44.700 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.700 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.700 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:44.700 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:44.700 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.700 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:44 smithi098 ceph-mon[32591]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:44.700 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.700 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:44.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:44 smithi098 ceph-mon[32591]: from='osd.5 [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:21:44.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:44 smithi098 ceph-mon[32591]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:21:44.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:44.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:44.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:44 smithi080 ceph-mon[32278]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:44.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:44.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:44.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:44 smithi080 ceph-mon[32278]: from='osd.5 [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:21:44.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:44 smithi080 ceph-mon[32278]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:21:44.725 DEBUG:teuthology.orchestra.run.smithi098:osd.5> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.5.service 2024-04-26T20:21:44.728 INFO:tasks.cephadm:Deploying osd.6 on smithi070 with /dev/vg_nvme/lv_2... 2024-04-26T20:21:44.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T20:21:44.975 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:46.263 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:46 smithi070 ceph-mon[29124]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T20:21:46.263 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:46 smithi070 ceph-mon[29124]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T20:21:46.263 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:46.263 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:46 smithi070 ceph-mon[29124]: from='osd.5 [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:21:46.263 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:46 smithi070 ceph-mon[29124]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:21:46.263 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:46 smithi070 ceph-mon[29124]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:46.304 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:46 smithi098 ceph-mon[32591]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T20:21:46.304 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:46 smithi098 ceph-mon[32591]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T20:21:46.304 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:46 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:46.304 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:46 smithi098 ceph-mon[32591]: from='osd.5 [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:21:46.304 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:46 smithi098 ceph-mon[32591]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:21:46.304 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:46 smithi098 ceph-mon[32591]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:46.305 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:21:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:21:46.010+0000 7f3d65a8f700 -1 osd.5 0 waiting for initial osdmap 2024-04-26T20:21:46.305 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:21:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:21:46.017+0000 7f3d61882700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:21:46.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:46 smithi080 ceph-mon[32278]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T20:21:46.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:46 smithi080 ceph-mon[32278]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T20:21:46.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:46 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:46.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:46 smithi080 ceph-mon[32278]: from='osd.5 [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:21:46.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:46 smithi080 ceph-mon[32278]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:21:46.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:46 smithi080 ceph-mon[32278]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:46.993 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T20:21:46.993 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T20:21:46.993 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2024-04-26T20:21:46.993 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2024-04-26T20:21:46.993 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00885739 s, 1.2 GB/s 2024-04-26T20:21:46.993 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2024-04-26T20:21:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:47 smithi070 ceph-mon[29124]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:21:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:47 smithi070 ceph-mon[29124]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T20:21:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:47 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:47 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:47.440 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:47 smithi098 ceph-mon[32591]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:21:47.440 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:47 smithi098 ceph-mon[32591]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T20:21:47.440 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:47 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:47.440 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:47 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:47.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:47 smithi080 ceph-mon[32278]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:21:47.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:47 smithi080 ceph-mon[32278]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T20:21:47.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:47 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:47.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:47 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:47.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_2 2024-04-26T20:21:47.925 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:48.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:21:48.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:21:48.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: osd.5 [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535] boot 2024-04-26T20:21:48.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T20:21:48.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:48.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:48.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi098 2024-04-26T20:21:48.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:48.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:48.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi098 to 8544M 2024-04-26T20:21:48.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:48.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:48.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:48 smithi098 ceph-mon[32591]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T20:21:48.277 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:21:48.277 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:21:48.277 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: osd.5 [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535] boot 2024-04-26T20:21:48.277 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi098 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi098 to 8544M 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:48 smithi070 ceph-mon[29124]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T20:21:48.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:21:48.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:21:48.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: osd.5 [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535] boot 2024-04-26T20:21:48.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T20:21:48.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:21:48.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:21:48.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi098 2024-04-26T20:21:48.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:48.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:48.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi098 to 8544M 2024-04-26T20:21:48.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:48.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:48.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:21:48.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:48 smithi080 ceph-mon[32278]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T20:21:49.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.586+0000 7f1f89b57700 1 -- 172.21.15.70:0/3735472115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f84103590 msgr2=0x7f1f841039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:49.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.586+0000 7f1f89b57700 1 --2- 172.21.15.70:0/3735472115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f84103590 0x7f1f841039f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1f780099c0 tx=0x7f1f78009cd0 comp rx=0 tx=0).stop 2024-04-26T20:21:49.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 -- 172.21.15.70:0/3735472115 shutdown_connections 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 --2- 172.21.15.70:0/3735472115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f84103f30 0x7f1f8410a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 --2- 172.21.15.70:0/3735472115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f84102390 0x7f1f841027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 --2- 172.21.15.70:0/3735472115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f84103590 0x7f1f841039f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 -- 172.21.15.70:0/3735472115 >> 172.21.15.70:0/3735472115 conn(0x7f1f840fd950 msgr2=0x7f1f840ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 -- 172.21.15.70:0/3735472115 shutdown_connections 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 -- 172.21.15.70:0/3735472115 wait complete. 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 Processor -- start 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 -- start start 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f84102390 0x7f1f84199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f84103590 0x7f1f84199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f84103f30 0x7f1f841a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.587+0000 7f1f89b57700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8410e060 con 0x7f1f84103f30 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f89b57700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8410dee0 con 0x7f1f84102390 2024-04-26T20:21:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f89b57700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8410e1e0 con 0x7f1f84103590 2024-04-26T20:21:49.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f83fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f84103f30 0x7f1f841a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:49.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f83fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f84103f30 0x7f1f841a0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56736/0 (socket says 172.21.15.70:56736) 2024-04-26T20:21:49.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f83fff700 1 -- 172.21.15.70:0/16479657 learned_addr learned my addr 172.21.15.70:0/16479657 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:21:49.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f837fe700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f84102390 0x7f1f84199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:49.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f82ffd700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f84103590 0x7f1f84199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:49.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f83fff700 1 -- 172.21.15.70:0/16479657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f84103590 msgr2=0x7f1f84199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:49.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f83fff700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f84103590 0x7f1f84199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:49.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f83fff700 1 -- 172.21.15.70:0/16479657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f84102390 msgr2=0x7f1f84199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:49.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f83fff700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f84102390 0x7f1f84199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:49.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f83fff700 1 -- 172.21.15.70:0/16479657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f841a1460 con 0x7f1f84103f30 2024-04-26T20:21:49.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f83fff700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f84103f30 0x7f1f841a0dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00b9a0 tx=0x7f1f7c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:49.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f80ff9700 1 -- 172.21.15.70:0/16479657 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c019070 con 0x7f1f84103f30 2024-04-26T20:21:49.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f80ff9700 1 -- 172.21.15.70:0/16479657 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f7c00ce00 con 0x7f1f84103f30 2024-04-26T20:21:49.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f89b57700 1 -- 172.21.15.70:0/16479657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f841a1750 con 0x7f1f84103f30 2024-04-26T20:21:49.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f80ff9700 1 -- 172.21.15.70:0/16479657 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c007370 con 0x7f1f84103f30 2024-04-26T20:21:49.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.588+0000 7f1f89b57700 1 -- 172.21.15.70:0/16479657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f841a1d10 con 0x7f1f84103f30 2024-04-26T20:21:49.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.589+0000 7f1f89b57700 1 -- 172.21.15.70:0/16479657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8406a110 con 0x7f1f84103f30 2024-04-26T20:21:49.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.591+0000 7f1f80ff9700 1 -- 172.21.15.70:0/16479657 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f1f7c01c070 con 0x7f1f84103f30 2024-04-26T20:21:49.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.591+0000 7f1f80ff9700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f6c0a3c40 0x7f1f6c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:49.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.591+0000 7f1f837fe700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f6c0a3c40 0x7f1f6c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:49.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.591+0000 7f1f80ff9700 1 -- 172.21.15.70:0/16479657 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4562+0+0 (secure 0 0 0) 0x7f1f7c0ced80 con 0x7f1f84103f30 2024-04-26T20:21:49.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.592+0000 7f1f837fe700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f6c0a3c40 0x7f1f6c0a6100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f841033f0 tx=0x7f1f74009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:49.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.595+0000 7f1f80ff9700 1 -- 172.21.15.70:0/16479657 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1f7c09c600 con 0x7f1f84103f30 2024-04-26T20:21:49.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:21:49.805+0000 7f1f89b57700 1 -- 172.21.15.70:0/16479657 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1f840ffb20 con 0x7f1f6c0a3c40 2024-04-26T20:21:50.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:49 smithi098 ceph-mon[32591]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T20:21:50.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:49 smithi098 ceph-mon[32591]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:21:50.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:49 smithi098 ceph-mon[32591]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:21:50.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:49 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:21:50.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:49 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:21:50.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:49 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:50.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:49 smithi080 ceph-mon[32278]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T20:21:50.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:49 smithi080 ceph-mon[32278]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:21:50.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:49 smithi080 ceph-mon[32278]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:21:50.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:49 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:21:50.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:49 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:21:50.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:49 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:50.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:49 smithi070 ceph-mon[29124]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T20:21:50.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:49 smithi070 ceph-mon[29124]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:21:50.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:49 smithi070 ceph-mon[29124]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:21:50.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:49 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:21:50.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:49 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:21:50.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:49 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:51.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:50 smithi098 ceph-mon[32591]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T20:21:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:50 smithi080 ceph-mon[32278]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T20:21:51.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:50 smithi070 ceph-mon[29124]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T20:21:52.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:51 smithi070 ceph-mon[29124]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T20:21:52.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:51 smithi070 ceph-mon[29124]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:21:52.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:51 smithi098 ceph-mon[32591]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T20:21:52.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:51 smithi098 ceph-mon[32591]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:21:52.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:51 smithi080 ceph-mon[32278]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T20:21:52.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:51 smithi080 ceph-mon[32278]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:21:53.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:52 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3139748645' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e835c1d-2db6-4e95-8300-e6f1d2be9916"}]: dispatch 2024-04-26T20:21:53.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:52 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3139748645' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e835c1d-2db6-4e95-8300-e6f1d2be9916"}]': finished 2024-04-26T20:21:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:52 smithi080 ceph-mon[32278]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T20:21:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:52 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:21:53.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:52 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3139748645' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e835c1d-2db6-4e95-8300-e6f1d2be9916"}]: dispatch 2024-04-26T20:21:53.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:52 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3139748645' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e835c1d-2db6-4e95-8300-e6f1d2be9916"}]': finished 2024-04-26T20:21:53.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:52 smithi070 ceph-mon[29124]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T20:21:53.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:52 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:21:53.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:52 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3139748645' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e835c1d-2db6-4e95-8300-e6f1d2be9916"}]: dispatch 2024-04-26T20:21:53.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:52 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3139748645' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e835c1d-2db6-4e95-8300-e6f1d2be9916"}]': finished 2024-04-26T20:21:53.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:52 smithi098 ceph-mon[32591]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T20:21:53.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:21:54.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:53 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3517650451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:21:54.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:53 smithi080 ceph-mon[32278]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-04-26T20:21:54.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:53 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3517650451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:21:54.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:53 smithi070 ceph-mon[29124]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-04-26T20:21:54.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:53 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3517650451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:21:54.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:53 smithi098 ceph-mon[32591]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-04-26T20:21:57.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:56 smithi098 ceph-mon[32591]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T20:21:57.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:56 smithi080 ceph-mon[32278]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T20:21:57.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:56 smithi070 ceph-mon[29124]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T20:21:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:21:58 smithi098 ceph-mon[32591]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T20:21:59.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:21:58 smithi080 ceph-mon[32278]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T20:21:59.229 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:21:58 smithi070 ceph-mon[29124]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T20:22:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:00 smithi098 ceph-mon[32591]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-26T20:22:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:00 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T20:22:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:00 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:00 smithi080 ceph-mon[32278]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-26T20:22:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:00 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T20:22:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:00 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:01.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:00 smithi070 ceph-mon[29124]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-26T20:22:01.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:00 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T20:22:01.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:00 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:02.170 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:01 smithi070 ceph-mon[29124]: Deploying daemon osd.6 on smithi070 2024-04-26T20:22:02.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:01 smithi098 ceph-mon[32591]: Deploying daemon osd.6 on smithi070 2024-04-26T20:22:02.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:01 smithi080 ceph-mon[32278]: Deploying daemon osd.6 on smithi070 2024-04-26T20:22:02.839 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:02 smithi070 ceph-mon[29124]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:22:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:02 smithi098 ceph-mon[32591]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:22:03.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:02 smithi080 ceph-mon[32278]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:22:05.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:04 smithi070 ceph-mon[29124]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-26T20:22:05.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:04 smithi098 ceph-mon[32591]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-26T20:22:05.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:04 smithi080 ceph-mon[32278]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-26T20:22:07.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:07.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:06 smithi070 ceph-mon[29124]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:07.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:07.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:07.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:07.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:06 smithi098 ceph-mon[32591]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:07.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:07.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:07.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:07.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:06 smithi080 ceph-mon[32278]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:07.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:07.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:08.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:08 smithi070 ceph-mon[29124]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:09.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:08 smithi098 ceph-mon[32591]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:09.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:08 smithi080 ceph-mon[32278]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:09.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.714+0000 7f1f80ff9700 1 -- 172.21.15.70:0/16479657 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1f840ffb20 con 0x7f1f6c0a3c40 2024-04-26T20:22:09.715 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 6 on host 'smithi070' 2024-04-26T20:22:09.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 -- 172.21.15.70:0/16479657 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f6c0a3c40 msgr2=0x7f1f6c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f6c0a3c40 0x7f1f6c0a6100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f841033f0 tx=0x7f1f74009190 comp rx=0 tx=0).stop 2024-04-26T20:22:09.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 -- 172.21.15.70:0/16479657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f84103f30 msgr2=0x7f1f841a0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f84103f30 0x7f1f841a0dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00b9a0 tx=0x7f1f7c00bcb0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 -- 172.21.15.70:0/16479657 shutdown_connections 2024-04-26T20:22:09.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f6c0a3c40 0x7f1f6c0a6100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f84103f30 0x7f1f841a0dc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f84102390 0x7f1f84199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 --2- 172.21.15.70:0/16479657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f84103590 0x7f1f84199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 -- 172.21.15.70:0/16479657 >> 172.21.15.70:0/16479657 conn(0x7f1f840fd950 msgr2=0x7f1f840ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:09.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 -- 172.21.15.70:0/16479657 shutdown_connections 2024-04-26T20:22:09.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:22:09.716+0000 7f1f89b57700 1 -- 172.21.15.70:0/16479657 wait complete. 2024-04-26T20:22:10.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:10.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:10.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:09 smithi070 ceph-mon[29124]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T20:22:10.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:10.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:10.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:10.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:09 smithi098 ceph-mon[32591]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T20:22:10.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:10.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:10.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:10.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:09 smithi080 ceph-mon[32278]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T20:22:10.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:10.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:10.480 DEBUG:teuthology.orchestra.run.smithi070:osd.6> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.6.service 2024-04-26T20:22:10.483 INFO:tasks.cephadm:Deploying osd.7 on smithi080 with /dev/vg_nvme/lv_2... 2024-04-26T20:22:10.483 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T20:22:10.804 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:22:11.069 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:10 smithi080 ceph-mon[32278]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:11.069 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:10 smithi080 ceph-mon[32278]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T20:22:11.069 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:10 smithi080 ceph-mon[32278]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T20:22:11.069 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:10 smithi080 ceph-mon[32278]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:22:11.069 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:11.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:10 smithi098 ceph-mon[32591]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:11.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:10 smithi098 ceph-mon[32591]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T20:22:11.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:10 smithi098 ceph-mon[32591]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T20:22:11.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:10 smithi098 ceph-mon[32591]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:22:11.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:11.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:10 smithi070 ceph-mon[29124]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:11.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:10 smithi070 ceph-mon[29124]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T20:22:11.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:10 smithi070 ceph-mon[29124]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T20:22:11.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:10 smithi070 ceph-mon[29124]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:22:11.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:11.535 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:22:11 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:22:11.243+0000 7f93dcc9e700 -1 osd.6 0 waiting for initial osdmap 2024-04-26T20:22:11.535 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:22:11 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:22:11.253+0000 7f93d4a89700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:22:11.942 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:11 smithi070 ceph-mon[29124]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:22:11.942 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:11 smithi070 ceph-mon[29124]: osdmap e46: 7 total, 6 up, 7 in 2024-04-26T20:22:11.942 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:11 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:11.942 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:11 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:11.943 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:11 smithi070 ceph-mon[29124]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' 2024-04-26T20:22:12.159 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:11 smithi080 ceph-mon[32278]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:22:12.160 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:11 smithi080 ceph-mon[32278]: osdmap e46: 7 total, 6 up, 7 in 2024-04-26T20:22:12.160 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:11 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:12.160 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:11 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:12.160 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:11 smithi080 ceph-mon[32278]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' 2024-04-26T20:22:12.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:11 smithi098 ceph-mon[32591]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:22:12.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:11 smithi098 ceph-mon[32591]: osdmap e46: 7 total, 6 up, 7 in 2024-04-26T20:22:12.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:11 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:12.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:11 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:12.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:11 smithi098 ceph-mon[32591]: from='osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691]' entity='osd.6' 2024-04-26T20:22:12.968 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T20:22:12.968 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T20:22:12.968 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-26T20:22:12.968 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-26T20:22:12.968 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114888 s, 913 MB/s 2024-04-26T20:22:12.968 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-26T20:22:13.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:12 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:22:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:12 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:22:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:12 smithi098 ceph-mon[32591]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:12 smithi098 ceph-mon[32591]: osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691] boot 2024-04-26T20:22:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:12 smithi098 ceph-mon[32591]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T20:22:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:13.217 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:12 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:22:13.217 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:12 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:22:13.217 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:12 smithi070 ceph-mon[29124]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:13.217 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:13.217 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:12 smithi070 ceph-mon[29124]: osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691] boot 2024-04-26T20:22:13.217 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:12 smithi070 ceph-mon[29124]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T20:22:13.217 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:12 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:22:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:12 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:22:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:12 smithi080 ceph-mon[32278]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:22:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:12 smithi080 ceph-mon[32278]: osd.6 [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691] boot 2024-04-26T20:22:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:12 smithi080 ceph-mon[32278]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T20:22:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:22:13.682 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_2 2024-04-26T20:22:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:22:14.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: osdmap e48: 7 total, 7 up, 7 in 2024-04-26T20:22:14.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi070 2024-04-26T20:22:14.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:14.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:14.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:14.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi070 to 5696M 2024-04-26T20:22:14.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:14.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:14.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.536 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:14 smithi070 ceph-mon[29124]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:14.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: osdmap e48: 7 total, 7 up, 7 in 2024-04-26T20:22:14.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi070 2024-04-26T20:22:14.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:14.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:14.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:14.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi070 to 5696M 2024-04-26T20:22:14.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:14.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:14.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:14 smithi098 ceph-mon[32591]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: osdmap e48: 7 total, 7 up, 7 in 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi070 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi070 to 5696M 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:14.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:14.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:14 smithi080 ceph-mon[32278]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:15.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.639+0000 7f35b99ff700 1 -- 172.21.15.80:0/548192904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b41034e0 msgr2=0x7f35b4103940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.639+0000 7f35b99ff700 1 --2- 172.21.15.80:0/548192904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b41034e0 0x7f35b4103940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009920 tx=0x7f35a8009c30 comp rx=0 tx=0).stop 2024-04-26T20:22:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.639+0000 7f35b99ff700 1 -- 172.21.15.80:0/548192904 shutdown_connections 2024-04-26T20:22:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.639+0000 7f35b99ff700 1 --2- 172.21.15.80:0/548192904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35b4103e80 0x7f35b410a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.639+0000 7f35b99ff700 1 --2- 172.21.15.80:0/548192904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35b41022e0 0x7f35b4102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.639+0000 7f35b99ff700 1 --2- 172.21.15.80:0/548192904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b41034e0 0x7f35b4103940 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.639+0000 7f35b99ff700 1 -- 172.21.15.80:0/548192904 >> 172.21.15.80:0/548192904 conn(0x7f35b40fd880 msgr2=0x7f35b40ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.639+0000 7f35b99ff700 1 -- 172.21.15.80:0/548192904 shutdown_connections 2024-04-26T20:22:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.639+0000 7f35b99ff700 1 -- 172.21.15.80:0/548192904 wait complete. 2024-04-26T20:22:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b99ff700 1 Processor -- start 2024-04-26T20:22:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b99ff700 1 -- start start 2024-04-26T20:22:15.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b99ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b41022e0 0x7f35b4199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b99ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35b41034e0 0x7f35b4199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b99ff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35b4103e80 0x7f35b41a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b99ff700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f35b410ded0 con 0x7f35b4103e80 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b99ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f35b410dd50 con 0x7f35b41022e0 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b99ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f35b410e050 con 0x7f35b41034e0 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b41022e0 0x7f35b4199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b41022e0 0x7f35b4199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55842/0 (socket says 172.21.15.80:55842) 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b2ffd700 1 -- 172.21.15.80:0/2879217827 learned_addr learned my addr 172.21.15.80:0/2879217827 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b27fc700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35b41034e0 0x7f35b4199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b37fe700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35b4103e80 0x7f35b41a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b2ffd700 1 -- 172.21.15.80:0/2879217827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35b41034e0 msgr2=0x7f35b4199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:15.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b2ffd700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35b41034e0 0x7f35b4199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b2ffd700 1 -- 172.21.15.80:0/2879217827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35b4103e80 msgr2=0x7f35b41a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b2ffd700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35b4103e80 0x7f35b41a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b2ffd700 1 -- 172.21.15.80:0/2879217827 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b41a1280 con 0x7f35b41022e0 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.640+0000 7f35b37fe700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35b4103e80 0x7f35b41a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.641+0000 7f35b2ffd700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b41022e0 0x7f35b4199620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f35a400e9f0 tx=0x7f35a400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.641+0000 7f35b89fd700 1 -- 172.21.15.80:0/2879217827 <== mon.2 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4004220 con 0x7f35b41022e0 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.641+0000 7f35b89fd700 1 -- 172.21.15.80:0/2879217827 <== mon.2 v2:172.21.15.80:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f35a40043c0 con 0x7f35b41022e0 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.641+0000 7f35b99ff700 1 -- 172.21.15.80:0/2879217827 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b41a1570 con 0x7f35b41022e0 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.641+0000 7f35b89fd700 1 -- 172.21.15.80:0/2879217827 <== mon.2 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4003d60 con 0x7f35b41022e0 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.641+0000 7f35b99ff700 1 -- 172.21.15.80:0/2879217827 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b41a1ab0 con 0x7f35b41022e0 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.642+0000 7f35b99ff700 1 -- 172.21.15.80:0/2879217827 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b406a110 con 0x7f35b41022e0 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.643+0000 7f35b89fd700 1 -- 172.21.15.80:0/2879217827 <== mon.2 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f35a400c7c0 con 0x7f35b41022e0 2024-04-26T20:22:15.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.643+0000 7f35b89fd700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f359c0a3c40 0x7f359c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:15.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.643+0000 7f35b89fd700 1 -- 172.21.15.80:0/2879217827 <== mon.2 v2:172.21.15.80:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4965+0+0 (secure 0 0 0) 0x7f35a40cfaf0 con 0x7f35b41022e0 2024-04-26T20:22:15.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.644+0000 7f35b27fc700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f359c0a3c40 0x7f359c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:15.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.644+0000 7f35b27fc700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f359c0a3c40 0x7f359c0a6100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35a800fbf0 tx=0x7f35a8019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:15.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.648+0000 7f35b89fd700 1 -- 172.21.15.80:0/2879217827 <== mon.2 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f35a4016330 con 0x7f35b41022e0 2024-04-26T20:22:15.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:15.856+0000 7f35b99ff700 1 -- 172.21.15.80:0/2879217827 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f35b41a1d10 con 0x7f359c0a3c40 2024-04-26T20:22:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:16 smithi098 ceph-mon[32591]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:16 smithi098 ceph-mon[32591]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:16 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:22:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:16 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:22:17.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:16 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:16 smithi080 ceph-mon[32278]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:16 smithi080 ceph-mon[32278]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:16 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:22:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:16 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:22:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:16 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:17.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:16 smithi070 ceph-mon[29124]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:16 smithi070 ceph-mon[29124]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:16 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:22:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:16 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:22:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:16 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:18 smithi098 ceph-mon[32591]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:19.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:18 smithi098 ceph-mon[32591]: from='client.? 172.21.15.80:0/1661198986' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be9f0075-a715-4f28-b180-061b1a7633ba"}]: dispatch 2024-04-26T20:22:19.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:18 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be9f0075-a715-4f28-b180-061b1a7633ba"}]: dispatch 2024-04-26T20:22:19.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:18 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be9f0075-a715-4f28-b180-061b1a7633ba"}]': finished 2024-04-26T20:22:19.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:18 smithi098 ceph-mon[32591]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T20:22:19.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:18 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:18 smithi080 ceph-mon[32278]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:18 smithi080 ceph-mon[32278]: from='client.? 172.21.15.80:0/1661198986' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be9f0075-a715-4f28-b180-061b1a7633ba"}]: dispatch 2024-04-26T20:22:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:18 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be9f0075-a715-4f28-b180-061b1a7633ba"}]: dispatch 2024-04-26T20:22:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:18 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be9f0075-a715-4f28-b180-061b1a7633ba"}]': finished 2024-04-26T20:22:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:18 smithi080 ceph-mon[32278]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T20:22:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:18 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:18 smithi070 ceph-mon[29124]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:18 smithi070 ceph-mon[29124]: from='client.? 172.21.15.80:0/1661198986' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be9f0075-a715-4f28-b180-061b1a7633ba"}]: dispatch 2024-04-26T20:22:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:18 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be9f0075-a715-4f28-b180-061b1a7633ba"}]: dispatch 2024-04-26T20:22:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:18 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be9f0075-a715-4f28-b180-061b1a7633ba"}]': finished 2024-04-26T20:22:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:18 smithi070 ceph-mon[29124]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T20:22:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:18 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:20.110 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:19 smithi098 ceph-mon[32591]: from='client.? 172.21.15.80:0/71345784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:22:20.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:19 smithi080 ceph-mon[32278]: from='client.? 172.21.15.80:0/71345784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:22:20.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:19 smithi070 ceph-mon[29124]: from='client.? 172.21.15.80:0/71345784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:22:21.136 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:20 smithi080 ceph-mon[32278]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:21.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:20 smithi098 ceph-mon[32591]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:21.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:20 smithi070 ceph-mon[29124]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:22.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:22 smithi080 ceph-mon[32278]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:23.087 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:22 smithi070 ceph-mon[29124]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:23.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:22 smithi098 ceph-mon[32591]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:24.847 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:24 smithi080 ceph-mon[32278]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:25.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:24 smithi098 ceph-mon[32591]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:25.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:24 smithi070 ceph-mon[29124]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:26.899 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:26 smithi080 ceph-mon[32278]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:26.899 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:26 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T20:22:26.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:26 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:26 smithi098 ceph-mon[32591]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:26 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T20:22:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:26 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:26 smithi070 ceph-mon[29124]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:26 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T20:22:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:26 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:27.959 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:27 smithi080 ceph-mon[32278]: Deploying daemon osd.7 on smithi080 2024-04-26T20:22:28.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:27 smithi098 ceph-mon[32591]: Deploying daemon osd.7 on smithi080 2024-04-26T20:22:28.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:27 smithi070 ceph-mon[29124]: Deploying daemon osd.7 on smithi080 2024-04-26T20:22:28.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:28 smithi080 ceph-mon[32278]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:29.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:28 smithi098 ceph-mon[32591]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:29.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:28 smithi070 ceph-mon[29124]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:31.167 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:30 smithi080 ceph-mon[32278]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:30 smithi098 ceph-mon[32591]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:31.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:30 smithi070 ceph-mon[29124]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:33.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:32 smithi070 ceph-mon[29124]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:33.091 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:32 smithi080 ceph-mon[32278]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:33.091 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:33.091 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:33.091 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:32 smithi098 ceph-mon[32591]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:34.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:34 smithi080 ceph-mon[32278]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:34.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:34.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:34.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:34.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:34.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:34 smithi070 ceph-mon[29124]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:35.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:34 smithi098 ceph-mon[32591]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:35.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:35.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:35.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:35.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.674+0000 7f35b89fd700 1 -- 172.21.15.80:0/2879217827 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f35b41a1d10 con 0x7f359c0a3c40 2024-04-26T20:22:35.675 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 7 on host 'smithi080' 2024-04-26T20:22:35.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 -- 172.21.15.80:0/2879217827 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f359c0a3c40 msgr2=0x7f359c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f359c0a3c40 0x7f359c0a6100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35a800fbf0 tx=0x7f35a8019040 comp rx=0 tx=0).stop 2024-04-26T20:22:35.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 -- 172.21.15.80:0/2879217827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b41022e0 msgr2=0x7f35b4199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b41022e0 0x7f35b4199620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f35a400e9f0 tx=0x7f35a400ed00 comp rx=0 tx=0).stop 2024-04-26T20:22:35.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 -- 172.21.15.80:0/2879217827 shutdown_connections 2024-04-26T20:22:35.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f359c0a3c40 0x7f359c0a6100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35b4103e80 0x7f35b41a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35b41022e0 0x7f35b4199620 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 --2- 172.21.15.80:0/2879217827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35b41034e0 0x7f35b4199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 -- 172.21.15.80:0/2879217827 >> 172.21.15.80:0/2879217827 conn(0x7f35b40fd880 msgr2=0x7f35b40ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:35.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 -- 172.21.15.80:0/2879217827 shutdown_connections 2024-04-26T20:22:35.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:22:35.677+0000 7f35b99ff700 1 -- 172.21.15.80:0/2879217827 wait complete. 2024-04-26T20:22:35.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:35 smithi080 ceph-mon[32278]: from='osd.7 [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:22:35.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:35 smithi080 ceph-mon[32278]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:22:35.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:35.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:35.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:36.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:35 smithi070 ceph-mon[29124]: from='osd.7 [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:22:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:35 smithi070 ceph-mon[29124]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:22:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:35 smithi098 ceph-mon[32591]: from='osd.7 [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:22:36.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:35 smithi098 ceph-mon[32591]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:22:36.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:36.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:36.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:36.360 DEBUG:teuthology.orchestra.run.smithi080:osd.7> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.7.service 2024-04-26T20:22:36.363 INFO:tasks.cephadm:Deploying osd.8 on smithi098 with /dev/vg_nvme/lv_2... 2024-04-26T20:22:36.363 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T20:22:36.614 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:22:36.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:36 smithi080 ceph-mon[32278]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:36.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:36 smithi080 ceph-mon[32278]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T20:22:36.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:36 smithi080 ceph-mon[32278]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T20:22:36.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:36 smithi080 ceph-mon[32278]: from='osd.7 [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:22:36.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:36 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:36.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:36 smithi080 ceph-mon[32278]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:22:37.013 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:36 smithi098 ceph-mon[32591]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:37.013 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:36 smithi098 ceph-mon[32591]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T20:22:37.013 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:36 smithi098 ceph-mon[32591]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T20:22:37.013 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:36 smithi098 ceph-mon[32591]: from='osd.7 [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:22:37.013 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:36 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:37.013 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:36 smithi098 ceph-mon[32591]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:22:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:36 smithi070 ceph-mon[29124]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:36 smithi070 ceph-mon[29124]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T20:22:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:36 smithi070 ceph-mon[29124]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T20:22:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:36 smithi070 ceph-mon[29124]: from='osd.7 [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:22:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:36 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:36 smithi070 ceph-mon[29124]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:22:37.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:22:37 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:22:37.187+0000 7f16784bc700 -1 osd.7 0 waiting for initial osdmap 2024-04-26T20:22:37.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:22:37 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:22:37.200+0000 7f16702a7700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:22:38.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:37 smithi070 ceph-mon[29124]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:22:38.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:37 smithi070 ceph-mon[29124]: osdmap e51: 8 total, 7 up, 8 in 2024-04-26T20:22:38.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:37 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:38.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:37 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:38.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:37 smithi070 ceph-mon[29124]: from='osd.7 ' entity='osd.7' 2024-04-26T20:22:38.056 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:37 smithi080 ceph-mon[32278]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:22:38.056 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:37 smithi080 ceph-mon[32278]: osdmap e51: 8 total, 7 up, 8 in 2024-04-26T20:22:38.056 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:37 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:38.056 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:37 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:38.056 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:37 smithi080 ceph-mon[32278]: from='osd.7 ' entity='osd.7' 2024-04-26T20:22:38.065 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:37 smithi098 ceph-mon[32591]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:22:38.065 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:37 smithi098 ceph-mon[32591]: osdmap e51: 8 total, 7 up, 8 in 2024-04-26T20:22:38.065 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:37 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:38.065 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:37 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:38.065 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:37 smithi098 ceph-mon[32591]: from='osd.7 ' entity='osd.7' 2024-04-26T20:22:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T20:22:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T20:22:38.626 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10+0 records in 2024-04-26T20:22:38.626 INFO:teuthology.orchestra.run.smithi098.stderr:10+0 records out 2024-04-26T20:22:38.626 INFO:teuthology.orchestra.run.smithi098.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114107 s, 919 MB/s 2024-04-26T20:22:38.626 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping successful for: 2024-04-26T20:22:38.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:38 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:22:38.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:38 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:22:38.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:38 smithi080 ceph-mon[32278]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:38.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:38 smithi080 ceph-mon[32278]: osd.7 [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895] boot 2024-04-26T20:22:38.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:38 smithi080 ceph-mon[32278]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T20:22:38.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:38.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:38 smithi080 ceph-mon[32278]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T20:22:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:38 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:22:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:38 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:22:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:38 smithi098 ceph-mon[32591]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:38 smithi098 ceph-mon[32591]: osd.7 [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895] boot 2024-04-26T20:22:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:38 smithi098 ceph-mon[32591]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T20:22:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:38 smithi098 ceph-mon[32591]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T20:22:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:38 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:22:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:38 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:22:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:38 smithi070 ceph-mon[29124]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:22:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:38 smithi070 ceph-mon[29124]: osd.7 [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895] boot 2024-04-26T20:22:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:38 smithi070 ceph-mon[29124]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T20:22:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:22:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:38 smithi070 ceph-mon[29124]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T20:22:39.350 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_2 2024-04-26T20:22:39.591 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:22:40.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T20:22:40.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi080 2024-04-26T20:22:40.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:40.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:40.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:40.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi080 to 5696M 2024-04-26T20:22:40.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:40.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:40.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:39 smithi098 ceph-mon[32591]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:40.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T20:22:40.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi080 2024-04-26T20:22:40.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:40.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:40.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:40.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi080 to 5696M 2024-04-26T20:22:40.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:40.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:40.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:39 smithi080 ceph-mon[32278]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:40.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T20:22:40.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi080 2024-04-26T20:22:40.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi080 to 5696M 2024-04-26T20:22:40.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:40.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:40.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:40.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:39 smithi070 ceph-mon[29124]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:41.071 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:40 smithi098 ceph-mon[32591]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T20:22:41.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:40 smithi070 ceph-mon[29124]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T20:22:41.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.293+0000 7f3d37204700 1 -- 172.21.15.98:0/2086006096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d301035a0 msgr2=0x7f3d30103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.293+0000 7f3d37204700 1 --2- 172.21.15.98:0/2086006096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d301035a0 0x7f3d30103a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c009990 tx=0x7f3d1c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.293+0000 7f3d37204700 1 -- 172.21.15.98:0/2086006096 shutdown_connections 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.293+0000 7f3d37204700 1 --2- 172.21.15.98:0/2086006096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d30103f40 0x7f3d3010a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.293+0000 7f3d37204700 1 --2- 172.21.15.98:0/2086006096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d301023a0 0x7f3d301027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.293+0000 7f3d37204700 1 --2- 172.21.15.98:0/2086006096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d301035a0 0x7f3d30103a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.293+0000 7f3d37204700 1 -- 172.21.15.98:0/2086006096 >> 172.21.15.98:0/2086006096 conn(0x7f3d300fd980 msgr2=0x7f3d300ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.293+0000 7f3d37204700 1 -- 172.21.15.98:0/2086006096 shutdown_connections 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.293+0000 7f3d37204700 1 -- 172.21.15.98:0/2086006096 wait complete. 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.293+0000 7f3d37204700 1 Processor -- start 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.293+0000 7f3d37204700 1 -- start start 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d37204700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d301023a0 0x7f3d3006c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d37204700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d301035a0 0x7f3d3019e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d37204700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d30103f40 0x7f3d301a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d37204700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3010df70 con 0x7f3d301023a0 2024-04-26T20:22:41.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d37204700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3010ddf0 con 0x7f3d30103f40 2024-04-26T20:22:41.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d37204700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3010e0f0 con 0x7f3d301035a0 2024-04-26T20:22:41.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d301035a0 0x7f3d3019e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d301035a0 0x7f3d3019e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38000/0 (socket says 172.21.15.98:38000) 2024-04-26T20:22:41.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2ffff700 1 -- 172.21.15.98:0/1987130594 learned_addr learned my addr 172.21.15.98:0/1987130594 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-04-26T20:22:41.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d357a1700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d30103f40 0x7f3d301a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d34fa0700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d301023a0 0x7f3d3006c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2ffff700 1 -- 172.21.15.98:0/1987130594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d30103f40 msgr2=0x7f3d301a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2ffff700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d30103f40 0x7f3d301a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2ffff700 1 -- 172.21.15.98:0/1987130594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d301023a0 msgr2=0x7f3d3006c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2ffff700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d301023a0 0x7f3d3006c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2ffff700 1 -- 172.21.15.98:0/1987130594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d301a12a0 con 0x7f3d301035a0 2024-04-26T20:22:41.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d34fa0700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d301023a0 0x7f3d3006c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:41.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2ffff700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d301035a0 0x7f3d3019e380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c000c00 tx=0x7f3d1c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2dffb700 1 -- 172.21.15.98:0/1987130594 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c026070 con 0x7f3d301035a0 2024-04-26T20:22:41.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d37204700 1 -- 172.21.15.98:0/1987130594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d301a1530 con 0x7f3d301035a0 2024-04-26T20:22:41.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2dffb700 1 -- 172.21.15.98:0/1987130594 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d1c00fe20 con 0x7f3d301035a0 2024-04-26T20:22:41.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.294+0000 7f3d2dffb700 1 -- 172.21.15.98:0/1987130594 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c017650 con 0x7f3d301035a0 2024-04-26T20:22:41.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.295+0000 7f3d37204700 1 -- 172.21.15.98:0/1987130594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d301a19e0 con 0x7f3d301035a0 2024-04-26T20:22:41.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.295+0000 7f3d37204700 1 -- 172.21.15.98:0/1987130594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3006a110 con 0x7f3d301035a0 2024-04-26T20:22:41.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.297+0000 7f3d2dffb700 1 -- 172.21.15.98:0/1987130594 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f3d1c029070 con 0x7f3d301035a0 2024-04-26T20:22:41.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.297+0000 7f3d2dffb700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3d200a3c40 0x7f3d200a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.297+0000 7f3d2dffb700 1 -- 172.21.15.98:0/1987130594 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5397+0+0 (secure 0 0 0) 0x7f3d1c0d0ba0 con 0x7f3d301035a0 2024-04-26T20:22:41.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.298+0000 7f3d34fa0700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3d200a3c40 0x7f3d200a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.298+0000 7f3d34fa0700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3d200a3c40 0x7f3d200a6100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3d30103400 tx=0x7f3d24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.301+0000 7f3d2dffb700 1 -- 172.21.15.98:0/1987130594 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f3d1c030070 con 0x7f3d301035a0 2024-04-26T20:22:41.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:40 smithi080 ceph-mon[32278]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T20:22:41.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:22:41.506+0000 7f3d37204700 1 -- 172.21.15.98:0/1987130594 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3d30063920 con 0x7f3d200a3c40 2024-04-26T20:22:42.253 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:41 smithi098 ceph-mon[32591]: osdmap e56: 8 total, 8 up, 8 in 2024-04-26T20:22:42.253 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:41 smithi098 ceph-mon[32591]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:42.254 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:41 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:22:42.254 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:41 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:22:42.254 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:41 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:42.254 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:41 smithi098 ceph-mon[32591]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:42.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:41 smithi070 ceph-mon[29124]: osdmap e56: 8 total, 8 up, 8 in 2024-04-26T20:22:42.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:41 smithi070 ceph-mon[29124]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:42.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:41 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:22:42.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:41 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:22:42.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:41 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:42.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:41 smithi070 ceph-mon[29124]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:42.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:41 smithi080 ceph-mon[32278]: osdmap e56: 8 total, 8 up, 8 in 2024-04-26T20:22:42.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:41 smithi080 ceph-mon[32278]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:42.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:41 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:22:42.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:41 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:22:42.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:41 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:42.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:41 smithi080 ceph-mon[32278]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:44.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:44 smithi098 ceph-mon[32591]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:44.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:44 smithi098 ceph-mon[32591]: from='client.? 172.21.15.98:0/4100817945' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de51eb21-8654-4d96-b398-0059d86c9580"}]: dispatch 2024-04-26T20:22:44.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:44 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de51eb21-8654-4d96-b398-0059d86c9580"}]: dispatch 2024-04-26T20:22:44.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:44 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de51eb21-8654-4d96-b398-0059d86c9580"}]': finished 2024-04-26T20:22:44.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:44 smithi098 ceph-mon[32591]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T20:22:44.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:22:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:44 smithi080 ceph-mon[32278]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:44 smithi080 ceph-mon[32278]: from='client.? 172.21.15.98:0/4100817945' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de51eb21-8654-4d96-b398-0059d86c9580"}]: dispatch 2024-04-26T20:22:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:44 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de51eb21-8654-4d96-b398-0059d86c9580"}]: dispatch 2024-04-26T20:22:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:44 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de51eb21-8654-4d96-b398-0059d86c9580"}]': finished 2024-04-26T20:22:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:44 smithi080 ceph-mon[32278]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T20:22:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:22:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:44 smithi070 ceph-mon[29124]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:44 smithi070 ceph-mon[29124]: from='client.? 172.21.15.98:0/4100817945' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de51eb21-8654-4d96-b398-0059d86c9580"}]: dispatch 2024-04-26T20:22:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:44 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de51eb21-8654-4d96-b398-0059d86c9580"}]: dispatch 2024-04-26T20:22:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:44 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de51eb21-8654-4d96-b398-0059d86c9580"}]': finished 2024-04-26T20:22:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:44 smithi070 ceph-mon[29124]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T20:22:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:22:46.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:45 smithi098 ceph-mon[32591]: from='client.? 172.21.15.98:0/2457587326' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:22:46.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:45 smithi080 ceph-mon[32278]: from='client.? 172.21.15.98:0/2457587326' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:22:46.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:45 smithi070 ceph-mon[29124]: from='client.? 172.21.15.98:0/2457587326' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:22:47.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:46 smithi098 ceph-mon[32591]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:47.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:46 smithi080 ceph-mon[32278]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:47.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:46 smithi070 ceph-mon[29124]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:48.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:48 smithi098 ceph-mon[32591]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:49.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:48 smithi080 ceph-mon[32278]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:49.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:48 smithi070 ceph-mon[29124]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:50 smithi098 ceph-mon[32591]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:50 smithi080 ceph-mon[32278]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:51.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:50 smithi070 ceph-mon[29124]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:51.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:51 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T20:22:51.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:51 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:52.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:51 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T20:22:52.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:51 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:52.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:51 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T20:22:52.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:51 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:52.818 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:52 smithi098 ceph-mon[32591]: Deploying daemon osd.8 on smithi098 2024-04-26T20:22:52.818 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:52 smithi098 ceph-mon[32591]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:52 smithi080 ceph-mon[32278]: Deploying daemon osd.8 on smithi098 2024-04-26T20:22:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:52 smithi080 ceph-mon[32278]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:53.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:52 smithi070 ceph-mon[29124]: Deploying daemon osd.8 on smithi098 2024-04-26T20:22:53.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:52 smithi070 ceph-mon[29124]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:55.126 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:54 smithi098 ceph-mon[32591]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:55.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:54 smithi080 ceph-mon[32278]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:55.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:54 smithi070 ceph-mon[29124]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:56.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:56 smithi098 ceph-mon[32591]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:57.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:56 smithi080 ceph-mon[32278]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:57.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:56 smithi070 ceph-mon[29124]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:58.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:58.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:58.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:58.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:22:58 smithi098 ceph-mon[32591]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:58.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:58.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:58.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:58.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:22:58 smithi080 ceph-mon[32278]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:22:59.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:59.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:22:59.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:59.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:22:58 smithi070 ceph-mon[29124]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:23:01.067 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:00 smithi098 ceph-mon[32591]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 8 on host 'smithi098' 2024-04-26T20:23:01.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.125+0000 7f3d2dffb700 1 -- 172.21.15.98:0/1987130594 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3d30063920 con 0x7f3d200a3c40 2024-04-26T20:23:01.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 -- 172.21.15.98:0/1987130594 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3d200a3c40 msgr2=0x7f3d200a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3d200a3c40 0x7f3d200a6100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3d30103400 tx=0x7f3d24009260 comp rx=0 tx=0).stop 2024-04-26T20:23:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 -- 172.21.15.98:0/1987130594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d301035a0 msgr2=0x7f3d3019e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d301035a0 0x7f3d3019e380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c000c00 tx=0x7f3d1c00f690 comp rx=0 tx=0).stop 2024-04-26T20:23:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 -- 172.21.15.98:0/1987130594 shutdown_connections 2024-04-26T20:23:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3d200a3c40 0x7f3d200a6100 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d30103f40 0x7f3d301a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d301023a0 0x7f3d3006c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 --2- 172.21.15.98:0/1987130594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d301035a0 0x7f3d3019e380 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 -- 172.21.15.98:0/1987130594 >> 172.21.15.98:0/1987130594 conn(0x7f3d300fd980 msgr2=0x7f3d301068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 -- 172.21.15.98:0/1987130594 shutdown_connections 2024-04-26T20:23:01.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:01.128+0000 7f3d37204700 1 -- 172.21.15.98:0/1987130594 wait complete. 2024-04-26T20:23:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:00 smithi080 ceph-mon[32278]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:23:01.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:00 smithi070 ceph-mon[29124]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:23:01.805 DEBUG:teuthology.orchestra.run.smithi098:osd.8> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.8.service 2024-04-26T20:23:01.808 INFO:tasks.cephadm:Deploying osd.9 on smithi070 with /dev/vg_nvme/lv_1... 2024-04-26T20:23:01.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T20:23:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:23:02.447 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:02.447 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:02.447 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:02 smithi070 ceph-mon[29124]: from='osd.8 [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:23:02.448 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:02 smithi070 ceph-mon[29124]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:23:02.448 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:02 smithi070 ceph-mon[29124]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:23:02.448 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:02.448 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:02.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:02.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:02.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:02 smithi098 ceph-mon[32591]: from='osd.8 [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:23:02.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:02 smithi098 ceph-mon[32591]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:23:02.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:02 smithi098 ceph-mon[32591]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:23:02.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:02.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:02.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:02.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:02 smithi080 ceph-mon[32278]: from='osd.8 [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:23:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:02 smithi080 ceph-mon[32278]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:23:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:02 smithi080 ceph-mon[32278]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:23:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:03 smithi098 ceph-mon[32591]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T20:23:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:03 smithi098 ceph-mon[32591]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T20:23:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:03 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:03.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:03 smithi098 ceph-mon[32591]: from='osd.8 [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:23:03.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:03 smithi098 ceph-mon[32591]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:23:03.209 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:23:03 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:23:03.120+0000 7f8dff938700 -1 osd.8 0 waiting for initial osdmap 2024-04-26T20:23:03.209 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:23:03 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:23:03.132+0000 7f8dfb72b700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:23:03.435 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:03 smithi070 ceph-mon[29124]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T20:23:03.435 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:03 smithi070 ceph-mon[29124]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T20:23:03.435 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:03 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:03.435 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:03 smithi070 ceph-mon[29124]: from='osd.8 [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:23:03.435 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:03 smithi070 ceph-mon[29124]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:23:03.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:03 smithi080 ceph-mon[32278]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T20:23:03.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:03 smithi080 ceph-mon[32278]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T20:23:03.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:03 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:03.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:03 smithi080 ceph-mon[32278]: from='osd.8 [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:23:03.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:03 smithi080 ceph-mon[32278]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:23:04.123 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T20:23:04.124 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T20:23:04.124 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2024-04-26T20:23:04.124 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2024-04-26T20:23:04.124 INFO:teuthology.orchestra.run.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00878154 s, 1.2 GB/s 2024-04-26T20:23:04.124 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2024-04-26T20:23:04.422 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:04 smithi070 ceph-mon[29124]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:23:04.422 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:04 smithi070 ceph-mon[29124]: osdmap e59: 9 total, 8 up, 9 in 2024-04-26T20:23:04.422 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:04.422 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:04.423 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:04 smithi070 ceph-mon[29124]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:23:04.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:04 smithi098 ceph-mon[32591]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:23:04.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:04 smithi098 ceph-mon[32591]: osdmap e59: 9 total, 8 up, 9 in 2024-04-26T20:23:04.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:04.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:04.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:04 smithi098 ceph-mon[32591]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:23:04.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:04 smithi080 ceph-mon[32278]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:23:04.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:04 smithi080 ceph-mon[32278]: osdmap e59: 9 total, 8 up, 9 in 2024-04-26T20:23:04.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:04.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:04.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:04 smithi080 ceph-mon[32278]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:23:04.762 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_1 2024-04-26T20:23:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:23:05.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:05 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:23:05.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:05 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:23:05.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:05 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:05.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:05 smithi070 ceph-mon[29124]: osd.8 [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700] boot 2024-04-26T20:23:05.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:05 smithi070 ceph-mon[29124]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T20:23:05.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:05 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:05.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:05 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:23:05.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:05 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:23:05.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:05 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:05.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:05 smithi098 ceph-mon[32591]: osd.8 [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700] boot 2024-04-26T20:23:05.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:05 smithi098 ceph-mon[32591]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T20:23:05.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:05 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:05.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:05 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:23:05.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:05 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:23:05.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:05 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:05.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:05 smithi080 ceph-mon[32278]: osd.8 [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700] boot 2024-04-26T20:23:05.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:05 smithi080 ceph-mon[32278]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T20:23:05.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:05 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:23:06.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T20:23:06.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi098 2024-04-26T20:23:06.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:06.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:06.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:06.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi098 to 5696M 2024-04-26T20:23:06.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:06.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:06.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:06.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:06.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:06.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:06.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:06 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi098 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi098 to 5696M 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:06.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:06.460 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:06 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi098 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi098 to 5696M 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:06.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:06.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:06.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:06.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:06.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:06 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:06.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.591+0000 7f05245f8700 1 -- 172.21.15.70:0/2064373244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f051c103480 msgr2=0x7f051c1038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:06.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.591+0000 7f05245f8700 1 --2- 172.21.15.70:0/2064373244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f051c103480 0x7f051c1038a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f051800b0d0 tx=0x7f051800b3e0 comp rx=0 tx=0).stop 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.591+0000 7f05245f8700 1 -- 172.21.15.70:0/2064373244 shutdown_connections 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.591+0000 7f05245f8700 1 --2- 172.21.15.70:0/2064373244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f051c105020 0x7f051c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.591+0000 7f05245f8700 1 --2- 172.21.15.70:0/2064373244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f051c103480 0x7f051c1038a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.591+0000 7f05245f8700 1 --2- 172.21.15.70:0/2064373244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f051c104680 0x7f051c104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.591+0000 7f05245f8700 1 -- 172.21.15.70:0/2064373244 >> 172.21.15.70:0/2064373244 conn(0x7f051c0fea20 msgr2=0x7f051c100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.591+0000 7f05245f8700 1 -- 172.21.15.70:0/2064373244 shutdown_connections 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.591+0000 7f05245f8700 1 -- 172.21.15.70:0/2064373244 wait complete. 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f05245f8700 1 Processor -- start 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f05245f8700 1 -- start start 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f05245f8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f051c103480 0x7f051c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f05245f8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f051c104680 0x7f051c199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f05245f8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f051c105020 0x7f051c1a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:06.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f05245f8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f051c10f070 con 0x7f051c103480 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f05245f8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f051c10eef0 con 0x7f051c105020 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f05245f8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f051c10f1f0 con 0x7f051c104680 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f0522394700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f051c103480 0x7f051c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f0522394700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f051c103480 0x7f051c199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36026/0 (socket says 172.21.15.70:36026) 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f0522394700 1 -- 172.21.15.70:0/3928490874 learned_addr learned my addr 172.21.15.70:0/3928490874 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f0521b93700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f051c104680 0x7f051c199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f0522394700 1 -- 172.21.15.70:0/3928490874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f051c104680 msgr2=0x7f051c199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f0522394700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f051c104680 0x7f051c199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f0522394700 1 -- 172.21.15.70:0/3928490874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f051c105020 msgr2=0x7f051c1a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f0522394700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f051c105020 0x7f051c1a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f0522394700 1 -- 172.21.15.70:0/3928490874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c1a12d0 con 0x7f051c103480 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.592+0000 7f0522394700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f051c103480 0x7f051c199670 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0518004fd0 tx=0x7f05180094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:06.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.593+0000 7f05137fe700 1 -- 172.21.15.70:0/3928490874 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518021070 con 0x7f051c103480 2024-04-26T20:23:06.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.593+0000 7f05245f8700 1 -- 172.21.15.70:0/3928490874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051c1a1560 con 0x7f051c103480 2024-04-26T20:23:06.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.593+0000 7f05137fe700 1 -- 172.21.15.70:0/3928490874 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0518007b80 con 0x7f051c103480 2024-04-26T20:23:06.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.593+0000 7f05137fe700 1 -- 172.21.15.70:0/3928490874 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518005260 con 0x7f051c103480 2024-04-26T20:23:06.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.593+0000 7f05245f8700 1 -- 172.21.15.70:0/3928490874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051c1a1a10 con 0x7f051c103480 2024-04-26T20:23:06.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.594+0000 7f05245f8700 1 -- 172.21.15.70:0/3928490874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f051c06a110 con 0x7f051c103480 2024-04-26T20:23:06.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.595+0000 7f05137fe700 1 -- 172.21.15.70:0/3928490874 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0518024070 con 0x7f051c103480 2024-04-26T20:23:06.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.595+0000 7f05137fe700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05080a3c40 0x7f05080a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:06.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.595+0000 7f0521b93700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05080a3c40 0x7f05080a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:06.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.595+0000 7f05137fe700 1 -- 172.21.15.70:0/3928490874 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5858+0+0 (secure 0 0 0) 0x7f051800f020 con 0x7f051c103480 2024-04-26T20:23:06.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.596+0000 7f0521b93700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05080a3c40 0x7f05080a6100 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f050c009c60 tx=0x7f050c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:06.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.599+0000 7f05137fe700 1 -- 172.21.15.70:0/3928490874 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f051802b020 con 0x7f051c103480 2024-04-26T20:23:06.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:06.809+0000 7f05245f8700 1 -- 172.21.15.70:0/3928490874 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f051c063860 con 0x7f05080a3c40 2024-04-26T20:23:07.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:07 smithi070 ceph-mon[29124]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T20:23:07.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:07 smithi070 ceph-mon[29124]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:23:07.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:23:07.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:23:07.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:07.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:07 smithi098 ceph-mon[32591]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T20:23:07.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:07 smithi098 ceph-mon[32591]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:23:07.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:23:07.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:23:07.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:07.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:07 smithi080 ceph-mon[32278]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T20:23:07.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:07 smithi080 ceph-mon[32278]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:23:07.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:23:07.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:23:07.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:08.448 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:08 smithi070 ceph-mon[29124]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T20:23:08.449 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:08 smithi070 ceph-mon[29124]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:08.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:08 smithi098 ceph-mon[32591]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T20:23:08.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:08 smithi098 ceph-mon[32591]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:08.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:08 smithi080 ceph-mon[32278]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T20:23:08.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:08 smithi080 ceph-mon[32278]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:09.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:09 smithi070 ceph-mon[29124]: osdmap e64: 9 total, 9 up, 9 in 2024-04-26T20:23:09.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:09 smithi098 ceph-mon[32591]: osdmap e64: 9 total, 9 up, 9 in 2024-04-26T20:23:09.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:09 smithi080 ceph-mon[32278]: osdmap e64: 9 total, 9 up, 9 in 2024-04-26T20:23:10.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:10 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/583468901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ab6f37b-5549-4582-8875-1863243bd85b"}]: dispatch 2024-04-26T20:23:10.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:10 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/583468901' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ab6f37b-5549-4582-8875-1863243bd85b"}]': finished 2024-04-26T20:23:10.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:10 smithi098 ceph-mon[32591]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T20:23:10.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:10.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:10 smithi098 ceph-mon[32591]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T20:23:10.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:10 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/583468901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ab6f37b-5549-4582-8875-1863243bd85b"}]: dispatch 2024-04-26T20:23:10.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:10 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/583468901' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ab6f37b-5549-4582-8875-1863243bd85b"}]': finished 2024-04-26T20:23:10.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:10 smithi080 ceph-mon[32278]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T20:23:10.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:10.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:10 smithi080 ceph-mon[32278]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T20:23:10.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:10 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/583468901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ab6f37b-5549-4582-8875-1863243bd85b"}]: dispatch 2024-04-26T20:23:10.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:10 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/583468901' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ab6f37b-5549-4582-8875-1863243bd85b"}]': finished 2024-04-26T20:23:10.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:10 smithi070 ceph-mon[29124]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T20:23:10.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:10.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:10 smithi070 ceph-mon[29124]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T20:23:11.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:11 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/183979668' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:23:11.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:11 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/183979668' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:23:11.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:11 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/183979668' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:23:12.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:12 smithi098 ceph-mon[32591]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-26T20:23:12.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:12 smithi080 ceph-mon[32278]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-26T20:23:12.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:12 smithi070 ceph-mon[29124]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-26T20:23:15.140 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:14 smithi070 ceph-mon[29124]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-04-26T20:23:15.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:14 smithi098 ceph-mon[32591]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-04-26T20:23:15.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:14 smithi080 ceph-mon[32278]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-04-26T20:23:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:16 smithi098 ceph-mon[32591]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:23:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:16 smithi080 ceph-mon[32278]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:23:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:16 smithi070 ceph-mon[29124]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:23:18.067 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:17 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T20:23:18.067 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:17 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:18.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:17 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T20:23:18.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:17 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:18.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:17 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T20:23:18.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:17 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:19.076 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:18 smithi070 ceph-mon[29124]: Deploying daemon osd.9 on smithi070 2024-04-26T20:23:19.076 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:18 smithi070 ceph-mon[29124]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:18 smithi098 ceph-mon[32591]: Deploying daemon osd.9 on smithi070 2024-04-26T20:23:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:18 smithi098 ceph-mon[32591]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:18 smithi080 ceph-mon[32278]: Deploying daemon osd.9 on smithi070 2024-04-26T20:23:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:18 smithi080 ceph-mon[32278]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:21.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:20 smithi070 ceph-mon[29124]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:21.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:20 smithi098 ceph-mon[32591]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:20 smithi080 ceph-mon[32278]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:22.993 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:22 smithi070 ceph-mon[29124]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:23.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:22 smithi098 ceph-mon[32591]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:23.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:22 smithi080 ceph-mon[32278]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:24.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:24.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:24.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:24.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:24 smithi070 ceph-mon[29124]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:24.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:24.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:24.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:24.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:24 smithi098 ceph-mon[32591]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:24.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:24.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:24.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:24.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:24 smithi080 ceph-mon[32278]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:26.616 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 9 on host 'smithi070' 2024-04-26T20:23:26.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.614+0000 7f05137fe700 1 -- 172.21.15.70:0/3928490874 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f051c063860 con 0x7f05080a3c40 2024-04-26T20:23:26.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 -- 172.21.15.70:0/3928490874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05080a3c40 msgr2=0x7f05080a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:26.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05080a3c40 0x7f05080a6100 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f050c009c60 tx=0x7f050c009260 comp rx=0 tx=0).stop 2024-04-26T20:23:26.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 -- 172.21.15.70:0/3928490874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f051c103480 msgr2=0x7f051c199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:26.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f051c103480 0x7f051c199670 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0518004fd0 tx=0x7f05180094f0 comp rx=0 tx=0).stop 2024-04-26T20:23:26.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 -- 172.21.15.70:0/3928490874 shutdown_connections 2024-04-26T20:23:26.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05080a3c40 0x7f05080a6100 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:26.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f051c105020 0x7f051c1a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:26.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f051c103480 0x7f051c199670 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:26.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 --2- 172.21.15.70:0/3928490874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f051c104680 0x7f051c199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:26.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 -- 172.21.15.70:0/3928490874 >> 172.21.15.70:0/3928490874 conn(0x7f051c0fea20 msgr2=0x7f051c107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:26.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 -- 172.21.15.70:0/3928490874 shutdown_connections 2024-04-26T20:23:26.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:23:26.617+0000 7f05245f8700 1 -- 172.21.15.70:0/3928490874 wait complete. 2024-04-26T20:23:26.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:26 smithi070 ceph-mon[29124]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:26.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:26 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:26.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:26 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:26 smithi098 ceph-mon[32591]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:26 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:27.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:26 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:27.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:26 smithi080 ceph-mon[32278]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:27.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:26 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:27.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:26 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:27.636 DEBUG:teuthology.orchestra.run.smithi070:osd.9> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.9.service 2024-04-26T20:23:27.638 INFO:tasks.cephadm:Deploying osd.10 on smithi080 with /dev/vg_nvme/lv_1... 2024-04-26T20:23:27.638 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T20:23:27.890 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:23:27.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:27 smithi080 ceph-mon[32278]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T20:23:28.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:27 smithi070 ceph-mon[29124]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T20:23:28.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:27 smithi098 ceph-mon[32591]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T20:23:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:28 smithi070 ceph-mon[29124]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:28 smithi070 ceph-mon[29124]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T20:23:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:28 smithi070 ceph-mon[29124]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T20:23:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:28 smithi070 ceph-mon[29124]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:23:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:28 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:28 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:28 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:29.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:28 smithi098 ceph-mon[32591]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:29.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:28 smithi098 ceph-mon[32591]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T20:23:29.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:28 smithi098 ceph-mon[32591]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T20:23:29.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:28 smithi098 ceph-mon[32591]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:23:29.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:28 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:29.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:28 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:29.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:28 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:29.218 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:28 smithi080 ceph-mon[32278]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:29.218 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:28 smithi080 ceph-mon[32278]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T20:23:29.218 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:28 smithi080 ceph-mon[32278]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T20:23:29.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:28 smithi080 ceph-mon[32278]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-04-26T20:23:29.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:28 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:29.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:28 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:29.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:28 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:29.701 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:23:29 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:23:29.284+0000 7f8b20db6700 -1 osd.9 0 waiting for initial osdmap 2024-04-26T20:23:29.701 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:23:29 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:23:29.295+0000 7f8b18ba1700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:23:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T20:23:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T20:23:29.961 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-26T20:23:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-26T20:23:29.961 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0118135 s, 888 MB/s 2024-04-26T20:23:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-26T20:23:30.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:29 smithi070 ceph-mon[29124]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:23:30.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:29 smithi070 ceph-mon[29124]: osdmap e67: 10 total, 9 up, 10 in 2024-04-26T20:23:30.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:29 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:30.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:29 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:30.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:29 smithi070 ceph-mon[29124]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' 2024-04-26T20:23:30.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:29 smithi098 ceph-mon[32591]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:23:30.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:29 smithi098 ceph-mon[32591]: osdmap e67: 10 total, 9 up, 10 in 2024-04-26T20:23:30.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:29 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:30.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:29 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:30.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:29 smithi098 ceph-mon[32591]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' 2024-04-26T20:23:30.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:29 smithi080 ceph-mon[32278]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-04-26T20:23:30.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:29 smithi080 ceph-mon[32278]: osdmap e67: 10 total, 9 up, 10 in 2024-04-26T20:23:30.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:29 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:30.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:29 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:30.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:29 smithi080 ceph-mon[32278]: from='osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927]' entity='osd.9' 2024-04-26T20:23:30.677 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_1 2024-04-26T20:23:30.932 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:23:30.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:30 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:23:30.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:30 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:23:30.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:30 smithi080 ceph-mon[32278]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:30.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:30 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:30.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:30 smithi080 ceph-mon[32278]: osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927] boot 2024-04-26T20:23:30.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:30 smithi080 ceph-mon[32278]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T20:23:30.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:30 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:30 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:23:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:30 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:23:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:30 smithi098 ceph-mon[32591]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:30 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:30 smithi098 ceph-mon[32591]: osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927] boot 2024-04-26T20:23:31.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:30 smithi098 ceph-mon[32591]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T20:23:31.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:30 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:31.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:30 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:23:31.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:30 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:23:31.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:30 smithi070 ceph-mon[29124]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:23:31.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:30 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:31.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:30 smithi070 ceph-mon[29124]: osd.9 [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927] boot 2024-04-26T20:23:31.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:30 smithi070 ceph-mon[29124]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T20:23:31.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:30 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:23:32.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.637+0000 7faa310aa700 1 -- 172.21.15.80:0/556655502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa2c104670 msgr2=0x7faa2c104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:32.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.637+0000 7faa310aa700 1 --2- 172.21.15.80:0/556655502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa2c104670 0x7faa2c104ad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa200099c0 tx=0x7faa20009cd0 comp rx=0 tx=0).stop 2024-04-26T20:23:32.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.637+0000 7faa310aa700 1 -- 172.21.15.80:0/556655502 shutdown_connections 2024-04-26T20:23:32.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.637+0000 7faa310aa700 1 --2- 172.21.15.80:0/556655502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa2c105010 0x7faa2c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:32.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.637+0000 7faa310aa700 1 --2- 172.21.15.80:0/556655502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa2c103470 0x7faa2c103890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.637+0000 7faa310aa700 1 --2- 172.21.15.80:0/556655502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa2c104670 0x7faa2c104ad0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.637+0000 7faa310aa700 1 -- 172.21.15.80:0/556655502 >> 172.21.15.80:0/556655502 conn(0x7faa2c0fea10 msgr2=0x7faa2c100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.637+0000 7faa310aa700 1 -- 172.21.15.80:0/556655502 shutdown_connections 2024-04-26T20:23:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.637+0000 7faa310aa700 1 -- 172.21.15.80:0/556655502 wait complete. 2024-04-26T20:23:32.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.638+0000 7faa310aa700 1 Processor -- start 2024-04-26T20:23:32.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.638+0000 7faa310aa700 1 -- start start 2024-04-26T20:23:32.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.638+0000 7faa310aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa2c103470 0x7faa2c0771c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:32.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.638+0000 7faa310aa700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa2c104670 0x7faa2c075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:32.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.638+0000 7faa310aa700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa2c105010 0x7faa2c075d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:32.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.638+0000 7faa310aa700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c10f060 con 0x7faa2c105010 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.638+0000 7faa310aa700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c10eee0 con 0x7faa2c104670 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.638+0000 7faa310aa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c10f1e0 con 0x7faa2c103470 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa2c104670 0x7faa2c075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa2c104670 0x7faa2c075810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43054/0 (socket says 172.21.15.80:43054) 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2a59c700 1 -- 172.21.15.80:0/4293497729 learned_addr learned my addr 172.21.15.80:0/4293497729 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2b59e700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa2c105010 0x7faa2c075d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2ad9d700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa2c103470 0x7faa2c0771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2a59c700 1 -- 172.21.15.80:0/4293497729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa2c103470 msgr2=0x7faa2c0771c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2a59c700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa2c103470 0x7faa2c0771c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2a59c700 1 -- 172.21.15.80:0/4293497729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa2c105010 msgr2=0x7faa2c075d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2a59c700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa2c105010 0x7faa2c075d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2a59c700 1 -- 172.21.15.80:0/4293497729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2c076600 con 0x7faa2c104670 2024-04-26T20:23:32.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2ad9d700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa2c103470 0x7faa2c0771c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:23:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa2a59c700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa2c104670 0x7faa2c075810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa20009f50 tx=0x7faa20004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa13fff700 1 -- 172.21.15.80:0/4293497729 <== mon.2 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20003d40 con 0x7faa2c104670 2024-04-26T20:23:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa13fff700 1 -- 172.21.15.80:0/4293497729 <== mon.2 v2:172.21.15.80:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa20004800 con 0x7faa2c104670 2024-04-26T20:23:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa310aa700 1 -- 172.21.15.80:0/4293497729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2c1a3760 con 0x7faa2c104670 2024-04-26T20:23:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa13fff700 1 -- 172.21.15.80:0/4293497729 <== mon.2 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa200054b0 con 0x7faa2c104670 2024-04-26T20:23:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.639+0000 7faa310aa700 1 -- 172.21.15.80:0/4293497729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa2c1a3bb0 con 0x7faa2c104670 2024-04-26T20:23:32.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.641+0000 7faa310aa700 1 -- 172.21.15.80:0/4293497729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa2c06a110 con 0x7faa2c104670 2024-04-26T20:23:32.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.641+0000 7faa13fff700 1 -- 172.21.15.80:0/4293497729 <== mon.2 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7faa20028060 con 0x7faa2c104670 2024-04-26T20:23:32.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.642+0000 7faa13fff700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faa140a3c40 0x7faa140a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:32.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.642+0000 7faa13fff700 1 -- 172.21.15.80:0/4293497729 <== mon.2 v2:172.21.15.80:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6261+0+0 (secure 0 0 0) 0x7faa200d06b0 con 0x7faa2c104670 2024-04-26T20:23:32.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.642+0000 7faa2ad9d700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faa140a3c40 0x7faa140a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:32.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.643+0000 7faa2ad9d700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faa140a3c40 0x7faa140a6100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa1c005fd0 tx=0x7faa1c005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:32.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.647+0000 7faa13fff700 1 -- 172.21.15.80:0/4293497729 <== mon.2 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7faa2005d060 con 0x7faa2c104670 2024-04-26T20:23:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:32.857+0000 7faa310aa700 1 -- 172.21.15.80:0/4293497729 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7faa2c063860 con 0x7faa140a3c40 2024-04-26T20:23:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi070 2024-04-26T20:23:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi070 to 4272M 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: osdmap e69: 10 total, 10 up, 10 in 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:33.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:33.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:33.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:32 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:33.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi070 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi070 to 4272M 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: osdmap e69: 10 total, 10 up, 10 in 2024-04-26T20:23:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:33.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:33.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:33.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:32 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:33.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi070 2024-04-26T20:23:33.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:33.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi070 to 4272M 2024-04-26T20:23:33.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:33.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:33.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:33.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: osdmap e69: 10 total, 10 up, 10 in 2024-04-26T20:23:33.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:33.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:33.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:33.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:32 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:34.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:33 smithi098 ceph-mon[32591]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:23:34.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:33 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:23:34.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:33 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:23:34.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:33 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:34.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:33 smithi080 ceph-mon[32278]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:23:34.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:33 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:23:34.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:33 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:23:34.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:33 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:34.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:33 smithi070 ceph-mon[29124]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:23:34.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:33 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:23:34.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:33 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:23:34.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:33 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:35.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:34 smithi070 ceph-mon[29124]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:35.041 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:34 smithi080 ceph-mon[32278]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:35.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:34 smithi098 ceph-mon[32591]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:36.111 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:35 smithi080 ceph-mon[32278]: from='client.? 172.21.15.80:0/4152353050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b598502-7650-4dc7-b997-60dd570914c2"}]: dispatch 2024-04-26T20:23:36.111 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:35 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b598502-7650-4dc7-b997-60dd570914c2"}]: dispatch 2024-04-26T20:23:36.111 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:35 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b598502-7650-4dc7-b997-60dd570914c2"}]': finished 2024-04-26T20:23:36.112 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:35 smithi080 ceph-mon[32278]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T20:23:36.112 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:35 smithi098 ceph-mon[32591]: from='client.? 172.21.15.80:0/4152353050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b598502-7650-4dc7-b997-60dd570914c2"}]: dispatch 2024-04-26T20:23:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:35 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b598502-7650-4dc7-b997-60dd570914c2"}]: dispatch 2024-04-26T20:23:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:35 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b598502-7650-4dc7-b997-60dd570914c2"}]': finished 2024-04-26T20:23:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:35 smithi098 ceph-mon[32591]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T20:23:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:36.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:35 smithi070 ceph-mon[29124]: from='client.? 172.21.15.80:0/4152353050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b598502-7650-4dc7-b997-60dd570914c2"}]: dispatch 2024-04-26T20:23:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:35 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b598502-7650-4dc7-b997-60dd570914c2"}]: dispatch 2024-04-26T20:23:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:35 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b598502-7650-4dc7-b997-60dd570914c2"}]': finished 2024-04-26T20:23:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:35 smithi070 ceph-mon[29124]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T20:23:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:37.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:36 smithi098 ceph-mon[32591]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:37.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:36 smithi098 ceph-mon[32591]: from='client.? 172.21.15.80:0/2336499138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:23:37.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:36 smithi080 ceph-mon[32278]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:37.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:36 smithi080 ceph-mon[32278]: from='client.? 172.21.15.80:0/2336499138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:23:37.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:36 smithi070 ceph-mon[29124]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:37.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:36 smithi070 ceph-mon[29124]: from='client.? 172.21.15.80:0/2336499138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:23:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:38 smithi098 ceph-mon[32591]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:39.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:38 smithi080 ceph-mon[32278]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:39.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:38 smithi070 ceph-mon[29124]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:40.985 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:40 smithi080 ceph-mon[32278]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:40 smithi098 ceph-mon[32591]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:41.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:40 smithi070 ceph-mon[29124]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:42 smithi098 ceph-mon[32591]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:43.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:42 smithi080 ceph-mon[32278]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:43.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:42 smithi070 ceph-mon[29124]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:44.127 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:43 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T20:23:44.127 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:43 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:44.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:43 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T20:23:44.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:43 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:44.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:43 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T20:23:44.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:43 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:45.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:44 smithi080 ceph-mon[32278]: Deploying daemon osd.10 on smithi080 2024-04-26T20:23:45.143 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:44 smithi080 ceph-mon[32278]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:44 smithi098 ceph-mon[32591]: Deploying daemon osd.10 on smithi080 2024-04-26T20:23:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:44 smithi098 ceph-mon[32591]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:45.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:44 smithi070 ceph-mon[29124]: Deploying daemon osd.10 on smithi080 2024-04-26T20:23:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:44 smithi070 ceph-mon[29124]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:46.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:46 smithi080 ceph-mon[32278]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:47.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:46 smithi098 ceph-mon[32591]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:47.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:46 smithi070 ceph-mon[29124]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:49.065 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:48 smithi080 ceph-mon[32278]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:49.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:48 smithi098 ceph-mon[32591]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:49.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:48 smithi070 ceph-mon[29124]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:50.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:50.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:50.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:50.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:50 smithi098 ceph-mon[32591]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:50.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:50.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:50.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:50.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:50 smithi080 ceph-mon[32278]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:50.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:50.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:50.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:50.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:50 smithi070 ceph-mon[29124]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:52.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.422+0000 7faa13fff700 1 -- 172.21.15.80:0/4293497729 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7faa2c063860 con 0x7faa140a3c40 2024-04-26T20:23:52.424 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 10 on host 'smithi080' 2024-04-26T20:23:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.424+0000 7faa310aa700 1 -- 172.21.15.80:0/4293497729 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faa140a3c40 msgr2=0x7faa140a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.424+0000 7faa310aa700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faa140a3c40 0x7faa140a6100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa1c005fd0 tx=0x7faa1c005f00 comp rx=0 tx=0).stop 2024-04-26T20:23:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.424+0000 7faa310aa700 1 -- 172.21.15.80:0/4293497729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa2c104670 msgr2=0x7faa2c075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.424+0000 7faa310aa700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa2c104670 0x7faa2c075810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa20009f50 tx=0x7faa20004790 comp rx=0 tx=0).stop 2024-04-26T20:23:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.424+0000 7faa310aa700 1 -- 172.21.15.80:0/4293497729 shutdown_connections 2024-04-26T20:23:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.424+0000 7faa310aa700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faa140a3c40 0x7faa140a6100 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.424+0000 7faa310aa700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa2c105010 0x7faa2c075d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.424+0000 7faa310aa700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa2c103470 0x7faa2c0771c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.424+0000 7faa310aa700 1 --2- 172.21.15.80:0/4293497729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa2c104670 0x7faa2c075810 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.424+0000 7faa310aa700 1 -- 172.21.15.80:0/4293497729 >> 172.21.15.80:0/4293497729 conn(0x7faa2c0fea10 msgr2=0x7faa2c107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.425+0000 7faa310aa700 1 -- 172.21.15.80:0/4293497729 shutdown_connections 2024-04-26T20:23:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T20:23:52.425+0000 7faa310aa700 1 -- 172.21.15.80:0/4293497729 wait complete. 2024-04-26T20:23:52.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:52 smithi080 ceph-mon[32278]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:52.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:52 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:52.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:52 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:53.162 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:52 smithi098 ceph-mon[32591]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:53.162 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:53.162 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:53.238 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:52 smithi070 ceph-mon[29124]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:53.238 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:52 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:53.238 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:52 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:53.346 DEBUG:teuthology.orchestra.run.smithi080:osd.10> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.10.service 2024-04-26T20:23:53.349 INFO:tasks.cephadm:Deploying osd.11 on smithi098 with /dev/vg_nvme/lv_1... 2024-04-26T20:23:53.349 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T20:23:53.593 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:23:53.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:53 smithi080 ceph-mon[32278]: from='osd.10 [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:23:53.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:53 smithi080 ceph-mon[32278]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:23:53.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:53 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:53.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:53 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:53.991 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:53 smithi098 ceph-mon[32591]: from='osd.10 [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:23:53.991 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:53 smithi098 ceph-mon[32591]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:23:53.991 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:53 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:53.991 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:53 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:54.258 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:53 smithi070 ceph-mon[29124]: from='osd.10 [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:23:54.258 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:53 smithi070 ceph-mon[29124]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:23:54.258 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:53 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:54.258 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:53 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:55.041 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:54 smithi098 ceph-mon[32591]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:55.041 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:54 smithi098 ceph-mon[32591]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T20:23:55.041 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:54 smithi098 ceph-mon[32591]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T20:23:55.041 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:54 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:55.041 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:54 smithi098 ceph-mon[32591]: from='osd.10 [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:23:55.041 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:54 smithi098 ceph-mon[32591]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:23:55.215 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:54 smithi080 ceph-mon[32278]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:55.215 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:54 smithi080 ceph-mon[32278]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T20:23:55.216 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:54 smithi080 ceph-mon[32278]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T20:23:55.216 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:54 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:55.216 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:54 smithi080 ceph-mon[32278]: from='osd.10 [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:23:55.216 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:54 smithi080 ceph-mon[32278]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:23:55.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:54 smithi070 ceph-mon[29124]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:55.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:54 smithi070 ceph-mon[29124]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T20:23:55.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:54 smithi070 ceph-mon[29124]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T20:23:55.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:54 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:55.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:54 smithi070 ceph-mon[29124]: from='osd.10 [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:23:55.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:54 smithi070 ceph-mon[29124]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T20:23:55.468 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:23:55 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:23:55.272+0000 7f6e295d9700 -1 osd.10 0 waiting for initial osdmap 2024-04-26T20:23:55.468 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:23:55 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:23:55.283+0000 7f6e213c4700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:23:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T20:23:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T20:23:55.762 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10+0 records in 2024-04-26T20:23:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:10+0 records out 2024-04-26T20:23:55.762 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114594 s, 915 MB/s 2024-04-26T20:23:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping successful for: 2024-04-26T20:23:56.156 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:55 smithi098 ceph-mon[32591]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:23:56.157 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:55 smithi098 ceph-mon[32591]: osdmap e72: 11 total, 10 up, 11 in 2024-04-26T20:23:56.157 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:55 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:56.157 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:55 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:56.157 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:55 smithi098 ceph-mon[32591]: from='osd.10 ' entity='osd.10' 2024-04-26T20:23:56.225 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:55 smithi080 ceph-mon[32278]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:23:56.257 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:55 smithi080 ceph-mon[32278]: osdmap e72: 11 total, 10 up, 11 in 2024-04-26T20:23:56.257 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:55 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:56.257 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:55 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:56.257 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:55 smithi080 ceph-mon[32278]: from='osd.10 ' entity='osd.10' 2024-04-26T20:23:56.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:55 smithi070 ceph-mon[29124]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T20:23:56.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:55 smithi070 ceph-mon[29124]: osdmap e72: 11 total, 10 up, 11 in 2024-04-26T20:23:56.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:55 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:56.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:55 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:56.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:55 smithi070 ceph-mon[29124]: from='osd.10 ' entity='osd.10' 2024-04-26T20:23:56.485 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_1 2024-04-26T20:23:56.722 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:23:57.094 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:56 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:23:57.094 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:56 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:23:57.094 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:56 smithi098 ceph-mon[32591]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:57.094 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:56 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:57.094 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:56 smithi098 ceph-mon[32591]: osd.10 [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547] boot 2024-04-26T20:23:57.095 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:56 smithi098 ceph-mon[32591]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T20:23:57.095 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:56 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:57.188 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:56 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:23:57.188 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:56 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:23:57.188 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:56 smithi080 ceph-mon[32278]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:57.188 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:56 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:57.188 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:56 smithi080 ceph-mon[32278]: osd.10 [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547] boot 2024-04-26T20:23:57.188 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:56 smithi080 ceph-mon[32278]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T20:23:57.188 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:56 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:57.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:56 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:23:57.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:56 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:23:57.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:56 smithi070 ceph-mon[29124]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:23:57.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:56 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:57.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:56 smithi070 ceph-mon[29124]: osd.10 [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547] boot 2024-04-26T20:23:57.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:56 smithi070 ceph-mon[29124]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T20:23:57.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:56 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:23:58.151 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:58.152 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:58.153 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:58.153 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:57 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T20:23:58.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:58.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:58.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:58.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:58.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:58.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:57 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T20:23:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:23:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:58.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:57 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:23:58.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.354+0000 7fe412a6c700 1 -- 172.21.15.98:0/2387981415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe40c103480 msgr2=0x7fe40c1038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:58.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.354+0000 7fe412a6c700 1 --2- 172.21.15.98:0/2387981415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe40c103480 0x7fe40c1038a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe400009990 tx=0x7fe400009ca0 comp rx=0 tx=0).stop 2024-04-26T20:23:58.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 -- 172.21.15.98:0/2387981415 shutdown_connections 2024-04-26T20:23:58.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 --2- 172.21.15.98:0/2387981415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe40c105020 0x7fe40c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:58.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 --2- 172.21.15.98:0/2387981415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe40c103480 0x7fe40c1038a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:58.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 --2- 172.21.15.98:0/2387981415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe40c104680 0x7fe40c104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:58.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 -- 172.21.15.98:0/2387981415 >> 172.21.15.98:0/2387981415 conn(0x7fe40c0fea20 msgr2=0x7fe40c100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:58.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 -- 172.21.15.98:0/2387981415 shutdown_connections 2024-04-26T20:23:58.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 -- 172.21.15.98:0/2387981415 wait complete. 2024-04-26T20:23:58.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 Processor -- start 2024-04-26T20:23:58.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 -- start start 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe40c103480 0x7fe40c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe40c104680 0x7fe40c199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe40c105020 0x7fe40c1a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c10f0b0 con 0x7fe40c103480 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c10ef30 con 0x7fe40c104680 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.355+0000 7fe412a6c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c10f230 con 0x7fe40c105020 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe411009700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe40c105020 0x7fe40c1a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe411009700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe40c105020 0x7fe40c1a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33502/0 (socket says 172.21.15.98:33502) 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe411009700 1 -- 172.21.15.98:0/4172978249 learned_addr learned my addr 172.21.15.98:0/4172978249 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe410808700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe40c103480 0x7fe40c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe40bfff700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe40c104680 0x7fe40c199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe411009700 1 -- 172.21.15.98:0/4172978249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe40c104680 msgr2=0x7fe40c199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:58.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe411009700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe40c104680 0x7fe40c199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:58.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe411009700 1 -- 172.21.15.98:0/4172978249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe40c103480 msgr2=0x7fe40c199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:58.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe411009700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe40c103480 0x7fe40c199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:58.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe411009700 1 -- 172.21.15.98:0/4172978249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c1a1290 con 0x7fe40c105020 2024-04-26T20:23:58.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe40bfff700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe40c104680 0x7fe40c199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:23:58.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe411009700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe40c105020 0x7fe40c1a0bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe40400b9a0 tx=0x7fe40400bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:58.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe409ffb700 1 -- 172.21.15.98:0/4172978249 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe404019070 con 0x7fe40c105020 2024-04-26T20:23:58.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe409ffb700 1 -- 172.21.15.98:0/4172978249 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe40400ce00 con 0x7fe40c105020 2024-04-26T20:23:58.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe412a6c700 1 -- 172.21.15.98:0/4172978249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40c1a1580 con 0x7fe40c105020 2024-04-26T20:23:58.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe409ffb700 1 -- 172.21.15.98:0/4172978249 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe404007370 con 0x7fe40c105020 2024-04-26T20:23:58.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.356+0000 7fe412a6c700 1 -- 172.21.15.98:0/4172978249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe40c1a1af0 con 0x7fe40c105020 2024-04-26T20:23:58.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.357+0000 7fe412a6c700 1 -- 172.21.15.98:0/4172978249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe40c06a110 con 0x7fe40c105020 2024-04-26T20:23:58.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.358+0000 7fe409ffb700 1 -- 172.21.15.98:0/4172978249 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fe40401c070 con 0x7fe40c105020 2024-04-26T20:23:58.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.359+0000 7fe409ffb700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3fc0a3c40 0x7fe3fc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:58.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.359+0000 7fe409ffb700 1 -- 172.21.15.98:0/4172978249 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6694+0+0 (secure 0 0 0) 0x7fe4040cf680 con 0x7fe40c105020 2024-04-26T20:23:58.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.359+0000 7fe410808700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3fc0a3c40 0x7fe3fc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:58.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.360+0000 7fe410808700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3fc0a3c40 0x7fe3fc0a6100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe400003870 tx=0x7fe400005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:58.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.363+0000 7fe409ffb700 1 -- 172.21.15.98:0/4172978249 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fe40409c610 con 0x7fe40c105020 2024-04-26T20:23:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:23:58.572+0000 7fe412a6c700 1 -- 172.21.15.98:0/4172978249 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe40c063860 con 0x7fe3fc0a3c40 2024-04-26T20:23:59.179 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:58 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi080 2024-04-26T20:23:59.179 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:58 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi080 to 4272M 2024-04-26T20:23:59.179 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:58 smithi098 ceph-mon[32591]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:23:59.179 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:58 smithi098 ceph-mon[32591]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T20:23:59.179 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:58 smithi098 ceph-mon[32591]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T20:23:59.179 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:23:59.180 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:23:59.180 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:58 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi080 2024-04-26T20:23:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:58 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi080 to 4272M 2024-04-26T20:23:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:58 smithi080 ceph-mon[32278]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:23:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:58 smithi080 ceph-mon[32278]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T20:23:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:58 smithi080 ceph-mon[32278]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T20:23:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:23:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:23:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:58 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi080 2024-04-26T20:23:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:58 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi080 to 4272M 2024-04-26T20:23:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:58 smithi070 ceph-mon[29124]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:23:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:58 smithi070 ceph-mon[29124]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T20:23:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:58 smithi070 ceph-mon[29124]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T20:23:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:23:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:23:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:00.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:59 smithi098 ceph-mon[32591]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:24:00.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:23:59 smithi098 ceph-mon[32591]: osdmap e77: 11 total, 11 up, 11 in 2024-04-26T20:24:00.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:59 smithi080 ceph-mon[32278]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:24:00.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:23:59 smithi080 ceph-mon[32278]: osdmap e77: 11 total, 11 up, 11 in 2024-04-26T20:24:00.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:59 smithi070 ceph-mon[29124]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:24:00.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:23:59 smithi070 ceph-mon[29124]: osdmap e77: 11 total, 11 up, 11 in 2024-04-26T20:24:00.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:00 smithi098 ceph-mon[32591]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:00 smithi080 ceph-mon[32278]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:01.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:00 smithi070 ceph-mon[29124]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:02.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:01 smithi098 ceph-mon[32591]: from='client.? 172.21.15.98:0/4242971732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2994a2a9-f896-4f0d-baab-095277c00bde"}]: dispatch 2024-04-26T20:24:02.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:01 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2994a2a9-f896-4f0d-baab-095277c00bde"}]: dispatch 2024-04-26T20:24:02.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:01 smithi098 ceph-mon[32591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2994a2a9-f896-4f0d-baab-095277c00bde"}]': finished 2024-04-26T20:24:02.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:01 smithi098 ceph-mon[32591]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T20:24:02.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:01 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:02.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:01 smithi080 ceph-mon[32278]: from='client.? 172.21.15.98:0/4242971732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2994a2a9-f896-4f0d-baab-095277c00bde"}]: dispatch 2024-04-26T20:24:02.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:01 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2994a2a9-f896-4f0d-baab-095277c00bde"}]: dispatch 2024-04-26T20:24:02.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:01 smithi080 ceph-mon[32278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2994a2a9-f896-4f0d-baab-095277c00bde"}]': finished 2024-04-26T20:24:02.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:01 smithi080 ceph-mon[32278]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T20:24:02.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:01 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:02.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:01 smithi070 ceph-mon[29124]: from='client.? 172.21.15.98:0/4242971732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2994a2a9-f896-4f0d-baab-095277c00bde"}]: dispatch 2024-04-26T20:24:02.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:01 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2994a2a9-f896-4f0d-baab-095277c00bde"}]: dispatch 2024-04-26T20:24:02.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:01 smithi070 ceph-mon[29124]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2994a2a9-f896-4f0d-baab-095277c00bde"}]': finished 2024-04-26T20:24:02.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:01 smithi070 ceph-mon[29124]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T20:24:02.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:01 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:02 smithi098 ceph-mon[32591]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:02 smithi098 ceph-mon[32591]: from='client.? 172.21.15.98:0/1622008802' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:24:03.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:02 smithi080 ceph-mon[32278]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:03.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:02 smithi080 ceph-mon[32278]: from='client.? 172.21.15.98:0/1622008802' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:24:03.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:02 smithi070 ceph-mon[29124]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:03.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:02 smithi070 ceph-mon[29124]: from='client.? 172.21.15.98:0/1622008802' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:24:05.135 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:04 smithi098 ceph-mon[32591]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T20:24:05.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:04 smithi080 ceph-mon[32278]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T20:24:05.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:04 smithi070 ceph-mon[29124]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T20:24:07.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:06 smithi098 ceph-mon[32591]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T20:24:07.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:06 smithi080 ceph-mon[32278]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T20:24:07.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:06 smithi070 ceph-mon[29124]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T20:24:09.133 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:08 smithi098 ceph-mon[32591]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-26T20:24:09.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:08 smithi080 ceph-mon[32278]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-26T20:24:09.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:08 smithi070 ceph-mon[29124]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-26T20:24:10.030 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T20:24:10.030 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:09 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:10.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T20:24:10.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:09 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:10.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T20:24:10.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:09 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:11.173 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:10 smithi098 ceph-mon[32591]: Deploying daemon osd.11 on smithi098 2024-04-26T20:24:11.173 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:10 smithi098 ceph-mon[32591]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:24:11.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:10 smithi080 ceph-mon[32278]: Deploying daemon osd.11 on smithi098 2024-04-26T20:24:11.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:10 smithi080 ceph-mon[32278]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:24:11.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:10 smithi070 ceph-mon[29124]: Deploying daemon osd.11 on smithi098 2024-04-26T20:24:11.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:10 smithi070 ceph-mon[29124]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:24:13.176 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:12 smithi098 ceph-mon[32591]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-26T20:24:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:12 smithi080 ceph-mon[32278]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-26T20:24:13.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:12 smithi070 ceph-mon[29124]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-26T20:24:15.148 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:14 smithi098 ceph-mon[32591]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-26T20:24:15.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:14 smithi080 ceph-mon[32278]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-26T20:24:15.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:14 smithi070 ceph-mon[29124]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-26T20:24:16.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:16 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:16.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:16 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:16.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:16 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:16.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:16 smithi098 ceph-mon[32591]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:16.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:16 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:16.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:16 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:16.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:16 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:16.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:16 smithi080 ceph-mon[32278]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:16.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:16 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:16.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:16 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:16.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:16 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:16.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:16 smithi070 ceph-mon[29124]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:18.912 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:18 smithi098 ceph-mon[32591]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:18.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.993+0000 7fe409ffb700 1 -- 172.21.15.98:0/4172978249 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe40c063860 con 0x7fe3fc0a3c40 2024-04-26T20:24:18.994 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 11 on host 'smithi098' 2024-04-26T20:24:18.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 -- 172.21.15.98:0/4172978249 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3fc0a3c40 msgr2=0x7fe3fc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:18.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3fc0a3c40 0x7fe3fc0a6100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe400003870 tx=0x7fe400005fd0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 -- 172.21.15.98:0/4172978249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe40c105020 msgr2=0x7fe40c1a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:18.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe40c105020 0x7fe40c1a0bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe40400b9a0 tx=0x7fe40400bcb0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 -- 172.21.15.98:0/4172978249 shutdown_connections 2024-04-26T20:24:18.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3fc0a3c40 0x7fe3fc0a6100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe40c105020 0x7fe40c1a0bf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe40c103480 0x7fe40c199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 --2- 172.21.15.98:0/4172978249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe40c104680 0x7fe40c199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 -- 172.21.15.98:0/4172978249 >> 172.21.15.98:0/4172978249 conn(0x7fe40c0fea20 msgr2=0x7fe40c107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:18.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 -- 172.21.15.98:0/4172978249 shutdown_connections 2024-04-26T20:24:18.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:18.996+0000 7fe412a6c700 1 -- 172.21.15.98:0/4172978249 wait complete. 2024-04-26T20:24:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:18 smithi080 ceph-mon[32278]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:19.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:18 smithi070 ceph-mon[29124]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:19.727 DEBUG:teuthology.orchestra.run.smithi098:osd.11> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.11.service 2024-04-26T20:24:19.730 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-26T20:24:19.730 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-26T20:24:19.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:19 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:19.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:19 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:19.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:19 smithi098 ceph-mon[32591]: from='osd.11 [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:24:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:19 smithi098 ceph-mon[32591]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:24:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:19 smithi098 ceph-mon[32591]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:19 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:19 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:19.983 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:24:20.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:20.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:20.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:19 smithi070 ceph-mon[29124]: from='osd.11 [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:24:20.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:19 smithi070 ceph-mon[29124]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:24:20.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:19 smithi070 ceph-mon[29124]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:20.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:20.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:19 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:20.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:19 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:20.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:19 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:20.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:19 smithi080 ceph-mon[32278]: from='osd.11 [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:24:20.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:19 smithi080 ceph-mon[32278]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:24:20.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:19 smithi080 ceph-mon[32278]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:20.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:19 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:20.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:19 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:21.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:20 smithi098 ceph-mon[32591]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T20:24:21.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:20 smithi098 ceph-mon[32591]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T20:24:21.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:20 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:21.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:20 smithi098 ceph-mon[32591]: from='osd.11 [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:24:21.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:20 smithi098 ceph-mon[32591]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:24:21.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:20 smithi080 ceph-mon[32278]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T20:24:21.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:20 smithi080 ceph-mon[32278]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T20:24:21.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:20 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:21.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:20 smithi080 ceph-mon[32278]: from='osd.11 [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:24:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:20 smithi080 ceph-mon[32278]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:24:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:20 smithi070 ceph-mon[29124]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T20:24:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:20 smithi070 ceph-mon[29124]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T20:24:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:20 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:20 smithi070 ceph-mon[29124]: from='osd.11 [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:24:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:20 smithi070 ceph-mon[29124]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-04-26T20:24:21.673 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:24:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:24:21.397+0000 7fdd706d0700 -1 osd.11 0 waiting for initial osdmap 2024-04-26T20:24:21.673 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:24:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:24:21.409+0000 7fdd684bb700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:24:21.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.906+0000 7f7547968700 1 -- 172.21.15.70:0/3511984882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7540102380 msgr2=0x7f75401027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:21.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.906+0000 7f7547968700 1 --2- 172.21.15.70:0/3511984882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7540102380 0x7f75401027a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f75300099c0 tx=0x7f7530009cd0 comp rx=0 tx=0).stop 2024-04-26T20:24:21.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.906+0000 7f7547968700 1 -- 172.21.15.70:0/3511984882 shutdown_connections 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.906+0000 7f7547968700 1 --2- 172.21.15.70:0/3511984882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7540103f20 0x7f754010a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.906+0000 7f7547968700 1 --2- 172.21.15.70:0/3511984882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7540102380 0x7f75401027a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.906+0000 7f7547968700 1 --2- 172.21.15.70:0/3511984882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7540103580 0x7f75401039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.906+0000 7f7547968700 1 -- 172.21.15.70:0/3511984882 >> 172.21.15.70:0/3511984882 conn(0x7f75400fd920 msgr2=0x7f75400ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.907+0000 7f7547968700 1 -- 172.21.15.70:0/3511984882 shutdown_connections 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.907+0000 7f7547968700 1 -- 172.21.15.70:0/3511984882 wait complete. 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.907+0000 7f7547968700 1 Processor -- start 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.907+0000 7f7547968700 1 -- start start 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.907+0000 7f7547968700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7540102380 0x7f754006c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.907+0000 7f7547968700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7540103580 0x7f754019e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.907+0000 7f7547968700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7540103f20 0x7f75401a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.907+0000 7f7547968700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f754010df70 con 0x7f7540102380 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.907+0000 7f7547968700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f754010ddf0 con 0x7f7540103f20 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.907+0000 7f7547968700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f754010e0f0 con 0x7f7540103580 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.907+0000 7f7545704700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7540102380 0x7f754006c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7545704700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7540102380 0x7f754006c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46438/0 (socket says 172.21.15.70:46438) 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7545704700 1 -- 172.21.15.70:0/2760105890 learned_addr learned my addr 172.21.15.70:0/2760105890 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7544f03700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7540103580 0x7f754019e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7545f05700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7540103f20 0x7f75401a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7545704700 1 -- 172.21.15.70:0/2760105890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7540103580 msgr2=0x7f754019e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7545704700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7540103580 0x7f754019e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7545704700 1 -- 172.21.15.70:0/2760105890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7540103f20 msgr2=0x7f75401a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7545704700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7540103f20 0x7f75401a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7545704700 1 -- 172.21.15.70:0/2760105890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75401a12d0 con 0x7f7540102380 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7545704700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7540102380 0x7f754006c6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7530003790 tx=0x7f753000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f75367fc700 1 -- 172.21.15.70:0/2760105890 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530027070 con 0x7f7540102380 2024-04-26T20:24:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7547968700 1 -- 172.21.15.70:0/2760105890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75401a1560 con 0x7f7540102380 2024-04-26T20:24:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f75367fc700 1 -- 172.21.15.70:0/2760105890 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f753000fc60 con 0x7f7540102380 2024-04-26T20:24:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f75367fc700 1 -- 172.21.15.70:0/2760105890 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75300173f0 con 0x7f7540102380 2024-04-26T20:24:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.908+0000 7f7547968700 1 -- 172.21.15.70:0/2760105890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75401a1a90 con 0x7f7540102380 2024-04-26T20:24:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.909+0000 7f7547968700 1 -- 172.21.15.70:0/2760105890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754006a110 con 0x7f7540102380 2024-04-26T20:24:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.910+0000 7f75367fc700 1 -- 172.21.15.70:0/2760105890 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f753002a070 con 0x7f7540102380 2024-04-26T20:24:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.911+0000 7f75367fc700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f752c0a3c40 0x7f752c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.911+0000 7f7544f03700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f752c0a3c40 0x7f752c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.911+0000 7f75367fc700 1 -- 172.21.15.70:0/2760105890 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6847+0+0 (secure 0 0 0) 0x7f75300d10e0 con 0x7f7540102380 2024-04-26T20:24:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.911+0000 7f7544f03700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f752c0a3c40 0x7f752c0a6100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f754006cc30 tx=0x7f753c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:21.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:21.915+0000 7f75367fc700 1 -- 172.21.15.70:0/2760105890 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7530031070 con 0x7f7540102380 2024-04-26T20:24:22.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.114+0000 7f7547968700 1 -- 172.21.15.70:0/2760105890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f754002e490 con 0x7f7540102380 2024-04-26T20:24:22.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.115+0000 7f75367fc700 1 -- 172.21.15.70:0/2760105890 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) ==== 74+0+133 (secure 0 0 0) 0x7f7530013070 con 0x7f7540102380 2024-04-26T20:24:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 -- 172.21.15.70:0/2760105890 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f752c0a3c40 msgr2=0x7f752c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f752c0a3c40 0x7f752c0a6100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f754006cc30 tx=0x7f753c00a300 comp rx=0 tx=0).stop 2024-04-26T20:24:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 -- 172.21.15.70:0/2760105890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7540102380 msgr2=0x7f754006c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7540102380 0x7f754006c6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7530003790 tx=0x7f753000fa00 comp rx=0 tx=0).stop 2024-04-26T20:24:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 -- 172.21.15.70:0/2760105890 shutdown_connections 2024-04-26T20:24:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f752c0a3c40 0x7f752c0a6100 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7540103f20 0x7f75401a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7540102380 0x7f754006c6b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 --2- 172.21.15.70:0/2760105890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7540103580 0x7f754019e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 -- 172.21.15.70:0/2760105890 >> 172.21.15.70:0/2760105890 conn(0x7f75400fd920 msgr2=0x7f7540106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 -- 172.21.15.70:0/2760105890 shutdown_connections 2024-04-26T20:24:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:22.117+0000 7f7547968700 1 -- 172.21.15.70:0/2760105890 wait complete. 2024-04-26T20:24:22.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:21 smithi080 ceph-mon[32278]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:24:22.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:21 smithi080 ceph-mon[32278]: osdmap e80: 12 total, 11 up, 12 in 2024-04-26T20:24:22.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:21 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:22.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:21 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:22.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:21 smithi080 ceph-mon[32278]: from='osd.11 ' entity='osd.11' 2024-04-26T20:24:22.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:21 smithi080 ceph-mon[32278]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:22.280 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:21 smithi098 ceph-mon[32591]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:24:22.281 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:21 smithi098 ceph-mon[32591]: osdmap e80: 12 total, 11 up, 12 in 2024-04-26T20:24:22.281 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:21 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:22.281 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:21 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:22.281 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:21 smithi098 ceph-mon[32591]: from='osd.11 ' entity='osd.11' 2024-04-26T20:24:22.281 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:21 smithi098 ceph-mon[32591]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:22.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:21 smithi070 ceph-mon[29124]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-04-26T20:24:22.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:21 smithi070 ceph-mon[29124]: osdmap e80: 12 total, 11 up, 12 in 2024-04-26T20:24:22.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:21 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:22.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:21 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:22.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:21 smithi070 ceph-mon[29124]: from='osd.11 ' entity='osd.11' 2024-04-26T20:24:22.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:21 smithi070 ceph-mon[29124]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:24:22.855 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":80,"num_osds":12,"num_up_osds":11,"osd_up_since":1714163035,"num_in_osds":12,"osd_in_since":1714163041,"num_remapped_pgs":0} 2024-04-26T20:24:23.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:22 smithi080 ceph-mon[32278]: purged_snaps scrub starts 2024-04-26T20:24:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:22 smithi080 ceph-mon[32278]: purged_snaps scrub ok 2024-04-26T20:24:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:22 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:22 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2760105890' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T20:24:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:22 smithi080 ceph-mon[32278]: osd.11 [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539] boot 2024-04-26T20:24:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:22 smithi080 ceph-mon[32278]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T20:24:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:22 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:23.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:22 smithi070 ceph-mon[29124]: purged_snaps scrub starts 2024-04-26T20:24:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:22 smithi070 ceph-mon[29124]: purged_snaps scrub ok 2024-04-26T20:24:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:22 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:22 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2760105890' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T20:24:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:22 smithi070 ceph-mon[29124]: osd.11 [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539] boot 2024-04-26T20:24:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:22 smithi070 ceph-mon[29124]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T20:24:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:22 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:23.358 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:22 smithi098 ceph-mon[32591]: purged_snaps scrub starts 2024-04-26T20:24:23.358 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:22 smithi098 ceph-mon[32591]: purged_snaps scrub ok 2024-04-26T20:24:23.358 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:22 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:23.358 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:22 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2760105890' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T20:24:23.358 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:22 smithi098 ceph-mon[32591]: osd.11 [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539] boot 2024-04-26T20:24:23.358 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:22 smithi098 ceph-mon[32591]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T20:24:23.358 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:22 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:24:23.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-26T20:24:24.096 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:24:25.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:25.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: Detected new or changed devices on smithi098 2024-04-26T20:24:25.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi098 to 4272M 2024-04-26T20:24:25.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:25.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:25.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T20:24:25.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:25.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:25.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:25.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:24 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:25.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: Detected new or changed devices on smithi098 2024-04-26T20:24:25.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi098 to 4272M 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:24 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: Detected new or changed devices on smithi098 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi098 to 4272M 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T20:24:25.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:25.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:25.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:25.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:24 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.682+0000 7fcb0203a700 1 -- 172.21.15.70:0/3257054812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcafc103480 msgr2=0x7fcafc1038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.682+0000 7fcb0203a700 1 --2- 172.21.15.70:0/3257054812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcafc103480 0x7fcafc1038a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00099c0 tx=0x7fcaf0009cd0 comp rx=0 tx=0).stop 2024-04-26T20:24:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.682+0000 7fcb0203a700 1 -- 172.21.15.70:0/3257054812 shutdown_connections 2024-04-26T20:24:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.682+0000 7fcb0203a700 1 --2- 172.21.15.70:0/3257054812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcafc105020 0x7fcafc10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.682+0000 7fcb0203a700 1 --2- 172.21.15.70:0/3257054812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcafc103480 0x7fcafc1038a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.682+0000 7fcb0203a700 1 --2- 172.21.15.70:0/3257054812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcafc104680 0x7fcafc104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.682+0000 7fcb0203a700 1 -- 172.21.15.70:0/3257054812 >> 172.21.15.70:0/3257054812 conn(0x7fcafc0fea20 msgr2=0x7fcafc100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.682+0000 7fcb0203a700 1 -- 172.21.15.70:0/3257054812 shutdown_connections 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.682+0000 7fcb0203a700 1 -- 172.21.15.70:0/3257054812 wait complete. 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.682+0000 7fcb0203a700 1 Processor -- start 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcb0203a700 1 -- start start 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcb0203a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcafc103480 0x7fcafc0771c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcb0203a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcafc104680 0x7fcafc075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcb0203a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcafc105020 0x7fcafc075d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcb0203a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc10f0b0 con 0x7fcafc103480 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcb0203a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc10ef30 con 0x7fcafc105020 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcb0203a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc10f230 con 0x7fcafc104680 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcafb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcafc103480 0x7fcafc0771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcafb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcafc103480 0x7fcafc0771c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46464/0 (socket says 172.21.15.70:46464) 2024-04-26T20:24:25.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcafb7fe700 1 -- 172.21.15.70:0/2778980299 learned_addr learned my addr 172.21.15.70:0/2778980299 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:25.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcafaffd700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcafc104680 0x7fcafc075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:25.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcafbfff700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcafc105020 0x7fcafc075d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:25.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcafb7fe700 1 -- 172.21.15.70:0/2778980299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcafc104680 msgr2=0x7fcafc075810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:25.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcafb7fe700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcafc104680 0x7fcafc075810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:25.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcafb7fe700 1 -- 172.21.15.70:0/2778980299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcafc105020 msgr2=0x7fcafc075d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:25.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcafb7fe700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcafc105020 0x7fcafc075d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:25.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcafb7fe700 1 -- 172.21.15.70:0/2778980299 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc076600 con 0x7fcafc103480 2024-04-26T20:24:25.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.683+0000 7fcafb7fe700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcafc103480 0x7fcafc0771c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0003790 tx=0x7fcaf000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:25.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.684+0000 7fcaf8ff9700 1 -- 172.21.15.70:0/2778980299 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0027070 con 0x7fcafc103480 2024-04-26T20:24:25.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.684+0000 7fcaf8ff9700 1 -- 172.21.15.70:0/2778980299 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcaf000fc60 con 0x7fcafc103480 2024-04-26T20:24:25.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.684+0000 7fcb0203a700 1 -- 172.21.15.70:0/2778980299 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcafc1a37f0 con 0x7fcafc103480 2024-04-26T20:24:25.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.684+0000 7fcaf8ff9700 1 -- 172.21.15.70:0/2778980299 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00173f0 con 0x7fcafc103480 2024-04-26T20:24:25.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.684+0000 7fcb0203a700 1 -- 172.21.15.70:0/2778980299 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcafc1a3cd0 con 0x7fcafc103480 2024-04-26T20:24:25.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.685+0000 7fcb0203a700 1 -- 172.21.15.70:0/2778980299 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcafc06a110 con 0x7fcafc103480 2024-04-26T20:24:25.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.686+0000 7fcaf8ff9700 1 -- 172.21.15.70:0/2778980299 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fcaf002a070 con 0x7fcafc103480 2024-04-26T20:24:25.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.686+0000 7fcaf8ff9700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcae40a3cc0 0x7fcae40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:25.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.686+0000 7fcafaffd700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcae40a3cc0 0x7fcae40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:25.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.686+0000 7fcaf8ff9700 1 -- 172.21.15.70:0/2778980299 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fcaf00d11a0 con 0x7fcafc103480 2024-04-26T20:24:25.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.687+0000 7fcafaffd700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcae40a3cc0 0x7fcae40a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcaec005950 tx=0x7fcaec00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:25.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.690+0000 7fcaf8ff9700 1 -- 172.21.15.70:0/2778980299 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fcaf0031070 con 0x7fcafc103480 2024-04-26T20:24:25.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.892+0000 7fcb0203a700 1 -- 172.21.15.70:0/2778980299 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fcafc064030 con 0x7fcafc103480 2024-04-26T20:24:25.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.892+0000 7fcaf8ff9700 1 -- 172.21.15.70:0/2778980299 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) ==== 74+0+133 (secure 0 0 0) 0x7fcaf0013070 con 0x7fcafc103480 2024-04-26T20:24:25.893 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:25.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.894+0000 7fcb0203a700 1 -- 172.21.15.70:0/2778980299 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcae40a3cc0 msgr2=0x7fcae40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:25.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.894+0000 7fcb0203a700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcae40a3cc0 0x7fcae40a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcaec005950 tx=0x7fcaec00b410 comp rx=0 tx=0).stop 2024-04-26T20:24:25.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.894+0000 7fcb0203a700 1 -- 172.21.15.70:0/2778980299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcafc103480 msgr2=0x7fcafc0771c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:25.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.894+0000 7fcb0203a700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcafc103480 0x7fcafc0771c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0003790 tx=0x7fcaf000fa00 comp rx=0 tx=0).stop 2024-04-26T20:24:25.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.894+0000 7fcb0203a700 1 -- 172.21.15.70:0/2778980299 shutdown_connections 2024-04-26T20:24:25.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.894+0000 7fcb0203a700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcae40a3cc0 0x7fcae40a6180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:25.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.894+0000 7fcb0203a700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcafc105020 0x7fcafc075d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:25.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.894+0000 7fcb0203a700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcafc103480 0x7fcafc0771c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:25.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.894+0000 7fcb0203a700 1 --2- 172.21.15.70:0/2778980299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcafc104680 0x7fcafc075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:25.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.894+0000 7fcb0203a700 1 -- 172.21.15.70:0/2778980299 >> 172.21.15.70:0/2778980299 conn(0x7fcafc0fea20 msgr2=0x7fcafc107a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:25.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.894+0000 7fcb0203a700 1 -- 172.21.15.70:0/2778980299 shutdown_connections 2024-04-26T20:24:25.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:25.895+0000 7fcb0203a700 1 -- 172.21.15.70:0/2778980299 wait complete. 2024-04-26T20:24:26.728 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1714163062,"num_in_osds":12,"osd_in_since":1714163041,"num_remapped_pgs":0} 2024-04-26T20:24:26.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T20:24:26.968 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:24:27.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:26 smithi070 ceph-mon[29124]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:27.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:26 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2778980299' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T20:24:27.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:26 smithi098 ceph-mon[32591]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:27.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:26 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2778980299' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T20:24:27.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:26 smithi080 ceph-mon[32278]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:27.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:26 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2778980299' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T20:24:28.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.761+0000 7fbd0622f700 1 -- 172.21.15.70:0/482493180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd00075650 msgr2=0x7fbd00075a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:28.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.761+0000 7fbd0622f700 1 --2- 172.21.15.70:0/482493180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd00075650 0x7fbd00075a30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009990 tx=0x7fbcf4009ca0 comp rx=0 tx=0).stop 2024-04-26T20:24:28.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.761+0000 7fbd0622f700 1 -- 172.21.15.70:0/482493180 shutdown_connections 2024-04-26T20:24:28.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.761+0000 7fbd0622f700 1 --2- 172.21.15.70:0/482493180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd0010fe20 0x7fbd00112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:28.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.761+0000 7fbd0622f700 1 --2- 172.21.15.70:0/482493180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd00075650 0x7fbd00075a30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:28.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.761+0000 7fbd0622f700 1 --2- 172.21.15.70:0/482493180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd00075f70 0x7fbd0010f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:28.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.761+0000 7fbd0622f700 1 -- 172.21.15.70:0/482493180 >> 172.21.15.70:0/482493180 conn(0x7fbd0007a580 msgr2=0x7fbd0007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.761+0000 7fbd0622f700 1 -- 172.21.15.70:0/482493180 shutdown_connections 2024-04-26T20:24:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.761+0000 7fbd0622f700 1 -- 172.21.15.70:0/482493180 wait complete. 2024-04-26T20:24:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.762+0000 7fbd0622f700 1 Processor -- start 2024-04-26T20:24:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.762+0000 7fbd0622f700 1 -- start start 2024-04-26T20:24:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.762+0000 7fbd0622f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd00075650 0x7fbd0019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.762+0000 7fbd0622f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd00075f70 0x7fbd0019c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.762+0000 7fbd0622f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0010fe20 0x7fbd001a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.762+0000 7fbd0622f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbd00115960 con 0x7fbd00075f70 2024-04-26T20:24:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.762+0000 7fbd0622f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbd001157e0 con 0x7fbd00075650 2024-04-26T20:24:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.762+0000 7fbd0622f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbd00115ae0 con 0x7fbd0010fe20 2024-04-26T20:24:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.762+0000 7fbcfeffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd00075f70 0x7fbd0019c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.762+0000 7fbcfeffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd00075f70 0x7fbd0019c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46478/0 (socket says 172.21.15.70:46478) 2024-04-26T20:24:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.762+0000 7fbcfeffd700 1 -- 172.21.15.70:0/3143895015 learned_addr learned my addr 172.21.15.70:0/3143895015 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcff7fe700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd00075650 0x7fbd0019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcfffff700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0010fe20 0x7fbd001a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcfeffd700 1 -- 172.21.15.70:0/3143895015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0010fe20 msgr2=0x7fbd001a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcfeffd700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0010fe20 0x7fbd001a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcfeffd700 1 -- 172.21.15.70:0/3143895015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd00075650 msgr2=0x7fbd0019be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcfeffd700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd00075650 0x7fbd0019be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcfeffd700 1 -- 172.21.15.70:0/3143895015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd001a0e20 con 0x7fbd00075f70 2024-04-26T20:24:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcff7fe700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd00075650 0x7fbd0019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcfeffd700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd00075f70 0x7fbd0019c350 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c920 tx=0x7fbcf000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:28.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcfcff9700 1 -- 172.21.15.70:0/3143895015 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0007b00 con 0x7fbd00075f70 2024-04-26T20:24:28.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbd0622f700 1 -- 172.21.15.70:0/3143895015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd001a1110 con 0x7fbd00075f70 2024-04-26T20:24:28.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcfcff9700 1 -- 172.21.15.70:0/3143895015 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcf0004d00 con 0x7fbd00075f70 2024-04-26T20:24:28.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbcfcff9700 1 -- 172.21.15.70:0/3143895015 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0005620 con 0x7fbd00075f70 2024-04-26T20:24:28.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.763+0000 7fbd0622f700 1 -- 172.21.15.70:0/3143895015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd001a8990 con 0x7fbd00075f70 2024-04-26T20:24:28.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.764+0000 7fbd0622f700 1 -- 172.21.15.70:0/3143895015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd0006a110 con 0x7fbd00075f70 2024-04-26T20:24:28.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.765+0000 7fbcfcff9700 1 -- 172.21.15.70:0/3143895015 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fbcf0004750 con 0x7fbd00075f70 2024-04-26T20:24:28.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.766+0000 7fbcfcff9700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbce80a3c40 0x7fbce80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:28.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.766+0000 7fbcff7fe700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbce80a3c40 0x7fbce80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:28.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.766+0000 7fbcfcff9700 1 -- 172.21.15.70:0/3143895015 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fbcf00cfc60 con 0x7fbd00075f70 2024-04-26T20:24:28.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.766+0000 7fbcff7fe700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbce80a3c40 0x7fbce80a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4006010 tx=0x7fbcf400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:28.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.770+0000 7fbcfcff9700 1 -- 172.21.15.70:0/3143895015 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fbcf0014030 con 0x7fbd00075f70 2024-04-26T20:24:28.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.971+0000 7fbd0622f700 1 -- 172.21.15.70:0/3143895015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd0002e490 con 0x7fbd00075f70 2024-04-26T20:24:28.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.973+0000 7fbcfcff9700 1 -- 172.21.15.70:0/3143895015 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18385 (secure 0 0 0) 0x7fbcf009cae0 con 0x7fbd00075f70 2024-04-26T20:24:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:28.974 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":82,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:24:23.963706+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:24:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 -- 172.21.15.70:0/3143895015 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbce80a3c40 msgr2=0x7fbce80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbce80a3c40 0x7fbce80a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4006010 tx=0x7fbcf400b540 comp rx=0 tx=0).stop 2024-04-26T20:24:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 -- 172.21.15.70:0/3143895015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd00075f70 msgr2=0x7fbd0019c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd00075f70 0x7fbd0019c350 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c920 tx=0x7fbcf000cce0 comp rx=0 tx=0).stop 2024-04-26T20:24:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 -- 172.21.15.70:0/3143895015 shutdown_connections 2024-04-26T20:24:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fbce80a3c40 0x7fbce80a6100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0010fe20 0x7fbd001a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd00075650 0x7fbd0019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:28.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 --2- 172.21.15.70:0/3143895015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd00075f70 0x7fbd0019c350 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:28.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 -- 172.21.15.70:0/3143895015 >> 172.21.15.70:0/3143895015 conn(0x7fbd0007a580 msgr2=0x7fbd001005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:28.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 -- 172.21.15.70:0/3143895015 shutdown_connections 2024-04-26T20:24:28.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:28.975+0000 7fbd0622f700 1 -- 172.21.15.70:0/3143895015 wait complete. 2024-04-26T20:24:29.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:28 smithi098 ceph-mon[32591]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:29.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:28 smithi080 ceph-mon[32278]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:29.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:28 smithi070 ceph-mon[29124]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:29.828 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:20:33.781367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:24:29.828 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-26T20:24:30.065 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:24:30.204 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:29 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3143895015' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:24:30.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:29 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3143895015' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:24:30.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:29 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3143895015' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:24:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:30 smithi098 ceph-mon[32591]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:31.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:30 smithi080 ceph-mon[32278]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:31.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:30 smithi070 ceph-mon[29124]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.862+0000 7f4eca121700 1 -- 172.21.15.70:0/2232590184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec4102d10 msgr2=0x7f4ec410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.862+0000 7f4eca121700 1 --2- 172.21.15.70:0/2232590184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec4102d10 0x7f4ec410f2d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00b0a0 tx=0x7f4ebc00b3b0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.863+0000 7f4eca121700 1 -- 172.21.15.70:0/2232590184 shutdown_connections 2024-04-26T20:24:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.863+0000 7f4eca121700 1 --2- 172.21.15.70:0/2232590184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec4102d10 0x7f4ec410f2d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.863+0000 7f4eca121700 1 --2- 172.21.15.70:0/2232590184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ec4104270 0x7f4ec4104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.863+0000 7f4eca121700 1 --2- 172.21.15.70:0/2232590184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ec4102350 0x7f4ec41027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.863+0000 7f4eca121700 1 -- 172.21.15.70:0/2232590184 >> 172.21.15.70:0/2232590184 conn(0x7f4ec4078390 msgr2=0x7f4ec40787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.863+0000 7f4eca121700 1 -- 172.21.15.70:0/2232590184 shutdown_connections 2024-04-26T20:24:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.863+0000 7f4eca121700 1 -- 172.21.15.70:0/2232590184 wait complete. 2024-04-26T20:24:31.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.863+0000 7f4eca121700 1 Processor -- start 2024-04-26T20:24:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4eca121700 1 -- start start 2024-04-26T20:24:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4eca121700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ec4102350 0x7f4ec41987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4eca121700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ec4102d10 0x7f4ec4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4eca121700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec4104270 0x7f4ec4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4ec3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec4104270 0x7f4ec4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4ec3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec4104270 0x7f4ec4199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43798/0 (socket says 172.21.15.70:43798) 2024-04-26T20:24:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4ec3fff700 1 -- 172.21.15.70:0/3302125672 learned_addr learned my addr 172.21.15.70:0/3302125672 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec41126f0 con 0x7f4ec4104270 2024-04-26T20:24:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec4112570 con 0x7f4ec4102350 2024-04-26T20:24:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4ec2ffd700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ec4102d10 0x7f4ec4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec4112870 con 0x7f4ec4102d10 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4ec37fe700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ec4102350 0x7f4ec41987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4ec3fff700 1 -- 172.21.15.70:0/3302125672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ec4102d10 msgr2=0x7f4ec4198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4ec3fff700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ec4102d10 0x7f4ec4198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4ec3fff700 1 -- 172.21.15.70:0/3302125672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ec4102350 msgr2=0x7f4ec41987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4ec3fff700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ec4102350 0x7f4ec41987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4ec3fff700 1 -- 172.21.15.70:0/3302125672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec41a8090 con 0x7f4ec4104270 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.864+0000 7f4ec37fe700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ec4102350 0x7f4ec41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.865+0000 7f4ec3fff700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec4104270 0x7f4ec4199260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00b830 tx=0x7f4ebc007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.865+0000 7f4ec0ff9700 1 -- 172.21.15.70:0/3302125672 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc007e60 con 0x7f4ec4104270 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.865+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec41a8320 con 0x7f4ec4104270 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.865+0000 7f4ec0ff9700 1 -- 172.21.15.70:0/3302125672 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ebc003c00 con 0x7f4ec4104270 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.865+0000 7f4ec0ff9700 1 -- 172.21.15.70:0/3302125672 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc01d8f0 con 0x7f4ec4104270 2024-04-26T20:24:31.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.865+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec41a8800 con 0x7f4ec4104270 2024-04-26T20:24:31.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.866+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec406a110 con 0x7f4ec4104270 2024-04-26T20:24:31.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.867+0000 7f4ec0ff9700 1 -- 172.21.15.70:0/3302125672 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f4ebc01da90 con 0x7f4ec4104270 2024-04-26T20:24:31.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.868+0000 7f4ec0ff9700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4eac0a3c40 0x7f4eac0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.868+0000 7f4ec37fe700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4eac0a3c40 0x7f4eac0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.868+0000 7f4ec0ff9700 1 -- 172.21.15.70:0/3302125672 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f4ebc00f020 con 0x7f4ec4104270 2024-04-26T20:24:31.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.868+0000 7f4ec37fe700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4eac0a3c40 0x7f4eac0a6100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4005950 tx=0x7f4eb400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:31.872+0000 7f4ec0ff9700 1 -- 172.21.15.70:0/3302125672 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f4ebc09e350 con 0x7f4ec4104270 2024-04-26T20:24:32.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.066+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4ec41a8b20 con 0x7f4ec4104270 2024-04-26T20:24:32.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.067+0000 7f4ec0ff9700 1 -- 172.21.15.70:0/3302125672 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f4ebc09dc50 con 0x7f4ec4104270 2024-04-26T20:24:32.068 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-04-26T20:24:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4eac0a3c40 msgr2=0x7f4eac0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4eac0a3c40 0x7f4eac0a6100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4005950 tx=0x7f4eb400b410 comp rx=0 tx=0).stop 2024-04-26T20:24:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec4104270 msgr2=0x7f4ec4199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec4104270 0x7f4ec4199260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00b830 tx=0x7f4ebc007a20 comp rx=0 tx=0).stop 2024-04-26T20:24:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 shutdown_connections 2024-04-26T20:24:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f4eac0a3c40 0x7f4eac0a6100 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:32.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec4104270 0x7f4ec4199260 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:32.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ec4102350 0x7f4ec41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:32.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 --2- 172.21.15.70:0/3302125672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ec4102d10 0x7f4ec4198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:32.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 >> 172.21.15.70:0/3302125672 conn(0x7f4ec4078390 msgr2=0x7f4ec4100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:32.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 shutdown_connections 2024-04-26T20:24:32.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:32.069+0000 7f4eca121700 1 -- 172.21.15.70:0/3302125672 wait complete. 2024-04-26T20:24:32.810 INFO:tasks.cephadm:Adding mds.a on smithi070 2024-04-26T20:24:32.810 INFO:tasks.cephadm:Adding mds.d on smithi070 2024-04-26T20:24:32.810 INFO:tasks.cephadm:Adding mds.g on smithi070 2024-04-26T20:24:32.810 INFO:tasks.cephadm:Adding mds.j on smithi070 2024-04-26T20:24:32.811 INFO:tasks.cephadm:Adding mds.b on smithi080 2024-04-26T20:24:32.811 INFO:tasks.cephadm:Adding mds.e on smithi080 2024-04-26T20:24:32.811 INFO:tasks.cephadm:Adding mds.h on smithi080 2024-04-26T20:24:32.811 INFO:tasks.cephadm:Adding mds.k on smithi080 2024-04-26T20:24:32.811 INFO:tasks.cephadm:Adding mds.c on smithi098 2024-04-26T20:24:32.811 INFO:tasks.cephadm:Adding mds.f on smithi098 2024-04-26T20:24:32.811 INFO:tasks.cephadm:Adding mds.i on smithi098 2024-04-26T20:24:32.811 INFO:tasks.cephadm:Adding mds.l on smithi098 2024-04-26T20:24:32.811 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi080=b;smithi080=e;smithi080=h;smithi080=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l' 2024-04-26T20:24:33.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:32 smithi070 ceph-mon[29124]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:32 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3302125672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:24:33.055 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:24:33.177 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:32 smithi098 ceph-mon[32591]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:33.177 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:32 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3302125672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:24:33.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:32 smithi080 ceph-mon[32278]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:32 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3302125672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:24:34.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.747+0000 7fc726e7f700 1 -- 172.21.15.98:0/1796905352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc720103f30 msgr2=0x7fc72010a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:34.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.747+0000 7fc726e7f700 1 --2- 172.21.15.98:0/1796905352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc720103f30 0x7fc72010a7e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc71800b0a0 tx=0x7fc71800b3b0 comp rx=0 tx=0).stop 2024-04-26T20:24:34.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.747+0000 7fc726e7f700 1 -- 172.21.15.98:0/1796905352 shutdown_connections 2024-04-26T20:24:34.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.747+0000 7fc726e7f700 1 --2- 172.21.15.98:0/1796905352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc720103f30 0x7fc72010a7e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:34.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.747+0000 7fc726e7f700 1 --2- 172.21.15.98:0/1796905352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc720102390 0x7fc7201027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:34.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.747+0000 7fc726e7f700 1 --2- 172.21.15.98:0/1796905352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc720103590 0x7fc7201039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:34.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.747+0000 7fc726e7f700 1 -- 172.21.15.98:0/1796905352 >> 172.21.15.98:0/1796905352 conn(0x7fc7200fd950 msgr2=0x7fc7200ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:34.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.747+0000 7fc726e7f700 1 -- 172.21.15.98:0/1796905352 shutdown_connections 2024-04-26T20:24:34.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.747+0000 7fc726e7f700 1 -- 172.21.15.98:0/1796905352 wait complete. 2024-04-26T20:24:34.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.748+0000 7fc726e7f700 1 Processor -- start 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.748+0000 7fc726e7f700 1 -- start start 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.748+0000 7fc726e7f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc720102390 0x7fc72006c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.748+0000 7fc726e7f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc720103590 0x7fc72019e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.748+0000 7fc726e7f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc720103f30 0x7fc7201a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.748+0000 7fc726e7f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc72010e060 con 0x7fc720103590 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.748+0000 7fc726e7f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc72010dee0 con 0x7fc720102390 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.748+0000 7fc726e7f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc72010e1e0 con 0x7fc720103f30 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc72541c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc720103f30 0x7fc7201a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc72541c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc720103f30 0x7fc7201a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52498/0 (socket says 172.21.15.98:52498) 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc72541c700 1 -- 172.21.15.98:0/1972050695 learned_addr learned my addr 172.21.15.98:0/1972050695 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc71ffff700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc720103590 0x7fc72019e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc724c1b700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc720102390 0x7fc72006c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:34.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc72541c700 1 -- 172.21.15.98:0/1972050695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc720102390 msgr2=0x7fc72006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc72541c700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc720102390 0x7fc72006c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc72541c700 1 -- 172.21.15.98:0/1972050695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc720103590 msgr2=0x7fc72019e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc72541c700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc720103590 0x7fc72019e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc72541c700 1 -- 172.21.15.98:0/1972050695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7201a13d0 con 0x7fc720103f30 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc71ffff700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc720103590 0x7fc72019e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc724c1b700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc720102390 0x7fc72006c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc72541c700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc720103f30 0x7fc7201a0b00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc718006130 tx=0x7fc718007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc71dffb700 1 -- 172.21.15.98:0/1972050695 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718003e10 con 0x7fc720103f30 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc71dffb700 1 -- 172.21.15.98:0/1972050695 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc718005540 con 0x7fc720103f30 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc726e7f700 1 -- 172.21.15.98:0/1972050695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7201a1660 con 0x7fc720103f30 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc71dffb700 1 -- 172.21.15.98:0/1972050695 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71801bbb0 con 0x7fc720103f30 2024-04-26T20:24:34.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.749+0000 7fc726e7f700 1 -- 172.21.15.98:0/1972050695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7201a1b90 con 0x7fc720103f30 2024-04-26T20:24:34.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.750+0000 7fc726e7f700 1 -- 172.21.15.98:0/1972050695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc72006a110 con 0x7fc720103f30 2024-04-26T20:24:34.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.751+0000 7fc71dffb700 1 -- 172.21.15.98:0/1972050695 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc7180056f0 con 0x7fc720103f30 2024-04-26T20:24:34.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.752+0000 7fc71dffb700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc7100a3cc0 0x7fc7100a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:34.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.752+0000 7fc71dffb700 1 -- 172.21.15.98:0/1972050695 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fc71800f020 con 0x7fc720103f30 2024-04-26T20:24:34.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.752+0000 7fc724c1b700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc7100a3cc0 0x7fc7100a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:34.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.753+0000 7fc724c1b700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc7100a3cc0 0x7fc7100a6180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7201033f0 tx=0x7fc714008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:34.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.757+0000 7fc71dffb700 1 -- 172.21.15.98:0/1972050695 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc71809e390 con 0x7fc720103f30 2024-04-26T20:24:34.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.967+0000 7fc726e7f700 1 -- 172.21.15.98:0/1972050695 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi080=b;smithi080=e;smithi080=h;smithi080=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}) -- 0x7fc720063960 con 0x7fc7100a3cc0 2024-04-26T20:24:34.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.975+0000 7fc71dffb700 1 -- 172.21.15.98:0/1972050695 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fc720063960 con 0x7fc7100a3cc0 2024-04-26T20:24:34.976 INFO:teuthology.orchestra.run.smithi098.stdout:Scheduled mds.all update... 2024-04-26T20:24:34.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 -- 172.21.15.98:0/1972050695 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc7100a3cc0 msgr2=0x7fc7100a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:34.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc7100a3cc0 0x7fc7100a6180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7201033f0 tx=0x7fc714008040 comp rx=0 tx=0).stop 2024-04-26T20:24:34.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 -- 172.21.15.98:0/1972050695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc720103f30 msgr2=0x7fc7201a0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:34.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc720103f30 0x7fc7201a0b00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc718006130 tx=0x7fc718007d90 comp rx=0 tx=0).stop 2024-04-26T20:24:34.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 -- 172.21.15.98:0/1972050695 shutdown_connections 2024-04-26T20:24:34.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc7100a3cc0 0x7fc7100a6180 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:34.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc720103f30 0x7fc7201a0b00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:34.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc720102390 0x7fc72006c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:34.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 --2- 172.21.15.98:0/1972050695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc720103590 0x7fc72019e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:34.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 -- 172.21.15.98:0/1972050695 >> 172.21.15.98:0/1972050695 conn(0x7fc7200fd950 msgr2=0x7fc720106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:34.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 -- 172.21.15.98:0/1972050695 shutdown_connections 2024-04-26T20:24:34.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T20:24:34.977+0000 7fc726e7f700 1 -- 172.21.15.98:0/1972050695 wait complete. 2024-04-26T20:24:35.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:34 smithi098 ceph-mon[32591]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:35.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:34 smithi080 ceph-mon[32278]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:35.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:34 smithi070 ceph-mon[29124]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:35.652 DEBUG:teuthology.orchestra.run.smithi070:mds.a> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.a.service 2024-04-26T20:24:35.655 DEBUG:teuthology.orchestra.run.smithi070:mds.d> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.d.service 2024-04-26T20:24:35.698 DEBUG:teuthology.orchestra.run.smithi070:mds.g> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.g.service 2024-04-26T20:24:35.741 DEBUG:teuthology.orchestra.run.smithi070:mds.j> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.j.service 2024-04-26T20:24:35.785 DEBUG:teuthology.orchestra.run.smithi080:mds.b> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.b.service 2024-04-26T20:24:35.787 DEBUG:teuthology.orchestra.run.smithi080:mds.e> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.e.service 2024-04-26T20:24:35.830 DEBUG:teuthology.orchestra.run.smithi080:mds.h> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.h.service 2024-04-26T20:24:35.873 DEBUG:teuthology.orchestra.run.smithi080:mds.k> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.k.service 2024-04-26T20:24:35.916 DEBUG:teuthology.orchestra.run.smithi098:mds.c> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.c.service 2024-04-26T20:24:35.919 DEBUG:teuthology.orchestra.run.smithi098:mds.f> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.f.service 2024-04-26T20:24:35.962 DEBUG:teuthology.orchestra.run.smithi098:mds.i> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.i.service 2024-04-26T20:24:36.006 DEBUG:teuthology.orchestra.run.smithi098:mds.l> sudo journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.l.service 2024-04-26T20:24:36.049 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-26T20:24:36.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:24:36.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.161+0000 7f933d54d640 1 -- 172.21.15.70:0/1326764287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93381034a0 msgr2=0x7f9338109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.161+0000 7f933d54d640 1 --2- 172.21.15.70:0/1326764287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93381034a0 0x7f9338109d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9330009ca0 tx=0x7f933002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.161+0000 7f933d54d640 1 -- 172.21.15.70:0/1326764287 shutdown_connections 2024-04-26T20:24:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.161+0000 7f933d54d640 1 --2- 172.21.15.70:0/1326764287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93381034a0 0x7f9338109d30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.161+0000 7f933d54d640 1 --2- 172.21.15.70:0/1326764287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9338102ae0 0x7f9338102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.161+0000 7f933d54d640 1 --2- 172.21.15.70:0/1326764287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93381018f0 0x7f9338101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.161+0000 7f933d54d640 1 -- 172.21.15.70:0/1326764287 >> 172.21.15.70:0/1326764287 conn(0x7f93380fcea0 msgr2=0x7f93380ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.161+0000 7f933d54d640 1 -- 172.21.15.70:0/1326764287 shutdown_connections 2024-04-26T20:24:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.161+0000 7f933d54d640 1 -- 172.21.15.70:0/1326764287 wait complete. 2024-04-26T20:24:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f933d54d640 1 Processor -- start 2024-04-26T20:24:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f933d54d640 1 -- start start 2024-04-26T20:24:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f933d54d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93381018f0 0x7f9338198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f933d54d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9338102ae0 0x7f9338199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f933d54d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93381034a0 0x7f93381a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f933d54d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f933810e5e0 con 0x7f9338102ae0 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f933d54d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f933810e460 con 0x7f93381018f0 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f933d54d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f933810e760 con 0x7f93381034a0 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f932ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9338102ae0 0x7f9338199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f932ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9338102ae0 0x7f9338199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43814/0 (socket says 172.21.15.70:43814) 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f932ffff640 1 -- 172.21.15.70:0/2194441818 learned_addr learned my addr 172.21.15.70:0/2194441818 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f932ffff640 1 -- 172.21.15.70:0/2194441818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93381034a0 msgr2=0x7f93381a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f9336ffd640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93381018f0 0x7f9338198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f93377fe640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93381034a0 0x7f93381a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f932ffff640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93381034a0 0x7f93381a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f932ffff640 1 -- 172.21.15.70:0/2194441818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93381018f0 msgr2=0x7f9338198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.162+0000 7f932ffff640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93381018f0 0x7f9338198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.163+0000 7f932ffff640 1 -- 172.21.15.70:0/2194441818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93381a0770 con 0x7f9338102ae0 2024-04-26T20:24:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.163+0000 7f932ffff640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9338102ae0 0x7f9338199090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f932000c920 tx=0x7f932000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.163+0000 7f9334ff9640 1 -- 172.21.15.70:0/2194441818 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320007c70 con 0x7f9338102ae0 2024-04-26T20:24:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.163+0000 7f9334ff9640 1 -- 172.21.15.70:0/2194441818 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9320007e10 con 0x7f9338102ae0 2024-04-26T20:24:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.163+0000 7f933d54d640 1 -- 172.21.15.70:0/2194441818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93381a0a60 con 0x7f9338102ae0 2024-04-26T20:24:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.163+0000 7f9334ff9640 1 -- 172.21.15.70:0/2194441818 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93200188c0 con 0x7f9338102ae0 2024-04-26T20:24:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.163+0000 7f933d54d640 1 -- 172.21.15.70:0/2194441818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93381a0fb0 con 0x7f9338102ae0 2024-04-26T20:24:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.164+0000 7f933d54d640 1 -- 172.21.15.70:0/2194441818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9338108b40 con 0x7f9338102ae0 2024-04-26T20:24:36.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.165+0000 7f9334ff9640 1 -- 172.21.15.70:0/2194441818 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9320018a60 con 0x7f9338102ae0 2024-04-26T20:24:36.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.165+0000 7f9334ff9640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f93240a3bb0 0x7f93240a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.166+0000 7f9336ffd640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f93240a3bb0 0x7f93240a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.166+0000 7f9334ff9640 1 -- 172.21.15.70:0/2194441818 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f93200d0150 con 0x7f9338102ae0 2024-04-26T20:24:36.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.166+0000 7f9336ffd640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f93240a3bb0 0x7f93240a6070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9338102940 tx=0x7f9328005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.170+0000 7f9334ff9640 1 -- 172.21.15.70:0/2194441818 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f9320014030 con 0x7f9338102ae0 2024-04-26T20:24:36.206 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi080=b;smithi080=e;smithi080=h;smithi080=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:24:36.206 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi080=b;smithi080=e;smithi080=h;smithi080=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-04-26T20:24:36.207 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:36.207 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:36.207 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:36.207 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:36.207 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:36.207 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:36.207 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:36.207 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:36.207 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: Deploying daemon mds.l on smithi098 2024-04-26T20:24:36.207 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:35 smithi098 ceph-mon[32591]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:36.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi080=b;smithi080=e;smithi080=h;smithi080=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:24:36.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi080=b;smithi080=e;smithi080=h;smithi080=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-04-26T20:24:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: Deploying daemon mds.l on smithi098 2024-04-26T20:24:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:35 smithi080 ceph-mon[32278]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi080=b;smithi080=e;smithi080=h;smithi080=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:24:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi080=b;smithi080=e;smithi080=h;smithi080=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-04-26T20:24:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: Deploying daemon mds.l on smithi098 2024-04-26T20:24:36.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:35 smithi070 ceph-mon[29124]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:36.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.349+0000 7f933d54d640 1 -- 172.21.15.70:0/2194441818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f933802dd20 con 0x7f9338102ae0 2024-04-26T20:24:36.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.350+0000 7f9334ff9640 1 -- 172.21.15.70:0/2194441818 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18385 (secure 0 0 0) 0x7f932000de20 con 0x7f9338102ae0 2024-04-26T20:24:36.352 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:36.352 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":82,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:24:23.963706+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:24:36.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 -- 172.21.15.70:0/2194441818 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f93240a3bb0 msgr2=0x7f93240a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f93240a3bb0 0x7f93240a6070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9338102940 tx=0x7f9328005f90 comp rx=0 tx=0).stop 2024-04-26T20:24:36.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 -- 172.21.15.70:0/2194441818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9338102ae0 msgr2=0x7f9338199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9338102ae0 0x7f9338199090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f932000c920 tx=0x7f932000cde0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 -- 172.21.15.70:0/2194441818 shutdown_connections 2024-04-26T20:24:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f93240a3bb0 0x7f93240a6070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93381034a0 0x7f93381a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9338102ae0 0x7f9338199090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 --2- 172.21.15.70:0/2194441818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93381018f0 0x7f9338198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 -- 172.21.15.70:0/2194441818 >> 172.21.15.70:0/2194441818 conn(0x7f93380fcea0 msgr2=0x7f9338105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 -- 172.21.15.70:0/2194441818 shutdown_connections 2024-04-26T20:24:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.352+0000 7f933d54d640 1 -- 172.21.15.70:0/2194441818 wait complete. 2024-04-26T20:24:36.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:20:33.781367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:24:36.366 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:24:36.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.465+0000 7f6317ea0640 1 -- 172.21.15.70:0/1729770631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6310101870 msgr2=0x7f6310101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.465+0000 7f6317ea0640 1 --2- 172.21.15.70:0/1729770631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6310101870 0x7f6310101c90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f630c009ca0 tx=0x7f630c02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.465+0000 7f6317ea0640 1 -- 172.21.15.70:0/1729770631 shutdown_connections 2024-04-26T20:24:36.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.465+0000 7f6317ea0640 1 --2- 172.21.15.70:0/1729770631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6310103420 0x7f6310109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.465+0000 7f6317ea0640 1 --2- 172.21.15.70:0/1729770631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6310102a60 0x7f6310102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.465+0000 7f6317ea0640 1 --2- 172.21.15.70:0/1729770631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6310101870 0x7f6310101c90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.465+0000 7f6317ea0640 1 -- 172.21.15.70:0/1729770631 >> 172.21.15.70:0/1729770631 conn(0x7f63100fce00 msgr2=0x7f63100ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.465+0000 7f6317ea0640 1 -- 172.21.15.70:0/1729770631 shutdown_connections 2024-04-26T20:24:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.465+0000 7f6317ea0640 1 -- 172.21.15.70:0/1729770631 wait complete. 2024-04-26T20:24:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f6317ea0640 1 Processor -- start 2024-04-26T20:24:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f6317ea0640 1 -- start start 2024-04-26T20:24:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f6317ea0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6310101870 0x7f6310198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f6317ea0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6310102a60 0x7f6310199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f6317ea0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6310103420 0x7f63101a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f6317ea0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f631010e5e0 con 0x7f6310103420 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f6317ea0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f631010e460 con 0x7f6310102a60 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f6317ea0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f631010e760 con 0x7f6310101870 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f631643d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6310103420 0x7f63101a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f631643d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6310103420 0x7f63101a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43840/0 (socket says 172.21.15.70:43840) 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f631643d640 1 -- 172.21.15.70:0/868029459 learned_addr learned my addr 172.21.15.70:0/868029459 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f6315c3c640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6310101870 0x7f6310198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f631643d640 1 -- 172.21.15.70:0/868029459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6310101870 msgr2=0x7f6310198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f631643d640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6310101870 0x7f6310198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f631643d640 1 -- 172.21.15.70:0/868029459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6310102a60 msgr2=0x7f6310199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f631643d640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6310102a60 0x7f6310199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f631643d640 1 -- 172.21.15.70:0/868029459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63101a0930 con 0x7f6310103420 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f631643d640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6310103420 0x7f63101a0290 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f630800d750 tx=0x7f630800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.466+0000 7f6306ffd640 1 -- 172.21.15.70:0/868029459 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308017070 con 0x7f6310103420 2024-04-26T20:24:36.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.467+0000 7f6317ea0640 1 -- 172.21.15.70:0/868029459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63101a0c20 con 0x7f6310103420 2024-04-26T20:24:36.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.467+0000 7f6306ffd640 1 -- 172.21.15.70:0/868029459 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f63080054f0 con 0x7f6310103420 2024-04-26T20:24:36.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.467+0000 7f6306ffd640 1 -- 172.21.15.70:0/868029459 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308004cd0 con 0x7f6310103420 2024-04-26T20:24:36.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.467+0000 7f6317ea0640 1 -- 172.21.15.70:0/868029459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63101a1170 con 0x7f6310103420 2024-04-26T20:24:36.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.467+0000 7f6317ea0640 1 -- 172.21.15.70:0/868029459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6310108cb0 con 0x7f6310103420 2024-04-26T20:24:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.469+0000 7f6306ffd640 1 -- 172.21.15.70:0/868029459 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f6308009bd0 con 0x7f6310103420 2024-04-26T20:24:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.469+0000 7f6306ffd640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f62fc0a3bb0 0x7f62fc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.469+0000 7f6315c3c640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f62fc0a3bb0 0x7f62fc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.469+0000 7f6306ffd640 1 -- 172.21.15.70:0/868029459 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f63080cfaa0 con 0x7f6310103420 2024-04-26T20:24:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.469+0000 7f6315c3c640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f62fc0a3bb0 0x7f62fc0a6070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f630c006010 tx=0x7f630c000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.474+0000 7f6306ffd640 1 -- 172.21.15.70:0/868029459 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f630809c920 con 0x7f6310103420 2024-04-26T20:24:36.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.650+0000 7f6317ea0640 1 -- 172.21.15.70:0/868029459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f631002dd10 con 0x7f6310103420 2024-04-26T20:24:36.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.650+0000 7f6306ffd640 1 -- 172.21.15.70:0/868029459 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f630809c220 con 0x7f6310103420 2024-04-26T20:24:36.652 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-04-26T20:24:36.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 -- 172.21.15.70:0/868029459 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f62fc0a3bb0 msgr2=0x7f62fc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f62fc0a3bb0 0x7f62fc0a6070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f630c006010 tx=0x7f630c000f40 comp rx=0 tx=0).stop 2024-04-26T20:24:36.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 -- 172.21.15.70:0/868029459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6310103420 msgr2=0x7f63101a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6310103420 0x7f63101a0290 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f630800d750 tx=0x7f630800dc10 comp rx=0 tx=0).stop 2024-04-26T20:24:36.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 -- 172.21.15.70:0/868029459 shutdown_connections 2024-04-26T20:24:36.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f62fc0a3bb0 0x7f62fc0a6070 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6310103420 0x7f63101a0290 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6310102a60 0x7f6310199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 --2- 172.21.15.70:0/868029459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6310101870 0x7f6310198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 -- 172.21.15.70:0/868029459 >> 172.21.15.70:0/868029459 conn(0x7f63100fce00 msgr2=0x7f6310105e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:36.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 -- 172.21.15.70:0/868029459 shutdown_connections 2024-04-26T20:24:36.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.652+0000 7f6317ea0640 1 -- 172.21.15.70:0/868029459 wait complete. 2024-04-26T20:24:36.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.762+0000 7f482c7f9640 1 -- 172.21.15.70:0/3665205000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4824100c80 msgr2=0x7f48241010a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.762+0000 7f482c7f9640 1 --2- 172.21.15.70:0/3665205000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4824100c80 0x7f48241010a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4814009930 tx=0x7f481402a420 comp rx=0 tx=0).stop 2024-04-26T20:24:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.762+0000 7f482c7f9640 1 -- 172.21.15.70:0/3665205000 shutdown_connections 2024-04-26T20:24:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.762+0000 7f482c7f9640 1 --2- 172.21.15.70:0/3665205000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48241046b0 0x7f482410af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.762+0000 7f482c7f9640 1 --2- 172.21.15.70:0/3665205000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4824103cf0 0x7f4824104170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.762+0000 7f482c7f9640 1 --2- 172.21.15.70:0/3665205000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4824100c80 0x7f48241010a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.762+0000 7f482c7f9640 1 -- 172.21.15.70:0/3665205000 >> 172.21.15.70:0/3665205000 conn(0x7f48240fc590 msgr2=0x7f48240fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.762+0000 7f482c7f9640 1 -- 172.21.15.70:0/3665205000 shutdown_connections 2024-04-26T20:24:36.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.762+0000 7f482c7f9640 1 -- 172.21.15.70:0/3665205000 wait complete. 2024-04-26T20:24:36.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.762+0000 7f482c7f9640 1 Processor -- start 2024-04-26T20:24:36.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.762+0000 7f482c7f9640 1 -- start start 2024-04-26T20:24:36.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482c7f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4824100c80 0x7f482419ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482c7f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4824103cf0 0x7f482419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482c7f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48241046b0 0x7f48241a2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482c7f9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f482410e610 con 0x7f4824100c80 2024-04-26T20:24:36.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482c7f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f482410e490 con 0x7f48241046b0 2024-04-26T20:24:36.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482c7f9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f482410e790 con 0x7f4824103cf0 2024-04-26T20:24:36.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482a595640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4824100c80 0x7f482419ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482a595640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4824100c80 0x7f482419ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43850/0 (socket says 172.21.15.70:43850) 2024-04-26T20:24:36.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482a595640 1 -- 172.21.15.70:0/4060900572 learned_addr learned my addr 172.21.15.70:0/4060900572 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:36.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f4829d94640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4824103cf0 0x7f482419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482ad96640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48241046b0 0x7f48241a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482a595640 1 -- 172.21.15.70:0/4060900572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4824103cf0 msgr2=0x7f482419b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482a595640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4824103cf0 0x7f482419b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482a595640 1 -- 172.21.15.70:0/4060900572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48241046b0 msgr2=0x7f48241a2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482a595640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48241046b0 0x7f48241a2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482a595640 1 -- 172.21.15.70:0/4060900572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48241a2ab0 con 0x7f4824100c80 2024-04-26T20:24:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482a595640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4824100c80 0x7f482419ae90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4814009230 tx=0x7f48140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f481b7fe640 1 -- 172.21.15.70:0/4060900572 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481403f030 con 0x7f4824100c80 2024-04-26T20:24:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f481b7fe640 1 -- 172.21.15.70:0/4060900572 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4814003cd0 con 0x7f4824100c80 2024-04-26T20:24:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482c7f9640 1 -- 172.21.15.70:0/4060900572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48241a2d40 con 0x7f4824100c80 2024-04-26T20:24:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f481b7fe640 1 -- 172.21.15.70:0/4060900572 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814035070 con 0x7f4824100c80 2024-04-26T20:24:36.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.763+0000 7f482c7f9640 1 -- 172.21.15.70:0/4060900572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48241a31d0 con 0x7f4824100c80 2024-04-26T20:24:36.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.764+0000 7f482c7f9640 1 -- 172.21.15.70:0/4060900572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48241a3400 con 0x7f4824100c80 2024-04-26T20:24:36.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.765+0000 7f481b7fe640 1 -- 172.21.15.70:0/4060900572 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f4814042030 con 0x7f4824100c80 2024-04-26T20:24:36.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.766+0000 7f481b7fe640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f48100a3c30 0x7f48100a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.766+0000 7f4829d94640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f48100a3c30 0x7f48100a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.766+0000 7f481b7fe640 1 -- 172.21.15.70:0/4060900572 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f48140f0320 con 0x7f4824100c80 2024-04-26T20:24:36.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.766+0000 7f4829d94640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f48100a3c30 0x7f48100a60f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f482419c3a0 tx=0x7f482000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.770+0000 7f481b7fe640 1 -- 172.21.15.70:0/4060900572 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f48140bd1a0 con 0x7f4824100c80 2024-04-26T20:24:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.982+0000 7f482c7f9640 1 -- 172.21.15.70:0/4060900572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48241a3760 con 0x7f4824100c80 2024-04-26T20:24:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.983+0000 7f481b7fe640 1 -- 172.21.15.70:0/4060900572 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f48140dd0e0 con 0x7f4824100c80 2024-04-26T20:24:36.985 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:36.985 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-26T20:24:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 1 2024-04-26T20:24:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 -- 172.21.15.70:0/4060900572 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f48100a3c30 msgr2=0x7f48100a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f48100a3c30 0x7f48100a60f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f482419c3a0 tx=0x7f482000a2d0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 -- 172.21.15.70:0/4060900572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4824100c80 msgr2=0x7f482419ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4824100c80 0x7f482419ae90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4814009230 tx=0x7f48140042f0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 -- 172.21.15.70:0/4060900572 shutdown_connections 2024-04-26T20:24:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f48100a3c30 0x7f48100a60f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48241046b0 0x7f48241a2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4824103cf0 0x7f482419b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 --2- 172.21.15.70:0/4060900572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4824100c80 0x7f482419ae90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 -- 172.21.15.70:0/4060900572 >> 172.21.15.70:0/4060900572 conn(0x7f48240fc590 msgr2=0x7f4824101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:36.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 -- 172.21.15.70:0/4060900572 shutdown_connections 2024-04-26T20:24:36.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:36.985+0000 7f482c7f9640 1 -- 172.21.15.70:0/4060900572 wait complete. 2024-04-26T20:24:37.180 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:37 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2194441818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:24:37.180 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:37 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/868029459' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:24:37.181 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:37 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/4060900572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:37.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:37 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2194441818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:24:37.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:37 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/868029459' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:24:37.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:37 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/4060900572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:37.458 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:24:37 smithi098 systemd[1]: Starting Ceph mds.l for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:24:37.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:37 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2194441818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:24:37.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:37 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/868029459' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:24:37.472 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:37 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/4060900572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:37.849 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:24:37 smithi098 podman[62869]: 2024-04-26 20:24:37.481387932 +0000 UTC m=+0.018449300 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:24:37.850 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:24:37 smithi098 podman[62869]: 2024-04-26 20:24:37.605547713 +0000 UTC m=+0.142609139 container create 994820d5e67913bd58893a201784b42e97b4d00c31a52fb87b49634c29dfe776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-26T20:24:37.850 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:24:37 smithi098 podman[62869]: 2024-04-26 20:24:37.849776627 +0000 UTC m=+0.386837994 container init 994820d5e67913bd58893a201784b42e97b4d00c31a52fb87b49634c29dfe776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-26T20:24:38.208 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:24:37 smithi098 podman[62869]: 2024-04-26 20:24:37.852391064 +0000 UTC m=+0.389452441 container start 994820d5e67913bd58893a201784b42e97b4d00c31a52fb87b49634c29dfe776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:24:38.208 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:24:37 smithi098 ceph-mds[62888]: -- 172.21.15.98:0/2937328536 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55828ed11a40 con 0x55828ece4c00 2024-04-26T20:24:38.209 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:24:37 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l[62884]: starting mds.l at 2024-04-26T20:24:38.209 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:24:37 smithi098 bash[62869]: 994820d5e67913bd58893a201784b42e97b4d00c31a52fb87b49634c29dfe776 2024-04-26T20:24:38.209 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:24:37 smithi098 systemd[1]: Started Ceph mds.l for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:24:38.962 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:38 smithi080 ceph-mon[32278]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:38.963 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:38 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.98:6832/699509756,v1:172.21.15.98:6833/699509756] up:boot 2024-04-26T20:24:38.963 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:38 smithi080 ceph-mon[32278]: fsmap 1 up:standby 2024-04-26T20:24:38.963 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:24:38.963 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:38.963 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:38.963 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:38.963 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:38.963 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:38.963 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:38 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:38.999 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 -- 172.21.15.70:0/1515978683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f5c102a80 msgr2=0x7f6f5c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 --2- 172.21.15.70:0/1515978683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f5c102a80 0x7f6f5c102f00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009900 tx=0x7f6f5802a410 comp rx=0 tx=0).stop 2024-04-26T20:24:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 -- 172.21.15.70:0/1515978683 shutdown_connections 2024-04-26T20:24:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 --2- 172.21.15.70:0/1515978683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f5c103440 0x7f6f5c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 --2- 172.21.15.70:0/1515978683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f5c102a80 0x7f6f5c102f00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 --2- 172.21.15.70:0/1515978683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f5c101890 0x7f6f5c101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 -- 172.21.15.70:0/1515978683 >> 172.21.15.70:0/1515978683 conn(0x7f6f5c0fce00 msgr2=0x7f6f5c0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 -- 172.21.15.70:0/1515978683 shutdown_connections 2024-04-26T20:24:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 -- 172.21.15.70:0/1515978683 wait complete. 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 Processor -- start 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 -- start start 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f5c101890 0x7f6f5c198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f5c102a80 0x7f6f5c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f5c103440 0x7f6f5c1a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c10e600 con 0x7f6f5c101890 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c10e480 con 0x7f6f5c102a80 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.108+0000 7f6f635b6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c10e780 con 0x7f6f5c103440 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f61352640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f5c101890 0x7f6f5c198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f61352640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f5c101890 0x7f6f5c198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43868/0 (socket says 172.21.15.70:43868) 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f61352640 1 -- 172.21.15.70:0/877395770 learned_addr learned my addr 172.21.15.70:0/877395770 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f60b51640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f5c102a80 0x7f6f5c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f61b53640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f5c103440 0x7f6f5c1a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f61352640 1 -- 172.21.15.70:0/877395770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f5c103440 msgr2=0x7f6f5c1a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f61352640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f5c103440 0x7f6f5c1a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f61352640 1 -- 172.21.15.70:0/877395770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f5c102a80 msgr2=0x7f6f5c1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f61352640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f5c102a80 0x7f6f5c1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f61352640 1 -- 172.21.15.70:0/877395770 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5c1a0880 con 0x7f6f5c101890 2024-04-26T20:24:39.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f61352640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f5c101890 0x7f6f5c198c70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00d770 tx=0x7f6f4c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:39.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f527fc640 1 -- 172.21.15.70:0/877395770 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c017070 con 0x7f6f5c101890 2024-04-26T20:24:39.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f527fc640 1 -- 172.21.15.70:0/877395770 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6f4c009c30 con 0x7f6f5c101890 2024-04-26T20:24:39.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f635b6640 1 -- 172.21.15.70:0/877395770 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5c1a0b70 con 0x7f6f5c101890 2024-04-26T20:24:39.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f527fc640 1 -- 172.21.15.70:0/877395770 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c003d70 con 0x7f6f5c101890 2024-04-26T20:24:39.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.109+0000 7f6f635b6640 1 -- 172.21.15.70:0/877395770 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5c1a10c0 con 0x7f6f5c101890 2024-04-26T20:24:39.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.110+0000 7f6f635b6640 1 -- 172.21.15.70:0/877395770 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f5c108bb0 con 0x7f6f5c101890 2024-04-26T20:24:39.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.111+0000 7f6f527fc640 1 -- 172.21.15.70:0/877395770 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f6f4c003f10 con 0x7f6f5c101890 2024-04-26T20:24:39.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.112+0000 7f6f527fc640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6f480a3bb0 0x7f6f480a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.112+0000 7f6f60b51640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6f480a3bb0 0x7f6f480a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.112+0000 7f6f527fc640 1 -- 172.21.15.70:0/877395770 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f6f4c0cf8b0 con 0x7f6f5c101890 2024-04-26T20:24:39.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.112+0000 7f6f60b51640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6f480a3bb0 0x7f6f480a6070 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6f58000c00 tx=0x7f6f58031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:39.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.117+0000 7f6f527fc640 1 -- 172.21.15.70:0/877395770 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f6f4c009de0 con 0x7f6f5c101890 2024-04-26T20:24:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:38 smithi098 ceph-mon[32591]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:38 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.98:6832/699509756,v1:172.21.15.98:6833/699509756] up:boot 2024-04-26T20:24:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:38 smithi098 ceph-mon[32591]: fsmap 1 up:standby 2024-04-26T20:24:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:24:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:39.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:39.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:39.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:38 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:38 smithi070 ceph-mon[29124]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:38 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.98:6832/699509756,v1:172.21.15.98:6833/699509756] up:boot 2024-04-26T20:24:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:38 smithi070 ceph-mon[29124]: fsmap 1 up:standby 2024-04-26T20:24:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:24:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:39.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:38 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.331+0000 7f6f635b6640 1 -- 172.21.15.70:0/877395770 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f5c02dad0 con 0x7f6f5c101890 2024-04-26T20:24:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.331+0000 7f6f527fc640 1 -- 172.21.15.70:0/877395770 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1390 (secure 0 0 0) 0x7f6f4c09c0e0 con 0x7f6f5c101890 2024-04-26T20:24:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:39.332 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T20:24:39.333 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 2 2024-04-26T20:24:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 -- 172.21.15.70:0/877395770 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6f480a3bb0 msgr2=0x7f6f480a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6f480a3bb0 0x7f6f480a6070 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6f58000c00 tx=0x7f6f58031510 comp rx=0 tx=0).stop 2024-04-26T20:24:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 -- 172.21.15.70:0/877395770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f5c101890 msgr2=0x7f6f5c198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f5c101890 0x7f6f5c198c70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00d770 tx=0x7f6f4c00dc30 comp rx=0 tx=0).stop 2024-04-26T20:24:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 -- 172.21.15.70:0/877395770 shutdown_connections 2024-04-26T20:24:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6f480a3bb0 0x7f6f480a6070 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f5c103440 0x7f6f5c1a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f5c102a80 0x7f6f5c1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 --2- 172.21.15.70:0/877395770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f5c101890 0x7f6f5c198c70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 -- 172.21.15.70:0/877395770 >> 172.21.15.70:0/877395770 conn(0x7f6f5c0fce00 msgr2=0x7f6f5c105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:39.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 -- 172.21.15.70:0/877395770 shutdown_connections 2024-04-26T20:24:39.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:39.334+0000 7f6f635b6640 1 -- 172.21.15.70:0/877395770 wait complete. 2024-04-26T20:24:39.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:39 smithi080 ceph-mon[32278]: Deploying daemon mds.k on smithi080 2024-04-26T20:24:39.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:39 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/877395770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:40.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:39 smithi098 ceph-mon[32591]: Deploying daemon mds.k on smithi080 2024-04-26T20:24:40.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:39 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/877395770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:40.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:39 smithi070 ceph-mon[29124]: Deploying daemon mds.k on smithi080 2024-04-26T20:24:40.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:39 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/877395770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:40.470 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:24:40 smithi080 systemd[1]: Starting Ceph mds.k for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:24:40.733 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:24:40 smithi080 podman[61255]: 2024-04-26 20:24:40.374751475 +0000 UTC m=+0.017237648 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:24:40.733 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:24:40 smithi080 podman[61255]: 2024-04-26 20:24:40.489247896 +0000 UTC m=+0.131734059 container create ebb72b90741f2a14c9ce339d5b20ba1727b7d6a15eea57e0929963b0b17361af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-26T20:24:40.733 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:24:40 smithi080 podman[61255]: 2024-04-26 20:24:40.733621571 +0000 UTC m=+0.376107739 container init ebb72b90741f2a14c9ce339d5b20ba1727b7d6a15eea57e0929963b0b17361af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:24:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:40 smithi098 ceph-mon[32591]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:40 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:41.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:40 smithi080 ceph-mon[32278]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:41.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:40 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:41.219 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:24:40 smithi080 podman[61255]: 2024-04-26 20:24:40.736331725 +0000 UTC m=+0.378817900 container start ebb72b90741f2a14c9ce339d5b20ba1727b7d6a15eea57e0929963b0b17361af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-26T20:24:41.220 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:24:40 smithi080 ceph-mds[61274]: -- 172.21.15.80:0/1452407784 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ae02af3a40 con 0x55ae02ac6c00 2024-04-26T20:24:41.220 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:24:40 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k[61270]: starting mds.k at 2024-04-26T20:24:41.220 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:24:40 smithi080 bash[61255]: ebb72b90741f2a14c9ce339d5b20ba1727b7d6a15eea57e0929963b0b17361af 2024-04-26T20:24:41.220 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:24:40 smithi080 systemd[1]: Started Ceph mds.k for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:24:41.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:40 smithi070 ceph-mon[29124]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:41.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:40 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:41.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.450+0000 7fafdcd24640 1 -- 172.21.15.70:0/839168915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd8108670 msgr2=0x7fafd810aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.450+0000 7fafdcd24640 1 --2- 172.21.15.70:0/839168915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd8108670 0x7fafd810aac0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009ca0 tx=0x7fafd002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.451+0000 7fafdcd24640 1 -- 172.21.15.70:0/839168915 shutdown_connections 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.451+0000 7fafdcd24640 1 --2- 172.21.15.70:0/839168915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd8108670 0x7fafd810aac0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.451+0000 7fafdcd24640 1 --2- 172.21.15.70:0/839168915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8105d40 0x7fafd8108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.451+0000 7fafdcd24640 1 --2- 172.21.15.70:0/839168915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd8103410 0x7fafd8105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.451+0000 7fafdcd24640 1 -- 172.21.15.70:0/839168915 >> 172.21.15.70:0/839168915 conn(0x7fafd80fce00 msgr2=0x7fafd80ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.451+0000 7fafdcd24640 1 -- 172.21.15.70:0/839168915 shutdown_connections 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.451+0000 7fafdcd24640 1 -- 172.21.15.70:0/839168915 wait complete. 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.451+0000 7fafdcd24640 1 Processor -- start 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.451+0000 7fafdcd24640 1 -- start start 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.451+0000 7fafdcd24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd8103410 0x7fafd8198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafdcd24640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd8105d40 0x7fafd8199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafdcd24640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8108670 0x7fafd81a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafdcd24640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafd810e610 con 0x7fafd8103410 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafdcd24640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fafd810e490 con 0x7fafd8105d40 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafdcd24640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fafd810e790 con 0x7fafd8108670 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafd659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd8103410 0x7fafd8198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafd659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd8103410 0x7fafd8198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51742/0 (socket says 172.21.15.70:51742) 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafd659c640 1 -- 172.21.15.70:0/3423483110 learned_addr learned my addr 172.21.15.70:0/3423483110 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafd6d9d640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8108670 0x7fafd81a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafcffff640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd8105d40 0x7fafd8199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafd659c640 1 -- 172.21.15.70:0/3423483110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8108670 msgr2=0x7fafd81a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafd659c640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8108670 0x7fafd81a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafd659c640 1 -- 172.21.15.70:0/3423483110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd8105d40 msgr2=0x7fafd8199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafd659c640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd8105d40 0x7fafd8199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafd659c640 1 -- 172.21.15.70:0/3423483110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd81a0850 con 0x7fafd8103410 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafd659c640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd8103410 0x7fafd8198c40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fafc800e9f0 tx=0x7fafc800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafcf7fe640 1 -- 172.21.15.70:0/3423483110 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc800cd80 con 0x7fafd8103410 2024-04-26T20:24:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafdcd24640 1 -- 172.21.15.70:0/3423483110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd81a0b40 con 0x7fafd8103410 2024-04-26T20:24:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafcf7fe640 1 -- 172.21.15.70:0/3423483110 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fafc8010900 con 0x7fafd8103410 2024-04-26T20:24:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafcf7fe640 1 -- 172.21.15.70:0/3423483110 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc80188d0 con 0x7fafd8103410 2024-04-26T20:24:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.452+0000 7fafdcd24640 1 -- 172.21.15.70:0/3423483110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd81a1090 con 0x7fafd8103410 2024-04-26T20:24:41.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.453+0000 7fafdcd24640 1 -- 172.21.15.70:0/3423483110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd80fe8f0 con 0x7fafd8103410 2024-04-26T20:24:41.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.454+0000 7fafcf7fe640 1 -- 172.21.15.70:0/3423483110 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fafc8010ab0 con 0x7fafd8103410 2024-04-26T20:24:41.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.455+0000 7fafcf7fe640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fafc40a3bb0 0x7fafc40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.455+0000 7fafcffff640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fafc40a3bb0 0x7fafc40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.455+0000 7fafcf7fe640 1 -- 172.21.15.70:0/3423483110 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fafc80d0490 con 0x7fafd8103410 2024-04-26T20:24:41.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.455+0000 7fafcffff640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fafc40a3bb0 0x7fafc40a6070 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafc0005fd0 tx=0x7fafc0005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:41.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.459+0000 7fafcf7fe640 1 -- 172.21.15.70:0/3423483110 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fafc809d310 con 0x7fafd8103410 2024-04-26T20:24:41.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.678+0000 7fafdcd24640 1 -- 172.21.15.70:0/3423483110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafd802dad0 con 0x7fafd8103410 2024-04-26T20:24:41.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.678+0000 7fafcf7fe640 1 -- 172.21.15.70:0/3423483110 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2209 (secure 0 0 0) 0x7fafc809cc10 con 0x7fafd8103410 2024-04-26T20:24:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:41.679 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T20:24:41.680 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 3 2024-04-26T20:24:41.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 -- 172.21.15.70:0/3423483110 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fafc40a3bb0 msgr2=0x7fafc40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fafc40a3bb0 0x7fafc40a6070 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafc0005fd0 tx=0x7fafc0005e20 comp rx=0 tx=0).stop 2024-04-26T20:24:41.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 -- 172.21.15.70:0/3423483110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd8103410 msgr2=0x7fafd8198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd8103410 0x7fafd8198c40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fafc800e9f0 tx=0x7fafc800eeb0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 -- 172.21.15.70:0/3423483110 shutdown_connections 2024-04-26T20:24:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fafc40a3bb0 0x7fafc40a6070 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8108670 0x7fafd81a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd8105d40 0x7fafd8199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 --2- 172.21.15.70:0/3423483110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd8103410 0x7fafd8198c40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 -- 172.21.15.70:0/3423483110 >> 172.21.15.70:0/3423483110 conn(0x7fafd80fce00 msgr2=0x7fafd8103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 -- 172.21.15.70:0/3423483110 shutdown_connections 2024-04-26T20:24:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:41.680+0000 7fafdcd24640 1 -- 172.21.15.70:0/3423483110 wait complete. 2024-04-26T20:24:42.017 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:41 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:42.017 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:41 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.80:6832/20228697,v1:172.21.15.80:6833/20228697] up:boot 2024-04-26T20:24:42.017 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:41 smithi070 ceph-mon[29124]: fsmap 2 up:standby 2024-04-26T20:24:42.017 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:41 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:24:42.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:41 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:42.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:41 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:42.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:41 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:42.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:41 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:42.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:41 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3423483110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:42.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:41 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:42.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:41 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.80:6832/20228697,v1:172.21.15.80:6833/20228697] up:boot 2024-04-26T20:24:42.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:41 smithi098 ceph-mon[32591]: fsmap 2 up:standby 2024-04-26T20:24:42.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:41 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:24:42.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:41 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:42.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:41 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:42.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:41 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:42.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:41 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:42.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:41 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3423483110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:42.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:41 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:42.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:41 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.80:6832/20228697,v1:172.21.15.80:6833/20228697] up:boot 2024-04-26T20:24:42.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:41 smithi080 ceph-mon[32278]: fsmap 2 up:standby 2024-04-26T20:24:42.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:41 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:24:42.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:41 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:42.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:41 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:42.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:41 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:42.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:41 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:42.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:41 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3423483110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:43.088 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:42 smithi070 ceph-mon[29124]: Deploying daemon mds.j on smithi070 2024-04-26T20:24:43.088 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:42 smithi070 ceph-mon[29124]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:43.169 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:42 smithi080 ceph-mon[32278]: Deploying daemon mds.j on smithi070 2024-04-26T20:24:43.169 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:42 smithi080 ceph-mon[32278]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:42 smithi098 ceph-mon[32591]: Deploying daemon mds.j on smithi070 2024-04-26T20:24:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:42 smithi098 ceph-mon[32591]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:43.478 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:24:43 smithi070 systemd[1]: Starting Ceph mds.j for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:24:43.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:43.745 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:24:43 smithi070 podman[69778]: 2024-04-26 20:24:43.380775144 +0000 UTC m=+0.017763066 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:24:43.745 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:24:43 smithi070 podman[69778]: 2024-04-26 20:24:43.499878767 +0000 UTC m=+0.136866684 container create a6318ca21c6423445b00c10a2c0051a91dc9d8087aecec44636d7f90499263ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T20:24:43.745 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:24:43 smithi070 podman[69778]: 2024-04-26 20:24:43.744612655 +0000 UTC m=+0.381600563 container init a6318ca21c6423445b00c10a2c0051a91dc9d8087aecec44636d7f90499263ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-j, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-26T20:24:43.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.798+0000 7fc987e09640 1 -- 172.21.15.70:0/732312029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9801034b0 msgr2=0x7fc9801058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:43.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.798+0000 7fc987e09640 1 --2- 172.21.15.70:0/732312029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9801034b0 0x7fc9801058a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc970009900 tx=0x7fc97002a410 comp rx=0 tx=0).stop 2024-04-26T20:24:43.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.798+0000 7fc987e09640 1 -- 172.21.15.70:0/732312029 shutdown_connections 2024-04-26T20:24:43.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.798+0000 7fc987e09640 1 --2- 172.21.15.70:0/732312029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc980108710 0x7fc98010ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:43.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.798+0000 7fc987e09640 1 --2- 172.21.15.70:0/732312029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc980105de0 0x7fc9801081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:43.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.798+0000 7fc987e09640 1 --2- 172.21.15.70:0/732312029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9801034b0 0x7fc9801058a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:43.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.798+0000 7fc987e09640 1 -- 172.21.15.70:0/732312029 >> 172.21.15.70:0/732312029 conn(0x7fc9800fce00 msgr2=0x7fc9800ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:43.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.798+0000 7fc987e09640 1 -- 172.21.15.70:0/732312029 shutdown_connections 2024-04-26T20:24:43.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.798+0000 7fc987e09640 1 -- 172.21.15.70:0/732312029 wait complete. 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc987e09640 1 Processor -- start 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc987e09640 1 -- start start 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc987e09640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9801034b0 0x7fc980198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc987e09640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc980105de0 0x7fc980199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc987e09640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc980108710 0x7fc9801a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc987e09640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc98010e610 con 0x7fc9801034b0 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc987e09640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc98010e490 con 0x7fc980108710 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc987e09640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc98010e790 con 0x7fc980105de0 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc985ba5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9801034b0 0x7fc980198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc985ba5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9801034b0 0x7fc980198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51764/0 (socket says 172.21.15.70:51764) 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc985ba5640 1 -- 172.21.15.70:0/185137970 learned_addr learned my addr 172.21.15.70:0/185137970 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc9863a6640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc980108710 0x7fc9801a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:43.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc9853a4640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc980105de0 0x7fc980199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc985ba5640 1 -- 172.21.15.70:0/185137970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc980105de0 msgr2=0x7fc980199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc985ba5640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc980105de0 0x7fc980199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc985ba5640 1 -- 172.21.15.70:0/185137970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc980108710 msgr2=0x7fc9801a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc985ba5640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc980108710 0x7fc9801a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc985ba5640 1 -- 172.21.15.70:0/185137970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9801a0900 con 0x7fc9801034b0 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc985ba5640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9801034b0 0x7fc980198cc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc970005940 tx=0x7fc9700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc976ffd640 1 -- 172.21.15.70:0/185137970 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97003f030 con 0x7fc9801034b0 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc987e09640 1 -- 172.21.15.70:0/185137970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9801a0b90 con 0x7fc9801034b0 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc976ffd640 1 -- 172.21.15.70:0/185137970 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc970003cd0 con 0x7fc9801034b0 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc976ffd640 1 -- 172.21.15.70:0/185137970 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970035070 con 0x7fc9801034b0 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.799+0000 7fc987e09640 1 -- 172.21.15.70:0/185137970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9801a1080 con 0x7fc9801034b0 2024-04-26T20:24:43.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.800+0000 7fc987e09640 1 -- 172.21.15.70:0/185137970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9800fe8f0 con 0x7fc9801034b0 2024-04-26T20:24:43.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.802+0000 7fc976ffd640 1 -- 172.21.15.70:0/185137970 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc970042030 con 0x7fc9801034b0 2024-04-26T20:24:43.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.802+0000 7fc976ffd640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc96c0a3bb0 0x7fc96c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:43.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.802+0000 7fc976ffd640 1 -- 172.21.15.70:0/185137970 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fc9700f04e0 con 0x7fc9801034b0 2024-04-26T20:24:43.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.802+0000 7fc9853a4640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc96c0a3bb0 0x7fc96c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:43.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.803+0000 7fc9853a4640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc96c0a3bb0 0x7fc96c0a6070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc97c005d00 tx=0x7fc97c005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:43.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:43.807+0000 7fc976ffd640 1 -- 172.21.15.70:0/185137970 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc9700bd360 con 0x7fc9801034b0 2024-04-26T20:24:44.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:43 smithi070 ceph-mon[29124]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:44.034 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:24:43 smithi070 podman[69778]: 2024-04-26 20:24:43.748397896 +0000 UTC m=+0.385385805 container start a6318ca21c6423445b00c10a2c0051a91dc9d8087aecec44636d7f90499263ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-j, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-26T20:24:44.035 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:24:43 smithi070 ceph-mds[69817]: -- 172.21.15.70:0/2868600615 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a5f2171a40 con 0x55a5f2145000 2024-04-26T20:24:44.035 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:24:43 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-j[69793]: starting mds.j at 2024-04-26T20:24:44.035 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:24:43 smithi070 bash[69778]: a6318ca21c6423445b00c10a2c0051a91dc9d8087aecec44636d7f90499263ce 2024-04-26T20:24:44.035 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:24:43 smithi070 systemd[1]: Started Ceph mds.j for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:24:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.051+0000 7fc987e09640 1 -- 172.21.15.70:0/185137970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc98002dad0 con 0x7fc9801034b0 2024-04-26T20:24:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.052+0000 7fc976ffd640 1 -- 172.21.15.70:0/185137970 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3031 (secure 0 0 0) 0x7fc9700bcc60 con 0x7fc9801034b0 2024-04-26T20:24:44.053 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:44.053 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T20:24:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 4 2024-04-26T20:24:44.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 -- 172.21.15.70:0/185137970 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc96c0a3bb0 msgr2=0x7fc96c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:44.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc96c0a3bb0 0x7fc96c0a6070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc97c005d00 tx=0x7fc97c005c50 comp rx=0 tx=0).stop 2024-04-26T20:24:44.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 -- 172.21.15.70:0/185137970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9801034b0 msgr2=0x7fc980198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:44.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9801034b0 0x7fc980198cc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc970005940 tx=0x7fc9700042f0 comp rx=0 tx=0).stop 2024-04-26T20:24:44.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 -- 172.21.15.70:0/185137970 shutdown_connections 2024-04-26T20:24:44.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc96c0a3bb0 0x7fc96c0a6070 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:44.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc980108710 0x7fc9801a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:44.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc980105de0 0x7fc980199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 --2- 172.21.15.70:0/185137970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9801034b0 0x7fc980198cc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 -- 172.21.15.70:0/185137970 >> 172.21.15.70:0/185137970 conn(0x7fc9800fce00 msgr2=0x7fc980103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 -- 172.21.15.70:0/185137970 shutdown_connections 2024-04-26T20:24:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:44.054+0000 7fc987e09640 1 -- 172.21.15.70:0/185137970 wait complete. 2024-04-26T20:24:44.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:43 smithi098 ceph-mon[32591]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:44.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:43 smithi080 ceph-mon[32278]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:44 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.70:6834/931274137,v1:172.21.15.70:6835/931274137] up:boot 2024-04-26T20:24:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:44 smithi098 ceph-mon[32591]: fsmap 3 up:standby 2024-04-26T20:24:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:24:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:45.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:45.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:45.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:45.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:44 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:45.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:44 smithi098 ceph-mon[32591]: Deploying daemon mds.d on smithi070 2024-04-26T20:24:45.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:44 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/185137970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:44 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.70:6834/931274137,v1:172.21.15.70:6835/931274137] up:boot 2024-04-26T20:24:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:44 smithi080 ceph-mon[32278]: fsmap 3 up:standby 2024-04-26T20:24:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:24:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:44 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:44 smithi080 ceph-mon[32278]: Deploying daemon mds.d on smithi070 2024-04-26T20:24:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:44 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/185137970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:45.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:44 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.70:6834/931274137,v1:172.21.15.70:6835/931274137] up:boot 2024-04-26T20:24:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:44 smithi070 ceph-mon[29124]: fsmap 3 up:standby 2024-04-26T20:24:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:24:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:44 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:44 smithi070 ceph-mon[29124]: Deploying daemon mds.d on smithi070 2024-04-26T20:24:45.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:44 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/185137970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:46.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.185+0000 7fd9dbb89640 1 -- 172.21.15.70:0/285610036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9d41086d0 msgr2=0x7fd9d410aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.185+0000 7fd9dbb89640 1 --2- 172.21.15.70:0/285610036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9d41086d0 0x7fd9d410aac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009ca0 tx=0x7fd9cc02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.185+0000 7fd9dbb89640 1 -- 172.21.15.70:0/285610036 shutdown_connections 2024-04-26T20:24:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.185+0000 7fd9dbb89640 1 --2- 172.21.15.70:0/285610036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9d41086d0 0x7fd9d410aac0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.185+0000 7fd9dbb89640 1 --2- 172.21.15.70:0/285610036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9d4105da0 0x7fd9d4108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.185+0000 7fd9dbb89640 1 --2- 172.21.15.70:0/285610036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9d4103470 0x7fd9d4105860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.185+0000 7fd9dbb89640 1 -- 172.21.15.70:0/285610036 >> 172.21.15.70:0/285610036 conn(0x7fd9d40fce00 msgr2=0x7fd9d40ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.185+0000 7fd9dbb89640 1 -- 172.21.15.70:0/285610036 shutdown_connections 2024-04-26T20:24:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.185+0000 7fd9dbb89640 1 -- 172.21.15.70:0/285610036 wait complete. 2024-04-26T20:24:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9dbb89640 1 Processor -- start 2024-04-26T20:24:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9dbb89640 1 -- start start 2024-04-26T20:24:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9dbb89640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9d4103470 0x7fd9d4198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9dbb89640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9d4105da0 0x7fd9d41991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9dbb89640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9d41086d0 0x7fd9d41a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9dbb89640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d410e610 con 0x7fd9d4103470 2024-04-26T20:24:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9dbb89640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d410e490 con 0x7fd9d4105da0 2024-04-26T20:24:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9dbb89640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d410e790 con 0x7fd9d41086d0 2024-04-26T20:24:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9d9925640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9d4103470 0x7fd9d4198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9d9925640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9d4103470 0x7fd9d4198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51772/0 (socket says 172.21.15.70:51772) 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9d9925640 1 -- 172.21.15.70:0/3785378877 learned_addr learned my addr 172.21.15.70:0/3785378877 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9da126640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9d41086d0 0x7fd9d41a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9d9925640 1 -- 172.21.15.70:0/3785378877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9d41086d0 msgr2=0x7fd9d41a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9d9124640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9d4105da0 0x7fd9d41991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9d9925640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9d41086d0 0x7fd9d41a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9d9925640 1 -- 172.21.15.70:0/3785378877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9d4105da0 msgr2=0x7fd9d41991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9d9925640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9d4105da0 0x7fd9d41991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9d9925640 1 -- 172.21.15.70:0/3785378877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d41a0880 con 0x7fd9d4103470 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9da126640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9d41086d0 0x7fd9d41a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.186+0000 7fd9d9925640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9d4103470 0x7fd9d4198c70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000d770 tx=0x7fd9d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.187+0000 7fd9caffd640 1 -- 172.21.15.70:0/3785378877 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0017070 con 0x7fd9d4103470 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.187+0000 7fd9dbb89640 1 -- 172.21.15.70:0/3785378877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d41a0b70 con 0x7fd9d4103470 2024-04-26T20:24:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.187+0000 7fd9caffd640 1 -- 172.21.15.70:0/3785378877 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd9d00054f0 con 0x7fd9d4103470 2024-04-26T20:24:46.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.187+0000 7fd9caffd640 1 -- 172.21.15.70:0/3785378877 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0004de0 con 0x7fd9d4103470 2024-04-26T20:24:46.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.187+0000 7fd9dbb89640 1 -- 172.21.15.70:0/3785378877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d41a10c0 con 0x7fd9d4103470 2024-04-26T20:24:46.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.188+0000 7fd9dbb89640 1 -- 172.21.15.70:0/3785378877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d40fe8f0 con 0x7fd9d4103470 2024-04-26T20:24:46.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.189+0000 7fd9caffd640 1 -- 172.21.15.70:0/3785378877 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fd9d0004f80 con 0x7fd9d4103470 2024-04-26T20:24:46.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.189+0000 7fd9caffd640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd9c00a3bb0 0x7fd9c00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:46.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.190+0000 7fd9caffd640 1 -- 172.21.15.70:0/3785378877 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fd9d00cff80 con 0x7fd9d4103470 2024-04-26T20:24:46.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.190+0000 7fd9d9124640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd9c00a3bb0 0x7fd9c00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:46.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.190+0000 7fd9d9124640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd9c00a3bb0 0x7fd9c00a6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4005fd0 tx=0x7fd9c4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:46.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.194+0000 7fd9caffd640 1 -- 172.21.15.70:0/3785378877 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd9d009ce00 con 0x7fd9d4103470 2024-04-26T20:24:46.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:45 smithi098 ceph-mon[32591]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:46.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:45 smithi080 ceph-mon[32278]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:46.281 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:45 smithi070 ceph-mon[29124]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:46.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.415+0000 7fd9dbb89640 1 -- 172.21.15.70:0/3785378877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9d402dca0 con 0x7fd9d4103470 2024-04-26T20:24:46.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.415+0000 7fd9caffd640 1 -- 172.21.15.70:0/3785378877 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3031 (secure 0 0 0) 0x7fd9d009c700 con 0x7fd9d4103470 2024-04-26T20:24:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:46.416 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T20:24:46.416 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 4 2024-04-26T20:24:46.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 -- 172.21.15.70:0/3785378877 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd9c00a3bb0 msgr2=0x7fd9c00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:46.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd9c00a3bb0 0x7fd9c00a6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4005fd0 tx=0x7fd9c4005850 comp rx=0 tx=0).stop 2024-04-26T20:24:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 -- 172.21.15.70:0/3785378877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9d4103470 msgr2=0x7fd9d4198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9d4103470 0x7fd9d4198c70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000d770 tx=0x7fd9d000dc30 comp rx=0 tx=0).stop 2024-04-26T20:24:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 -- 172.21.15.70:0/3785378877 shutdown_connections 2024-04-26T20:24:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd9c00a3bb0 0x7fd9c00a6070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9d41086d0 0x7fd9d41a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9d4105da0 0x7fd9d41991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 --2- 172.21.15.70:0/3785378877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9d4103470 0x7fd9d4198c70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 -- 172.21.15.70:0/3785378877 >> 172.21.15.70:0/3785378877 conn(0x7fd9d40fce00 msgr2=0x7fd9d4103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 -- 172.21.15.70:0/3785378877 shutdown_connections 2024-04-26T20:24:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:46.417+0000 7fd9dbb89640 1 -- 172.21.15.70:0/3785378877 wait complete. 2024-04-26T20:24:46.911 INFO:journalctl@ceph.mds.d.smithi070.stdout:Apr 26 20:24:46 smithi070 systemd[1]: Started Ceph mds.d for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:24:47.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:46 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3785378877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:47.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:46 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:47.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:46 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:47.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:46 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:47.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:46 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:47.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:46 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:47.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:46 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:47.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:46 smithi098 ceph-mon[32591]: Deploying daemon mds.e on smithi080 2024-04-26T20:24:47.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:46 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3785378877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:47.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:46 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:47.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:46 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:47.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:46 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:47.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:46 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:47.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:46 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:47.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:46 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:47.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:46 smithi080 ceph-mon[32278]: Deploying daemon mds.e on smithi080 2024-04-26T20:24:47.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:46 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3785378877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:46 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:47.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:46 smithi070 ceph-mon[29124]: Deploying daemon mds.e on smithi080 2024-04-26T20:24:48.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:47 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.70:6836/2473693414,v1:172.21.15.70:6837/2473693414] up:boot 2024-04-26T20:24:48.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:47 smithi098 ceph-mon[32591]: fsmap 4 up:standby 2024-04-26T20:24:48.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:47 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T20:24:48.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:47 smithi098 ceph-mon[32591]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:48.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:47 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.70:6836/2473693414,v1:172.21.15.70:6837/2473693414] up:boot 2024-04-26T20:24:48.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:47 smithi080 ceph-mon[32278]: fsmap 4 up:standby 2024-04-26T20:24:48.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:47 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T20:24:48.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:47 smithi080 ceph-mon[32278]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:48.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:47 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.70:6836/2473693414,v1:172.21.15.70:6837/2473693414] up:boot 2024-04-26T20:24:48.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:47 smithi070 ceph-mon[29124]: fsmap 4 up:standby 2024-04-26T20:24:48.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:47 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T20:24:48.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:47 smithi070 ceph-mon[29124]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:48.430 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.541+0000 7f9987662640 1 -- 172.21.15.70:0/768925309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f998006e8e0 msgr2=0x7f998006ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.541+0000 7f9987662640 1 --2- 172.21.15.70:0/768925309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f998006e8e0 0x7f998006ed00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f997c009900 tx=0x7f997c02a410 comp rx=0 tx=0).stop 2024-04-26T20:24:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 -- 172.21.15.70:0/768925309 shutdown_connections 2024-04-26T20:24:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 --2- 172.21.15.70:0/768925309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99800704c0 0x7f9980070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 --2- 172.21.15.70:0/768925309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f998006fb20 0x7f998006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 --2- 172.21.15.70:0/768925309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f998006e8e0 0x7f998006ed00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 -- 172.21.15.70:0/768925309 >> 172.21.15.70:0/768925309 conn(0x7f998006d4b0 msgr2=0x7f998006d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 -- 172.21.15.70:0/768925309 shutdown_connections 2024-04-26T20:24:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 -- 172.21.15.70:0/768925309 wait complete. 2024-04-26T20:24:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 Processor -- start 2024-04-26T20:24:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 -- start start 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998006e8e0 0x7f99801a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f998006fb20 0x7f99801a8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800704c0 0x7f99801af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f998011d3d0 con 0x7f99800704c0 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f998011d250 con 0x7f998006e8e0 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9987662640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f998011d550 con 0x7f998006fb20 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.542+0000 7f9985bff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800704c0 0x7f99801af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f9985bff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800704c0 0x7f99801af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51810/0 (socket says 172.21.15.70:51810) 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f9985bff640 1 -- 172.21.15.70:0/2122556499 learned_addr learned my addr 172.21.15.70:0/2122556499 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f99853fe640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998006e8e0 0x7f99801a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f9984bfd640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f998006fb20 0x7f99801a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f9985bff640 1 -- 172.21.15.70:0/2122556499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f998006fb20 msgr2=0x7f99801a8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f9985bff640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f998006fb20 0x7f99801a8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f9985bff640 1 -- 172.21.15.70:0/2122556499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998006e8e0 msgr2=0x7f99801a7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f9985bff640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998006e8e0 0x7f99801a7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f9985bff640 1 -- 172.21.15.70:0/2122556499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99801af6f0 con 0x7f99800704c0 2024-04-26T20:24:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f99853fe640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998006e8e0 0x7f99801a7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f9985bff640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800704c0 0x7f99801af080 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f997800cad0 tx=0x7f997800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f99767fc640 1 -- 172.21.15.70:0/2122556499 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997800ae20 con 0x7f99800704c0 2024-04-26T20:24:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f99767fc640 1 -- 172.21.15.70:0/2122556499 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9978005020 con 0x7f99800704c0 2024-04-26T20:24:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f9987662640 1 -- 172.21.15.70:0/2122556499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99801af9e0 con 0x7f99800704c0 2024-04-26T20:24:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f99767fc640 1 -- 172.21.15.70:0/2122556499 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997800f6b0 con 0x7f99800704c0 2024-04-26T20:24:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.543+0000 7f9987662640 1 -- 172.21.15.70:0/2122556499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99801afee0 con 0x7f99800704c0 2024-04-26T20:24:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.544+0000 7f9987662640 1 -- 172.21.15.70:0/2122556499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9980119d50 con 0x7f99800704c0 2024-04-26T20:24:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.546+0000 7f99767fc640 1 -- 172.21.15.70:0/2122556499 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f99780051d0 con 0x7f99800704c0 2024-04-26T20:24:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.547+0000 7f99767fc640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f996c0a3bb0 0x7f996c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.547+0000 7f99853fe640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f996c0a3bb0 0x7f996c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:48.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.547+0000 7f99767fc640 1 -- 172.21.15.70:0/2122556499 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f99780d0460 con 0x7f99800704c0 2024-04-26T20:24:48.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.547+0000 7f99853fe640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f996c0a3bb0 0x7f996c0a6070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f997c0096c0 tx=0x7f997c009650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:48.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.550+0000 7f99767fc640 1 -- 172.21.15.70:0/2122556499 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f9978014030 con 0x7f99800704c0 2024-04-26T20:24:48.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.770+0000 7f9987662640 1 -- 172.21.15.70:0/2122556499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f998002dd20 con 0x7f99800704c0 2024-04-26T20:24:48.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.770+0000 7f99767fc640 1 -- 172.21.15.70:0/2122556499 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3856 (secure 0 0 0) 0x7f997809d2e0 con 0x7f99800704c0 2024-04-26T20:24:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:48.771 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T20:24:48.772 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 5 2024-04-26T20:24:48.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.772+0000 7f9987662640 1 -- 172.21.15.70:0/2122556499 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f996c0a3bb0 msgr2=0x7f996c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:48.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.772+0000 7f9987662640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f996c0a3bb0 0x7f996c0a6070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f997c0096c0 tx=0x7f997c009650 comp rx=0 tx=0).stop 2024-04-26T20:24:48.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.772+0000 7f9987662640 1 -- 172.21.15.70:0/2122556499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800704c0 msgr2=0x7f99801af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:48.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.772+0000 7f9987662640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800704c0 0x7f99801af080 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f997800cad0 tx=0x7f997800cf90 comp rx=0 tx=0).stop 2024-04-26T20:24:48.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.772+0000 7f9987662640 1 -- 172.21.15.70:0/2122556499 shutdown_connections 2024-04-26T20:24:48.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.772+0000 7f9987662640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f996c0a3bb0 0x7f996c0a6070 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:48.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.772+0000 7f9987662640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800704c0 0x7f99801af080 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:48.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.772+0000 7f9987662640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f998006fb20 0x7f99801a8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:48.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.772+0000 7f9987662640 1 --2- 172.21.15.70:0/2122556499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998006e8e0 0x7f99801a7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:48.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.772+0000 7f9987662640 1 -- 172.21.15.70:0/2122556499 >> 172.21.15.70:0/2122556499 conn(0x7f998006d4b0 msgr2=0x7f998010b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:48.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.773+0000 7f9987662640 1 -- 172.21.15.70:0/2122556499 shutdown_connections 2024-04-26T20:24:48.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:48.773+0000 7f9987662640 1 -- 172.21.15.70:0/2122556499 wait complete. 2024-04-26T20:24:49.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:48 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2122556499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:49.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:48 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2122556499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:49.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:48 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2122556499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:49.220 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:24:49 smithi080 systemd[1]: Starting Ceph mds.e for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:24:49.614 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:24:49 smithi080 podman[61575]: 2024-04-26 20:24:49.249254205 +0000 UTC m=+0.018149099 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:24:49.614 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:24:49 smithi080 podman[61575]: 2024-04-26 20:24:49.3700205 +0000 UTC m=+0.138915377 container create 4e4863d539fdfd5eb074ab2206898fe35cce69c0cadd9d3e6e596fa61033c76c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-26T20:24:49.615 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:24:49 smithi080 podman[61575]: 2024-04-26 20:24:49.614409532 +0000 UTC m=+0.383304408 container init 4e4863d539fdfd5eb074ab2206898fe35cce69c0cadd9d3e6e596fa61033c76c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T20:24:49.969 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:24:49 smithi080 podman[61575]: 2024-04-26 20:24:49.617135855 +0000 UTC m=+0.386030738 container start 4e4863d539fdfd5eb074ab2206898fe35cce69c0cadd9d3e6e596fa61033c76c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-26T20:24:49.970 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:24:49 smithi080 ceph-mds[61594]: -- 172.21.15.80:0/2878974111 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5559ae585a40 con 0x5559ae558800 2024-04-26T20:24:49.970 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:24:49 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e[61590]: starting mds.e at 2024-04-26T20:24:49.970 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:24:49 smithi080 bash[61575]: 4e4863d539fdfd5eb074ab2206898fe35cce69c0cadd9d3e6e596fa61033c76c 2024-04-26T20:24:49.970 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:24:49 smithi080 systemd[1]: Started Ceph mds.e for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:24:50.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.896+0000 7f9035f24640 1 -- 172.21.15.70:0/3271723104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9030101890 msgr2=0x7f9030101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.896+0000 7f9035f24640 1 --2- 172.21.15.70:0/3271723104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9030101890 0x7f9030101cb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9020009900 tx=0x7f902002a410 comp rx=0 tx=0).stop 2024-04-26T20:24:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.896+0000 7f9035f24640 1 -- 172.21.15.70:0/3271723104 shutdown_connections 2024-04-26T20:24:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.896+0000 7f9035f24640 1 --2- 172.21.15.70:0/3271723104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9030103440 0x7f9030109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.896+0000 7f9035f24640 1 --2- 172.21.15.70:0/3271723104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9030102a80 0x7f9030102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.896+0000 7f9035f24640 1 --2- 172.21.15.70:0/3271723104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9030101890 0x7f9030101cb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.896+0000 7f9035f24640 1 -- 172.21.15.70:0/3271723104 >> 172.21.15.70:0/3271723104 conn(0x7f90300fce40 msgr2=0x7f90300ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.896+0000 7f9035f24640 1 -- 172.21.15.70:0/3271723104 shutdown_connections 2024-04-26T20:24:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.896+0000 7f9035f24640 1 -- 172.21.15.70:0/3271723104 wait complete. 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f9035f24640 1 Processor -- start 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f9035f24640 1 -- start start 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f9035f24640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9030101890 0x7f9030197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f9035f24640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9030102a80 0x7f9030198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f9035f24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9030103440 0x7f903019f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f9035f24640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f903010d4f0 con 0x7f9030103440 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f9035f24640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f903010d370 con 0x7f9030102a80 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f9035f24640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f903010d670 con 0x7f9030101890 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f902ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9030103440 0x7f903019f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f902ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9030103440 0x7f903019f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48188/0 (socket says 172.21.15.70:48188) 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f902ffff640 1 -- 172.21.15.70:0/1085509140 learned_addr learned my addr 172.21.15.70:0/1085509140 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f902effd640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9030102a80 0x7f9030198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f902f7fe640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9030101890 0x7f9030197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f902ffff640 1 -- 172.21.15.70:0/1085509140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9030101890 msgr2=0x7f9030197bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f902ffff640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9030101890 0x7f9030197bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f902ffff640 1 -- 172.21.15.70:0/1085509140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9030102a80 msgr2=0x7f9030198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f902ffff640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9030102a80 0x7f9030198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.897+0000 7f902ffff640 1 -- 172.21.15.70:0/1085509140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903019f7f0 con 0x7f9030103440 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.898+0000 7f902ffff640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9030103440 0x7f903019f180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f902800eaa0 tx=0x7f902800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.898+0000 7f902cff9640 1 -- 172.21.15.70:0/1085509140 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902800cdb0 con 0x7f9030103440 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.898+0000 7f902cff9640 1 -- 172.21.15.70:0/1085509140 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9028005020 con 0x7f9030103440 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.898+0000 7f902cff9640 1 -- 172.21.15.70:0/1085509140 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90280116d0 con 0x7f9030103440 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.898+0000 7f9035f24640 1 -- 172.21.15.70:0/1085509140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903019fae0 con 0x7f9030103440 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.898+0000 7f9035f24640 1 -- 172.21.15.70:0/1085509140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90301a0080 con 0x7f9030103440 2024-04-26T20:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.899+0000 7f9035f24640 1 -- 172.21.15.70:0/1085509140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9030108bd0 con 0x7f9030103440 2024-04-26T20:24:50.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.900+0000 7f902cff9640 1 -- 172.21.15.70:0/1085509140 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f90280051d0 con 0x7f9030103440 2024-04-26T20:24:50.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.900+0000 7f902cff9640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f90180a3c30 0x7f90180a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:50.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.900+0000 7f902f7fe640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f90180a3c30 0x7f90180a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:50.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.901+0000 7f902cff9640 1 -- 172.21.15.70:0/1085509140 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f90280d00f0 con 0x7f9030103440 2024-04-26T20:24:50.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.901+0000 7f902f7fe640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f90180a3c30 0x7f90180a60f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9020000c00 tx=0x7f9020031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:50.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:50.905+0000 7f902cff9640 1 -- 172.21.15.70:0/1085509140 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f9028016030 con 0x7f9030103440 2024-04-26T20:24:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:50 smithi098 ceph-mon[32591]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:50.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:50.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:50.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:50 smithi098 ceph-mon[32591]: Deploying daemon mds.f on smithi098 2024-04-26T20:24:50.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:50 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.80:6834/857349607,v1:172.21.15.80:6835/857349607] up:boot 2024-04-26T20:24:50.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:50 smithi098 ceph-mon[32591]: fsmap 5 up:standby 2024-04-26T20:24:50.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:50 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:24:51.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:51.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:50 smithi070 ceph-mon[29124]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:50 smithi070 ceph-mon[29124]: Deploying daemon mds.f on smithi098 2024-04-26T20:24:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:50 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.80:6834/857349607,v1:172.21.15.80:6835/857349607] up:boot 2024-04-26T20:24:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:50 smithi070 ceph-mon[29124]: fsmap 5 up:standby 2024-04-26T20:24:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:50 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:24:51.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.122+0000 7f9035f24640 1 -- 172.21.15.70:0/1085509140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f903002dad0 con 0x7f9030103440 2024-04-26T20:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.122+0000 7f902cff9640 1 -- 172.21.15.70:0/1085509140 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4678 (secure 0 0 0) 0x7f902809cf70 con 0x7f9030103440 2024-04-26T20:24:51.123 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:51.123 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-26T20:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 6 2024-04-26T20:24:51.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 -- 172.21.15.70:0/1085509140 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f90180a3c30 msgr2=0x7f90180a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:51.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f90180a3c30 0x7f90180a60f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9020000c00 tx=0x7f9020031510 comp rx=0 tx=0).stop 2024-04-26T20:24:51.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 -- 172.21.15.70:0/1085509140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9030103440 msgr2=0x7f903019f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:51.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9030103440 0x7f903019f180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f902800eaa0 tx=0x7f902800ef60 comp rx=0 tx=0).stop 2024-04-26T20:24:51.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 -- 172.21.15.70:0/1085509140 shutdown_connections 2024-04-26T20:24:51.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f90180a3c30 0x7f90180a60f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:51.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9030103440 0x7f903019f180 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:51.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9030102a80 0x7f9030198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:51.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 --2- 172.21.15.70:0/1085509140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9030101890 0x7f9030197bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:51.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 -- 172.21.15.70:0/1085509140 >> 172.21.15.70:0/1085509140 conn(0x7f90300fce40 msgr2=0x7f9030105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:51.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 -- 172.21.15.70:0/1085509140 shutdown_connections 2024-04-26T20:24:51.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:51.124+0000 7f9035f24640 1 -- 172.21.15.70:0/1085509140 wait complete. 2024-04-26T20:24:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:51.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:51.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:50 smithi080 ceph-mon[32278]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:51.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:51.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:51.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:51.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:51.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:50 smithi080 ceph-mon[32278]: Deploying daemon mds.f on smithi098 2024-04-26T20:24:51.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:50 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.80:6834/857349607,v1:172.21.15.80:6835/857349607] up:boot 2024-04-26T20:24:51.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:50 smithi080 ceph-mon[32278]: fsmap 5 up:standby 2024-04-26T20:24:51.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:50 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:24:52.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:51 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1085509140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:52.121 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:51 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1085509140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:52.148 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:51 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1085509140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:52.148 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:24:51 smithi098 systemd[1]: Starting Ceph mds.f for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:24:52.414 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:24:52 smithi098 podman[63169]: 2024-04-26 20:24:52.050819052 +0000 UTC m=+0.018009654 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:24:52.414 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:24:52 smithi098 podman[63169]: 2024-04-26 20:24:52.168970059 +0000 UTC m=+0.136160651 container create 46300548d288a440d5c91b7c828a32d3cdad3dca2647ddfe137e80bd78f144c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:24:52.415 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:24:52 smithi098 podman[63169]: 2024-04-26 20:24:52.413891809 +0000 UTC m=+0.381082401 container init 46300548d288a440d5c91b7c828a32d3cdad3dca2647ddfe137e80bd78f144c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-04-26T20:24:52.708 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:24:52 smithi098 podman[63169]: 2024-04-26 20:24:52.416676498 +0000 UTC m=+0.383867091 container start 46300548d288a440d5c91b7c828a32d3cdad3dca2647ddfe137e80bd78f144c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-26T20:24:52.709 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:24:52 smithi098 ceph-mds[63188]: -- 172.21.15.98:0/1553433731 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf2e5d3a40 con 0x55bf2e5a6800 2024-04-26T20:24:52.709 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:24:52 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f[63184]: starting mds.f at 2024-04-26T20:24:52.709 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:24:52 smithi098 bash[63169]: 46300548d288a440d5c91b7c828a32d3cdad3dca2647ddfe137e80bd78f144c0 2024-04-26T20:24:52.709 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:24:52 smithi098 systemd[1]: Started Ceph mds.f for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:24:53.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:52 smithi070 ceph-mon[29124]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:53.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:52 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:53.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:52 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:53.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:52 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:53.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:52 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:53.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:52 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:53.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:52 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:53.137 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:52 smithi098 ceph-mon[32591]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:53.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:52 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:52 smithi080 ceph-mon[32278]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:52 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:52 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:52 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:52 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:52 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:52 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:53.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 -- 172.21.15.70:0/3627637384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6840101260 msgr2=0x7f6840103690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:53.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 --2- 172.21.15.70:0/3627637384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6840101260 0x7f6840103690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6830009900 tx=0x7f683002a410 comp rx=0 tx=0).stop 2024-04-26T20:24:53.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 -- 172.21.15.70:0/3627637384 shutdown_connections 2024-04-26T20:24:53.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 --2- 172.21.15.70:0/3627637384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6840106580 0x7f6840106a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 --2- 172.21.15.70:0/3627637384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840103bd0 0x7f6840106040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 --2- 172.21.15.70:0/3627637384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6840101260 0x7f6840103690 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 -- 172.21.15.70:0/3627637384 >> 172.21.15.70:0/3627637384 conn(0x7f68400fce60 msgr2=0x7f68400ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 -- 172.21.15.70:0/3627637384 shutdown_connections 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 -- 172.21.15.70:0/3627637384 wait complete. 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 Processor -- start 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 -- start start 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840101260 0x7f684019f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6840103bd0 0x7f684019f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6840106580 0x7f68401a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6840114bf0 con 0x7f6840103bd0 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6840114a70 con 0x7f6840101260 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.247+0000 7f6848664640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6840114d70 con 0x7f6840106580 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6845bff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6840103bd0 0x7f684019f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6845bff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6840103bd0 0x7f684019f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48210/0 (socket says 172.21.15.70:48210) 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6845bff640 1 -- 172.21.15.70:0/642580577 learned_addr learned my addr 172.21.15.70:0/642580577 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6846400640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840101260 0x7f684019f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6846c01640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6840106580 0x7f68401a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6845bff640 1 -- 172.21.15.70:0/642580577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6840106580 msgr2=0x7f68401a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6845bff640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6840106580 0x7f68401a67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6845bff640 1 -- 172.21.15.70:0/642580577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840101260 msgr2=0x7f684019f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6845bff640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840101260 0x7f684019f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6845bff640 1 -- 172.21.15.70:0/642580577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68401a6e50 con 0x7f6840103bd0 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6845bff640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6840103bd0 0x7f684019f770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f683c00e9f0 tx=0x7f683c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f68377fe640 1 -- 172.21.15.70:0/642580577 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c00ccc0 con 0x7f6840103bd0 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6848664640 1 -- 172.21.15.70:0/642580577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68401a7140 con 0x7f6840103bd0 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f68377fe640 1 -- 172.21.15.70:0/642580577 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f683c010900 con 0x7f6840103bd0 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f68377fe640 1 -- 172.21.15.70:0/642580577 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c018860 con 0x7f6840103bd0 2024-04-26T20:24:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.248+0000 7f6848664640 1 -- 172.21.15.70:0/642580577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68401a7690 con 0x7f6840103bd0 2024-04-26T20:24:53.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.249+0000 7f6848664640 1 -- 172.21.15.70:0/642580577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68400fe950 con 0x7f6840103bd0 2024-04-26T20:24:53.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.250+0000 7f68377fe640 1 -- 172.21.15.70:0/642580577 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f683c010ab0 con 0x7f6840103bd0 2024-04-26T20:24:53.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.251+0000 7f68377fe640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f682c0a3bb0 0x7f682c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:53.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.251+0000 7f6846400640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f682c0a3bb0 0x7f682c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:53.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.251+0000 7f68377fe640 1 -- 172.21.15.70:0/642580577 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f683c0d02a0 con 0x7f6840103bd0 2024-04-26T20:24:53.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.251+0000 7f6846400640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f682c0a3bb0 0x7f682c0a6070 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6830000c00 tx=0x7f6830031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:53.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.255+0000 7f68377fe640 1 -- 172.21.15.70:0/642580577 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f683c09d120 con 0x7f6840103bd0 2024-04-26T20:24:53.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.470+0000 7f6848664640 1 -- 172.21.15.70:0/642580577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f684002dd20 con 0x7f6840103bd0 2024-04-26T20:24:53.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.471+0000 7f68377fe640 1 -- 172.21.15.70:0/642580577 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5503 (secure 0 0 0) 0x7f683c09ca20 con 0x7f6840103bd0 2024-04-26T20:24:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:53.472 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-26T20:24:53.472 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 7 2024-04-26T20:24:53.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 -- 172.21.15.70:0/642580577 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f682c0a3bb0 msgr2=0x7f682c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f682c0a3bb0 0x7f682c0a6070 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6830000c00 tx=0x7f6830031510 comp rx=0 tx=0).stop 2024-04-26T20:24:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 -- 172.21.15.70:0/642580577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6840103bd0 msgr2=0x7f684019f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6840103bd0 0x7f684019f770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f683c00e9f0 tx=0x7f683c00edf0 comp rx=0 tx=0).stop 2024-04-26T20:24:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 -- 172.21.15.70:0/642580577 shutdown_connections 2024-04-26T20:24:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f682c0a3bb0 0x7f682c0a6070 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6840106580 0x7f68401a67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6840103bd0 0x7f684019f770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 --2- 172.21.15.70:0/642580577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840101260 0x7f684019f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 -- 172.21.15.70:0/642580577 >> 172.21.15.70:0/642580577 conn(0x7f68400fce60 msgr2=0x7f6840101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 -- 172.21.15.70:0/642580577 shutdown_connections 2024-04-26T20:24:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:53.473+0000 7f6848664640 1 -- 172.21.15.70:0/642580577 wait complete. 2024-04-26T20:24:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:53 smithi070 ceph-mon[29124]: Deploying daemon mds.c on smithi098 2024-04-26T20:24:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:53 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] up:boot 2024-04-26T20:24:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:53 smithi070 ceph-mon[29124]: fsmap 6 up:standby 2024-04-26T20:24:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:53 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:24:54.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:53 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/642580577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:54.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:53 smithi098 ceph-mon[32591]: Deploying daemon mds.c on smithi098 2024-04-26T20:24:54.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:53 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] up:boot 2024-04-26T20:24:54.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:53 smithi098 ceph-mon[32591]: fsmap 6 up:standby 2024-04-26T20:24:54.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:53 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:24:54.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:53 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/642580577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:54.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:53 smithi080 ceph-mon[32278]: Deploying daemon mds.c on smithi098 2024-04-26T20:24:54.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:53 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] up:boot 2024-04-26T20:24:54.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:53 smithi080 ceph-mon[32278]: fsmap 6 up:standby 2024-04-26T20:24:54.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:53 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:24:54.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:53 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/642580577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:54.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:54 smithi098 ceph-mon[32591]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:54.959 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:24:54 smithi098 systemd[1]: Starting Ceph mds.c for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:24:55.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:54 smithi070 ceph-mon[29124]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:55.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:54 smithi080 ceph-mon[32278]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:55.295 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:24:55 smithi098 podman[63491]: 2024-04-26 20:24:54.927147431 +0000 UTC m=+0.017837375 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:24:55.295 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:24:55 smithi098 podman[63491]: 2024-04-26 20:24:55.042526123 +0000 UTC m=+0.133216101 container create 10e6c2710488ee0ca1f59a5a7c9e4fdbb526cf39543ec5837f22f52fefe9e815 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T20:24:55.295 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:24:55 smithi098 podman[63491]: 2024-04-26 20:24:55.295339061 +0000 UTC m=+0.386028997 container init 10e6c2710488ee0ca1f59a5a7c9e4fdbb526cf39543ec5837f22f52fefe9e815 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:24:55.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:55.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.596+0000 7f0985262640 1 -- 172.21.15.70:0/4063510986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09801034a0 msgr2=0x7f0980109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:55.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.596+0000 7f0985262640 1 --2- 172.21.15.70:0/4063510986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09801034a0 0x7f0980109d30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0978009ca0 tx=0x7f097802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:55.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.596+0000 7f0985262640 1 -- 172.21.15.70:0/4063510986 shutdown_connections 2024-04-26T20:24:55.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.596+0000 7f0985262640 1 --2- 172.21.15.70:0/4063510986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09801034a0 0x7f0980109d30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.596+0000 7f0985262640 1 --2- 172.21.15.70:0/4063510986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0980102ae0 0x7f0980102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.596+0000 7f0985262640 1 --2- 172.21.15.70:0/4063510986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09801018f0 0x7f0980101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.596+0000 7f0985262640 1 -- 172.21.15.70:0/4063510986 >> 172.21.15.70:0/4063510986 conn(0x7f09800fcea0 msgr2=0x7f09800ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.596+0000 7f0985262640 1 -- 172.21.15.70:0/4063510986 shutdown_connections 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.596+0000 7f0985262640 1 -- 172.21.15.70:0/4063510986 wait complete. 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f0985262640 1 Processor -- start 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f0985262640 1 -- start start 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f0985262640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09801018f0 0x7f0980198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f0985262640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0980102ae0 0x7f0980199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f0985262640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09801034a0 0x7f09801a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f0985262640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f098010e5e0 con 0x7f09801018f0 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f0985262640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f098010e460 con 0x7f09801034a0 2024-04-26T20:24:55.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f0985262640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f098010e760 con 0x7f0980102ae0 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09801018f0 0x7f0980198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09801018f0 0x7f0980198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48228/0 (socket says 172.21.15.70:48228) 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097effd640 1 -- 172.21.15.70:0/3190102686 learned_addr learned my addr 172.21.15.70:0/3190102686 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f0977fff640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0980102ae0 0x7f0980199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097f7fe640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09801034a0 0x7f09801a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097effd640 1 -- 172.21.15.70:0/3190102686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0980102ae0 msgr2=0x7f0980199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097effd640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0980102ae0 0x7f0980199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097effd640 1 -- 172.21.15.70:0/3190102686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09801034a0 msgr2=0x7f09801a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097effd640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09801034a0 0x7f09801a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097effd640 1 -- 172.21.15.70:0/3190102686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09801a0760 con 0x7f09801018f0 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097effd640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09801018f0 0x7f0980198b40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f097000d770 tx=0x7f097000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097cff9640 1 -- 172.21.15.70:0/3190102686 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970017070 con 0x7f09801018f0 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f097cff9640 1 -- 172.21.15.70:0/3190102686 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0970009c30 con 0x7f09801018f0 2024-04-26T20:24:55.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.597+0000 7f0985262640 1 -- 172.21.15.70:0/3190102686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09801a0a50 con 0x7f09801018f0 2024-04-26T20:24:55.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.598+0000 7f097cff9640 1 -- 172.21.15.70:0/3190102686 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970003d70 con 0x7f09801018f0 2024-04-26T20:24:55.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.598+0000 7f0985262640 1 -- 172.21.15.70:0/3190102686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09801a0fa0 con 0x7f09801018f0 2024-04-26T20:24:55.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.598+0000 7f0985262640 1 -- 172.21.15.70:0/3190102686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0980069c30 con 0x7f09801018f0 2024-04-26T20:24:55.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.600+0000 7f097cff9640 1 -- 172.21.15.70:0/3190102686 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0970003f10 con 0x7f09801018f0 2024-04-26T20:24:55.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.600+0000 7f097cff9640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f096c0a3bb0 0x7f096c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:55.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.600+0000 7f0977fff640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f096c0a3bb0 0x7f096c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:55.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.600+0000 7f097cff9640 1 -- 172.21.15.70:0/3190102686 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f09700cfdd0 con 0x7f09801018f0 2024-04-26T20:24:55.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.601+0000 7f0977fff640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f096c0a3bb0 0x7f096c0a6070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0968005e10 tx=0x7f0968005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:55.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.604+0000 7f097cff9640 1 -- 172.21.15.70:0/3190102686 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f097009cc50 con 0x7f09801018f0 2024-04-26T20:24:55.708 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:24:55 smithi098 podman[63491]: 2024-04-26 20:24:55.298019679 +0000 UTC m=+0.388709620 container start 10e6c2710488ee0ca1f59a5a7c9e4fdbb526cf39543ec5837f22f52fefe9e815 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:24:55.708 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:24:55 smithi098 ceph-mds[63510]: -- 172.21.15.98:0/2935502729 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55802df45a40 con 0x55802df18c00 2024-04-26T20:24:55.708 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:24:55 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c[63506]: starting mds.c at 2024-04-26T20:24:55.708 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:24:55 smithi098 bash[63491]: 10e6c2710488ee0ca1f59a5a7c9e4fdbb526cf39543ec5837f22f52fefe9e815 2024-04-26T20:24:55.708 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:24:55 smithi098 systemd[1]: Started Ceph mds.c for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:24:55.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.818+0000 7f0985262640 1 -- 172.21.15.70:0/3190102686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0980108b40 con 0x7f09801018f0 2024-04-26T20:24:55.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.818+0000 7f097cff9640 1 -- 172.21.15.70:0/3190102686 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6328 (secure 0 0 0) 0x7f0970009de0 con 0x7f09801018f0 2024-04-26T20:24:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:55.819 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-26T20:24:55.819 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-04-26T20:24:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 -- 172.21.15.70:0/3190102686 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f096c0a3bb0 msgr2=0x7f096c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f096c0a3bb0 0x7f096c0a6070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0968005e10 tx=0x7f0968005da0 comp rx=0 tx=0).stop 2024-04-26T20:24:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 -- 172.21.15.70:0/3190102686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09801018f0 msgr2=0x7f0980198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09801018f0 0x7f0980198b40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f097000d770 tx=0x7f097000dc30 comp rx=0 tx=0).stop 2024-04-26T20:24:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 -- 172.21.15.70:0/3190102686 shutdown_connections 2024-04-26T20:24:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f096c0a3bb0 0x7f096c0a6070 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09801034a0 0x7f09801a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:55.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0980102ae0 0x7f0980199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:55.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 --2- 172.21.15.70:0/3190102686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09801018f0 0x7f0980198b40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:55.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 -- 172.21.15.70:0/3190102686 >> 172.21.15.70:0/3190102686 conn(0x7f09800fcea0 msgr2=0x7f0980105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:55.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 -- 172.21.15.70:0/3190102686 shutdown_connections 2024-04-26T20:24:55.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:55.820+0000 7f0985262640 1 -- 172.21.15.70:0/3190102686 wait complete. 2024-04-26T20:24:56.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:56.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:56.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:56.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:56.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:56.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:56.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: Deploying daemon mds.h on smithi080 2024-04-26T20:24:56.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:56.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] up:boot 2024-04-26T20:24:56.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: fsmap 7 up:standby 2024-04-26T20:24:56.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:24:56.721 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:56 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3190102686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:56.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: Deploying daemon mds.h on smithi080 2024-04-26T20:24:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] up:boot 2024-04-26T20:24:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: fsmap 7 up:standby 2024-04-26T20:24:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:24:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:56 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3190102686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:56.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:56.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:56.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:56.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:56.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:56.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:56.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: Deploying daemon mds.h on smithi080 2024-04-26T20:24:56.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:56.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] up:boot 2024-04-26T20:24:56.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: fsmap 7 up:standby 2024-04-26T20:24:56.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:24:56.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:56 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3190102686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:57.832 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 -- 172.21.15.70:0/646767926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f2c102a80 msgr2=0x7f1f2c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 --2- 172.21.15.70:0/646767926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f2c102a80 0x7f1f2c102f00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009ca0 tx=0x7f1f1c02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 -- 172.21.15.70:0/646767926 shutdown_connections 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 --2- 172.21.15.70:0/646767926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f2c103440 0x7f1f2c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 --2- 172.21.15.70:0/646767926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f2c102a80 0x7f1f2c102f00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 --2- 172.21.15.70:0/646767926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2c101890 0x7f1f2c101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 -- 172.21.15.70:0/646767926 >> 172.21.15.70:0/646767926 conn(0x7f1f2c0fce00 msgr2=0x7f1f2c0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 -- 172.21.15.70:0/646767926 shutdown_connections 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 -- 172.21.15.70:0/646767926 wait complete. 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 Processor -- start 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 -- start start 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f2c101890 0x7f1f2c19aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2c102a80 0x7f1f2c19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f2c103440 0x7f1f2c1a2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c10d4f0 con 0x7f1f2c103440 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c10d370 con 0x7f1f2c102a80 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.941+0000 7f1f32e72640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c10d670 con 0x7f1f2c101890 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f3140f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f2c103440 0x7f1f2c1a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f3140f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f2c103440 0x7f1f2c1a2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48258/0 (socket says 172.21.15.70:48258) 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f2bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2c102a80 0x7f1f2c19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f3140f640 1 -- 172.21.15.70:0/3338457009 learned_addr learned my addr 172.21.15.70:0/3338457009 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f30c0e640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f2c101890 0x7f1f2c19aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f3140f640 1 -- 172.21.15.70:0/3338457009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f2c101890 msgr2=0x7f1f2c19aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f3140f640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f2c101890 0x7f1f2c19aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f3140f640 1 -- 172.21.15.70:0/3338457009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2c102a80 msgr2=0x7f1f2c19b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f3140f640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2c102a80 0x7f1f2c19b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f3140f640 1 -- 172.21.15.70:0/3338457009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c1a2ac0 con 0x7f1f2c103440 2024-04-26T20:24:57.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f3140f640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f2c103440 0x7f1f2c1a2450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400c970 tx=0x7f1f1400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:57.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f29ffb640 1 -- 172.21.15.70:0/3338457009 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14007bb0 con 0x7f1f2c103440 2024-04-26T20:24:57.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f29ffb640 1 -- 172.21.15.70:0/3338457009 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f14007d50 con 0x7f1f2c103440 2024-04-26T20:24:57.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f32e72640 1 -- 172.21.15.70:0/3338457009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2c1a2db0 con 0x7f1f2c103440 2024-04-26T20:24:57.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f29ffb640 1 -- 172.21.15.70:0/3338457009 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1400f450 con 0x7f1f2c103440 2024-04-26T20:24:57.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.942+0000 7f1f32e72640 1 -- 172.21.15.70:0/3338457009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f2c1a32d0 con 0x7f1f2c103440 2024-04-26T20:24:57.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.943+0000 7f1f32e72640 1 -- 172.21.15.70:0/3338457009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2c1a3560 con 0x7f1f2c103440 2024-04-26T20:24:57.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.944+0000 7f1f29ffb640 1 -- 172.21.15.70:0/3338457009 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f1f14004f20 con 0x7f1f2c103440 2024-04-26T20:24:57.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.945+0000 7f1f29ffb640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f180a3c30 0x7f1f180a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:57.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.945+0000 7f1f30c0e640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f180a3c30 0x7f1f180a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:57.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.945+0000 7f1f29ffb640 1 -- 172.21.15.70:0/3338457009 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f1f140cfb40 con 0x7f1f2c103440 2024-04-26T20:24:57.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.945+0000 7f1f30c0e640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f180a3c30 0x7f1f180a60f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c1028e0 tx=0x7f1f24005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:57.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:57.949+0000 7f1f29ffb640 1 -- 172.21.15.70:0/3338457009 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1f14014030 con 0x7f1f2c103440 2024-04-26T20:24:58.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.166+0000 7f1f32e72640 1 -- 172.21.15.70:0/3338457009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f2c1a3730 con 0x7f1f2c103440 2024-04-26T20:24:58.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.167+0000 7f1f29ffb640 1 -- 172.21.15.70:0/3338457009 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6328 (secure 0 0 0) 0x7f1f1409c9c0 con 0x7f1f2c103440 2024-04-26T20:24:58.204 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:24:58.204 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-26T20:24:58.205 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-04-26T20:24:58.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 -- 172.21.15.70:0/3338457009 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f180a3c30 msgr2=0x7f1f180a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:58.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f180a3c30 0x7f1f180a60f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c1028e0 tx=0x7f1f24005f90 comp rx=0 tx=0).stop 2024-04-26T20:24:58.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 -- 172.21.15.70:0/3338457009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f2c103440 msgr2=0x7f1f2c1a2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:58.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f2c103440 0x7f1f2c1a2450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400c970 tx=0x7f1f1400ce30 comp rx=0 tx=0).stop 2024-04-26T20:24:58.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 -- 172.21.15.70:0/3338457009 shutdown_connections 2024-04-26T20:24:58.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1f180a3c30 0x7f1f180a60f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f2c103440 0x7f1f2c1a2450 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2c102a80 0x7f1f2c19b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 --2- 172.21.15.70:0/3338457009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f2c101890 0x7f1f2c19aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 -- 172.21.15.70:0/3338457009 >> 172.21.15.70:0/3338457009 conn(0x7f1f2c0fce00 msgr2=0x7f1f2c0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:58.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 -- 172.21.15.70:0/3338457009 shutdown_connections 2024-04-26T20:24:58.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:24:58.169+0000 7f1f32e72640 1 -- 172.21.15.70:0/3338457009 wait complete. 2024-04-26T20:24:58.220 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:24:58 smithi080 podman[61885]: 2024-04-26 20:24:58.126290148 +0000 UTC m=+0.135350595 container create 8d796e6cfab63933b13fba348262d87c58ee3eea397731e75510172cbd4fac4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:24:58.505 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:24:58 smithi080 podman[61885]: 2024-04-26 20:24:58.414646778 +0000 UTC m=+0.423707186 container init 8d796e6cfab63933b13fba348262d87c58ee3eea397731e75510172cbd4fac4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:24:58.505 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:24:58 smithi080 podman[61885]: 2024-04-26 20:24:58.417314776 +0000 UTC m=+0.426375197 container start 8d796e6cfab63933b13fba348262d87c58ee3eea397731e75510172cbd4fac4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-26T20:24:58.505 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:24:58 smithi080 ceph-mds[61904]: -- 172.21.15.80:0/1085154019 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c4c841ba40 con 0x55c4c83ee800 2024-04-26T20:24:58.505 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:24:58 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h[61900]: starting mds.h at 2024-04-26T20:24:58.830 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:24:58 smithi080 bash[61885]: 8d796e6cfab63933b13fba348262d87c58ee3eea397731e75510172cbd4fac4a 2024-04-26T20:24:58.830 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:24:58 smithi080 systemd[1]: Started Ceph mds.h for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:24:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:58 smithi098 ceph-mon[32591]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:58 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3338457009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:59.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:59.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:59.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:59.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:59.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:58 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:59.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:58 smithi080 ceph-mon[32278]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:59.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:58 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3338457009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:59.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:59.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:58 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:58 smithi070 ceph-mon[29124]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:24:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:58 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3338457009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:24:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:24:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:24:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:58 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:00.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:25:00.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:59 smithi098 ceph-mon[32591]: Deploying daemon mds.i on smithi098 2024-04-26T20:25:00.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:59 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] up:boot 2024-04-26T20:25:00.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:59 smithi098 ceph-mon[32591]: fsmap 8 up:standby 2024-04-26T20:25:00.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:24:59 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:25:00.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:59 smithi080 ceph-mon[32278]: Deploying daemon mds.i on smithi098 2024-04-26T20:25:00.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:59 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] up:boot 2024-04-26T20:25:00.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:59 smithi080 ceph-mon[32278]: fsmap 8 up:standby 2024-04-26T20:25:00.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:24:59 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:25:00.232 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:59 smithi070 ceph-mon[29124]: Deploying daemon mds.i on smithi098 2024-04-26T20:25:00.232 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:59 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] up:boot 2024-04-26T20:25:00.232 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:59 smithi070 ceph-mon[29124]: fsmap 8 up:standby 2024-04-26T20:25:00.232 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:24:59 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:25:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.316+0000 7fdc62b89640 1 -- 172.21.15.70:0/2023593330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c103520 msgr2=0x7fdc5c109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.316+0000 7fdc62b89640 1 --2- 172.21.15.70:0/2023593330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c103520 0x7fdc5c109db0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009ca0 tx=0x7fdc5402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.316+0000 7fdc62b89640 1 -- 172.21.15.70:0/2023593330 shutdown_connections 2024-04-26T20:25:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.316+0000 7fdc62b89640 1 --2- 172.21.15.70:0/2023593330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c103520 0x7fdc5c109db0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.316+0000 7fdc62b89640 1 --2- 172.21.15.70:0/2023593330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc5c102b60 0x7fdc5c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.316+0000 7fdc62b89640 1 --2- 172.21.15.70:0/2023593330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5c101970 0x7fdc5c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.316+0000 7fdc62b89640 1 -- 172.21.15.70:0/2023593330 >> 172.21.15.70:0/2023593330 conn(0x7fdc5c0fcf00 msgr2=0x7fdc5c0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.316+0000 7fdc62b89640 1 -- 172.21.15.70:0/2023593330 shutdown_connections 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.316+0000 7fdc62b89640 1 -- 172.21.15.70:0/2023593330 wait complete. 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc62b89640 1 Processor -- start 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc62b89640 1 -- start start 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc62b89640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c101970 0x7fdc5c198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc62b89640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5c102b60 0x7fdc5c1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc62b89640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc5c103520 0x7fdc5c1a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc62b89640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c10d4f0 con 0x7fdc5c101970 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc62b89640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c10d370 con 0x7fdc5c103520 2024-04-26T20:25:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc62b89640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c10d670 con 0x7fdc5c102b60 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc60925640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c101970 0x7fdc5c198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc60925640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c101970 0x7fdc5c198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53110/0 (socket says 172.21.15.70:53110) 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc60925640 1 -- 172.21.15.70:0/1658480932 learned_addr learned my addr 172.21.15.70:0/1658480932 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc5bfff640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5c102b60 0x7fdc5c1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc60925640 1 -- 172.21.15.70:0/1658480932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5c102b60 msgr2=0x7fdc5c1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc60925640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5c102b60 0x7fdc5c1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc60925640 1 -- 172.21.15.70:0/1658480932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc5c103520 msgr2=0x7fdc5c1a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.317+0000 7fdc60925640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc5c103520 0x7fdc5c1a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.318+0000 7fdc60925640 1 -- 172.21.15.70:0/1658480932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c1a0870 con 0x7fdc5c101970 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.318+0000 7fdc5bfff640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5c102b60 0x7fdc5c1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.318+0000 7fdc60925640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c101970 0x7fdc5c198c60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00d950 tx=0x7fdc4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.318+0000 7fdc59ffb640 1 -- 172.21.15.70:0/1658480932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c017070 con 0x7fdc5c101970 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.318+0000 7fdc59ffb640 1 -- 172.21.15.70:0/1658480932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdc4c009c30 con 0x7fdc5c101970 2024-04-26T20:25:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.318+0000 7fdc62b89640 1 -- 172.21.15.70:0/1658480932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5c1a0b60 con 0x7fdc5c101970 2024-04-26T20:25:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.318+0000 7fdc59ffb640 1 -- 172.21.15.70:0/1658480932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c00f620 con 0x7fdc5c101970 2024-04-26T20:25:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.318+0000 7fdc62b89640 1 -- 172.21.15.70:0/1658480932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5c1a1060 con 0x7fdc5c101970 2024-04-26T20:25:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.319+0000 7fdc62b89640 1 -- 172.21.15.70:0/1658480932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc5c1a1230 con 0x7fdc5c101970 2024-04-26T20:25:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.320+0000 7fdc59ffb640 1 -- 172.21.15.70:0/1658480932 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fdc4c01a070 con 0x7fdc5c101970 2024-04-26T20:25:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.321+0000 7fdc59ffb640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdc440a3bb0 0x7fdc440a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.321+0000 7fdc5bfff640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdc440a3bb0 0x7fdc440a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.321+0000 7fdc59ffb640 1 -- 172.21.15.70:0/1658480932 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fdc4c0cfac0 con 0x7fdc5c101970 2024-04-26T20:25:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.322+0000 7fdc5bfff640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdc440a3bb0 0x7fdc440a6070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc50005fd0 tx=0x7fdc5000b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.326+0000 7fdc59ffb640 1 -- 172.21.15.70:0/1658480932 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fdc4c009de0 con 0x7fdc5c101970 2024-04-26T20:25:00.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.542+0000 7fdc62b89640 1 -- 172.21.15.70:0/1658480932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc5c1a14e0 con 0x7fdc5c101970 2024-04-26T20:25:00.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.543+0000 7fdc59ffb640 1 -- 172.21.15.70:0/1658480932 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7153 (secure 0 0 0) 0x7fdc4c09c940 con 0x7fdc5c101970 2024-04-26T20:25:00.544 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:00.544 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-26T20:25:00.544 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 9 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 -- 172.21.15.70:0/1658480932 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdc440a3bb0 msgr2=0x7fdc440a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdc440a3bb0 0x7fdc440a6070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc50005fd0 tx=0x7fdc5000b5f0 comp rx=0 tx=0).stop 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 -- 172.21.15.70:0/1658480932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c101970 msgr2=0x7fdc5c198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c101970 0x7fdc5c198c60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00d950 tx=0x7fdc4c00de10 comp rx=0 tx=0).stop 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 -- 172.21.15.70:0/1658480932 shutdown_connections 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdc440a3bb0 0x7fdc440a6070 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc5c103520 0x7fdc5c1a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5c102b60 0x7fdc5c1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 --2- 172.21.15.70:0/1658480932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c101970 0x7fdc5c198c60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 -- 172.21.15.70:0/1658480932 >> 172.21.15.70:0/1658480932 conn(0x7fdc5c0fcf00 msgr2=0x7fdc5c06b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 -- 172.21.15.70:0/1658480932 shutdown_connections 2024-04-26T20:25:00.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:00.545+0000 7fdc62b89640 1 -- 172.21.15.70:0/1658480932 wait complete. 2024-04-26T20:25:00.837 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:25:00 smithi098 systemd[1]: Starting Ceph mds.i for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:25:01.095 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:00 smithi098 ceph-mon[32591]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:01.095 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:00 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1658480932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:01.095 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:25:00 smithi098 podman[63799]: 2024-04-26 20:25:00.878671674 +0000 UTC m=+0.017990638 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:25:01.095 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:25:00 smithi098 podman[63799]: 2024-04-26 20:25:00.982345852 +0000 UTC m=+0.121664813 container create 1a2204d234f6022f1fccc5c1fa59dccd89f9a5cd2b2d009f6b3454df48b9c027 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD) 2024-04-26T20:25:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:00 smithi080 ceph-mon[32278]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:00 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1658480932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:01.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:00 smithi070 ceph-mon[29124]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:01.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:00 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1658480932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:01.458 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:25:01 smithi098 podman[63799]: 2024-04-26 20:25:01.218507134 +0000 UTC m=+0.357826095 container init 1a2204d234f6022f1fccc5c1fa59dccd89f9a5cd2b2d009f6b3454df48b9c027 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:25:01.459 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:25:01 smithi098 podman[63799]: 2024-04-26 20:25:01.221281558 +0000 UTC m=+0.360600522 container start 1a2204d234f6022f1fccc5c1fa59dccd89f9a5cd2b2d009f6b3454df48b9c027 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-26T20:25:01.459 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:25:01 smithi098 ceph-mds[63818]: -- 172.21.15.98:0/4048994571 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561f2addda40 con 0x561f2adb0c00 2024-04-26T20:25:01.459 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:25:01 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i[63814]: starting mds.i at 2024-04-26T20:25:01.459 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:25:01 smithi098 bash[63799]: 1a2204d234f6022f1fccc5c1fa59dccd89f9a5cd2b2d009f6b3454df48b9c027 2024-04-26T20:25:01.459 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:25:01 smithi098 systemd[1]: Started Ceph mds.i for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:25:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:25:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:25:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:02 smithi080 ceph-mon[32278]: Deploying daemon mds.g on smithi070 2024-04-26T20:25:02.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:02 smithi080 ceph-mon[32278]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:02.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:02 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] up:boot 2024-04-26T20:25:02.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:02 smithi080 ceph-mon[32278]: fsmap 9 up:standby 2024-04-26T20:25:02.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:02 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:25:02.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:25:02.580 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:02.580 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:02.581 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:02.581 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:25:02.581 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:25:02.581 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:02.581 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:02 smithi070 ceph-mon[29124]: Deploying daemon mds.g on smithi070 2024-04-26T20:25:02.581 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:02 smithi070 ceph-mon[29124]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:02.581 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:02 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] up:boot 2024-04-26T20:25:02.581 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:02 smithi070 ceph-mon[29124]: fsmap 9 up:standby 2024-04-26T20:25:02.581 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:02 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:25:02.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 -- 172.21.15.70:0/560020987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2fc101890 msgr2=0x7ff2fc101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:02.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 --2- 172.21.15.70:0/560020987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2fc101890 0x7ff2fc101cb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009ca0 tx=0x7ff2ec02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:02.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 -- 172.21.15.70:0/560020987 shutdown_connections 2024-04-26T20:25:02.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 --2- 172.21.15.70:0/560020987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2fc103440 0x7ff2fc109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:02.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 --2- 172.21.15.70:0/560020987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2fc102a80 0x7ff2fc102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:02.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 --2- 172.21.15.70:0/560020987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2fc101890 0x7ff2fc101cb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:02.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 -- 172.21.15.70:0/560020987 >> 172.21.15.70:0/560020987 conn(0x7ff2fc0fce00 msgr2=0x7ff2fc0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 -- 172.21.15.70:0/560020987 shutdown_connections 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 -- 172.21.15.70:0/560020987 wait complete. 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 Processor -- start 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 -- start start 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2fc101890 0x7ff2fc198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2fc102a80 0x7ff2fc1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2fc103440 0x7ff2fc1a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc10d4e0 con 0x7ff2fc103440 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc10d360 con 0x7ff2fc101890 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.659+0000 7ff30156a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc10d660 con 0x7ff2fc102a80 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2fb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2fc103440 0x7ff2fc1a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2fb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2fc103440 0x7ff2fc1a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53126/0 (socket says 172.21.15.70:53126) 2024-04-26T20:25:02.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2fb7fe640 1 -- 172.21.15.70:0/3259166391 learned_addr learned my addr 172.21.15.70:0/3259166391 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2faffd640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2fc101890 0x7ff2fc198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2fa7fc640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2fc102a80 0x7ff2fc1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2fb7fe640 1 -- 172.21.15.70:0/3259166391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2fc102a80 msgr2=0x7ff2fc1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2fb7fe640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2fc102a80 0x7ff2fc1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2fb7fe640 1 -- 172.21.15.70:0/3259166391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2fc101890 msgr2=0x7ff2fc198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2fb7fe640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2fc101890 0x7ff2fc198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2fb7fe640 1 -- 172.21.15.70:0/3259166391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc1a0880 con 0x7ff2fc103440 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2faffd640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2fc101890 0x7ff2fc198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2fa7fc640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2fc102a80 0x7ff2fc1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2fb7fe640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2fc103440 0x7ff2fc1a01e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400c970 tx=0x7ff2f400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2f3fff640 1 -- 172.21.15.70:0/3259166391 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4007bb0 con 0x7ff2fc103440 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff30156a640 1 -- 172.21.15.70:0/3259166391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2fc1a0b70 con 0x7ff2fc103440 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2f3fff640 1 -- 172.21.15.70:0/3259166391 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff2f4007d50 con 0x7ff2fc103440 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff2f3fff640 1 -- 172.21.15.70:0/3259166391 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40187c0 con 0x7ff2fc103440 2024-04-26T20:25:02.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.660+0000 7ff30156a640 1 -- 172.21.15.70:0/3259166391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2fc1a10c0 con 0x7ff2fc103440 2024-04-26T20:25:02.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.661+0000 7ff30156a640 1 -- 172.21.15.70:0/3259166391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2fc1a1290 con 0x7ff2fc103440 2024-04-26T20:25:02.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.662+0000 7ff2f3fff640 1 -- 172.21.15.70:0/3259166391 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7ff2f400fa40 con 0x7ff2fc103440 2024-04-26T20:25:02.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.663+0000 7ff2f3fff640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff2e80a3bb0 0x7ff2e80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:02.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.663+0000 7ff2faffd640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff2e80a3bb0 0x7ff2e80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:02.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.663+0000 7ff2f3fff640 1 -- 172.21.15.70:0/3259166391 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7ff2f40d0180 con 0x7ff2fc103440 2024-04-26T20:25:02.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.663+0000 7ff2faffd640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff2e80a3bb0 0x7ff2e80a6070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec006010 tx=0x7ff2ec0093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:02.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.667+0000 7ff2f3fff640 1 -- 172.21.15.70:0/3259166391 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff2f4014030 con 0x7ff2fc103440 2024-04-26T20:25:02.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:02.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:02.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:02.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:25:02.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:25:02.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:02.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:02 smithi098 ceph-mon[32591]: Deploying daemon mds.g on smithi070 2024-04-26T20:25:02.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:02 smithi098 ceph-mon[32591]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:02.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:02 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] up:boot 2024-04-26T20:25:02.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:02 smithi098 ceph-mon[32591]: fsmap 9 up:standby 2024-04-26T20:25:02.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:02 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:25:02.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.884+0000 7ff30156a640 1 -- 172.21.15.70:0/3259166391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2fc1a1500 con 0x7ff2fc103440 2024-04-26T20:25:02.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.885+0000 7ff2f3fff640 1 -- 172.21.15.70:0/3259166391 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+7980 (secure 0 0 0) 0x7ff2f409d000 con 0x7ff2fc103440 2024-04-26T20:25:02.886 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:02.886 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-26T20:25:02.886 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 10 2024-04-26T20:25:02.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 -- 172.21.15.70:0/3259166391 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff2e80a3bb0 msgr2=0x7ff2e80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:02.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff2e80a3bb0 0x7ff2e80a6070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec006010 tx=0x7ff2ec0093f0 comp rx=0 tx=0).stop 2024-04-26T20:25:02.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 -- 172.21.15.70:0/3259166391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2fc103440 msgr2=0x7ff2fc1a01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:02.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2fc103440 0x7ff2fc1a01e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400c970 tx=0x7ff2f400ce30 comp rx=0 tx=0).stop 2024-04-26T20:25:02.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 -- 172.21.15.70:0/3259166391 shutdown_connections 2024-04-26T20:25:02.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff2e80a3bb0 0x7ff2e80a6070 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:02.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2fc103440 0x7ff2fc1a01e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:02.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2fc102a80 0x7ff2fc1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:02.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 --2- 172.21.15.70:0/3259166391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2fc101890 0x7ff2fc198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:02.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 -- 172.21.15.70:0/3259166391 >> 172.21.15.70:0/3259166391 conn(0x7ff2fc0fce00 msgr2=0x7ff2fc069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:02.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 -- 172.21.15.70:0/3259166391 shutdown_connections 2024-04-26T20:25:02.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:02.887+0000 7ff30156a640 1 -- 172.21.15.70:0/3259166391 wait complete. 2024-04-26T20:25:03.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:03 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3259166391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:03.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:03 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3259166391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:03.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:03 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3259166391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:04.175 INFO:journalctl@ceph.mds.g.smithi070.stdout:Apr 26 20:25:04 smithi070 systemd[1]: Started Ceph mds.g for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:25:04.702 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:04 smithi098 ceph-mon[32591]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:04.703 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:04.703 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:04.703 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:04.703 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:25:04.703 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:25:04.703 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:04 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:04.722 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:04 smithi080 ceph-mon[32278]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:04.722 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:04.722 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:04.722 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:04.722 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:25:04.722 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:25:04.722 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:04 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:04.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:04 smithi070 ceph-mon[29124]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:04.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:04.748 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:04.748 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:04.748 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:25:04.748 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:25:04.748 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:04 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:04.900 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:25:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.000+0000 7f16b68da640 1 -- 172.21.15.70:0/96567082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16b0105d40 msgr2=0x7f16b0108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.000+0000 7f16b68da640 1 --2- 172.21.15.70:0/96567082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16b0105d40 0x7f16b0108130 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009900 tx=0x7f16a402a410 comp rx=0 tx=0).stop 2024-04-26T20:25:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.000+0000 7f16b68da640 1 -- 172.21.15.70:0/96567082 shutdown_connections 2024-04-26T20:25:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.000+0000 7f16b68da640 1 --2- 172.21.15.70:0/96567082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16b0108670 0x7f16b010aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.000+0000 7f16b68da640 1 --2- 172.21.15.70:0/96567082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16b0105d40 0x7f16b0108130 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.000+0000 7f16b68da640 1 --2- 172.21.15.70:0/96567082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b0103410 0x7f16b0105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.000+0000 7f16b68da640 1 -- 172.21.15.70:0/96567082 >> 172.21.15.70:0/96567082 conn(0x7f16b00fce40 msgr2=0x7f16b00ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.000+0000 7f16b68da640 1 -- 172.21.15.70:0/96567082 shutdown_connections 2024-04-26T20:25:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.000+0000 7f16b68da640 1 -- 172.21.15.70:0/96567082 wait complete. 2024-04-26T20:25:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.000+0000 7f16b68da640 1 Processor -- start 2024-04-26T20:25:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.000+0000 7f16b68da640 1 -- start start 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.001+0000 7f16b68da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16b0103410 0x7f16b0102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.001+0000 7f16b68da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16b0105d40 0x7f16b01013c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.001+0000 7f16b68da640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b0108670 0x7f16b0101900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.001+0000 7f16b68da640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f16b010e5f0 con 0x7f16b0103410 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.001+0000 7f16b68da640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f16b010e470 con 0x7f16b0108670 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.001+0000 7f16b68da640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16b010e770 con 0x7f16b0105d40 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.001+0000 7f16affff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16b0103410 0x7f16b0102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.001+0000 7f16affff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16b0103410 0x7f16b0102d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53158/0 (socket says 172.21.15.70:53158) 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.001+0000 7f16affff640 1 -- 172.21.15.70:0/1137242239 learned_addr learned my addr 172.21.15.70:0/1137242239 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.001+0000 7f16af7fe640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16b0105d40 0x7f16b01013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16b4e77640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b0108670 0x7f16b0101900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16affff640 1 -- 172.21.15.70:0/1137242239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16b0105d40 msgr2=0x7f16b01013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16affff640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16b0105d40 0x7f16b01013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16affff640 1 -- 172.21.15.70:0/1137242239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b0108670 msgr2=0x7f16b0101900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16affff640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b0108670 0x7f16b0101900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16affff640 1 -- 172.21.15.70:0/1137242239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b01021c0 con 0x7f16b0103410 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16b4e77640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b0108670 0x7f16b0101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16affff640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16b0103410 0x7f16b0102d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f16a000c920 tx=0x7f16a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16ad7fa640 1 -- 172.21.15.70:0/1137242239 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0007c70 con 0x7f16b0103410 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16b68da640 1 -- 172.21.15.70:0/1137242239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b01a2db0 con 0x7f16b0103410 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16ad7fa640 1 -- 172.21.15.70:0/1137242239 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f16a0007e10 con 0x7f16b0103410 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16ad7fa640 1 -- 172.21.15.70:0/1137242239 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a00188c0 con 0x7f16b0103410 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.002+0000 7f16b68da640 1 -- 172.21.15.70:0/1137242239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b01a3220 con 0x7f16b0103410 2024-04-26T20:25:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.003+0000 7f16b68da640 1 -- 172.21.15.70:0/1137242239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b00fe930 con 0x7f16b0103410 2024-04-26T20:25:05.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.005+0000 7f16ad7fa640 1 -- 172.21.15.70:0/1137242239 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f16a0018a60 con 0x7f16b0103410 2024-04-26T20:25:05.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.005+0000 7f16ad7fa640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f16980a3bb0 0x7f16980a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:05.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.006+0000 7f16af7fe640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f16980a3bb0 0x7f16980a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:05.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.006+0000 7f16ad7fa640 1 -- 172.21.15.70:0/1137242239 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f16a00d00a0 con 0x7f16b0103410 2024-04-26T20:25:05.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.006+0000 7f16af7fe640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f16980a3bb0 0x7f16980a6070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009230 tx=0x7f16a4031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:05.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.010+0000 7f16ad7fa640 1 -- 172.21.15.70:0/1137242239 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f16a0014030 con 0x7f16b0103410 2024-04-26T20:25:05.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.238+0000 7f16b68da640 1 -- 172.21.15.70:0/1137242239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16b002dca0 con 0x7f16b0103410 2024-04-26T20:25:05.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.239+0000 7f16ad7fa640 1 -- 172.21.15.70:0/1137242239 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8806 (secure 0 0 0) 0x7f16a009cf20 con 0x7f16b0103410 2024-04-26T20:25:05.240 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:05.240 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-26T20:25:05.240 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 11 2024-04-26T20:25:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 -- 172.21.15.70:0/1137242239 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f16980a3bb0 msgr2=0x7f16980a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f16980a3bb0 0x7f16980a6070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009230 tx=0x7f16a4031510 comp rx=0 tx=0).stop 2024-04-26T20:25:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 -- 172.21.15.70:0/1137242239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16b0103410 msgr2=0x7f16b0102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:05.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16b0103410 0x7f16b0102d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f16a000c920 tx=0x7f16a000cde0 comp rx=0 tx=0).stop 2024-04-26T20:25:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 -- 172.21.15.70:0/1137242239 shutdown_connections 2024-04-26T20:25:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f16980a3bb0 0x7f16980a6070 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16b0108670 0x7f16b0101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16b0105d40 0x7f16b01013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 --2- 172.21.15.70:0/1137242239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16b0103410 0x7f16b0102d30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 -- 172.21.15.70:0/1137242239 >> 172.21.15.70:0/1137242239 conn(0x7f16b00fce40 msgr2=0x7f16b0103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 -- 172.21.15.70:0/1137242239 shutdown_connections 2024-04-26T20:25:05.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:05.241+0000 7f16b68da640 1 -- 172.21.15.70:0/1137242239 wait complete. 2024-04-26T20:25:05.638 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:05 smithi070 ceph-mon[29124]: Deploying daemon mds.a on smithi070 2024-04-26T20:25:05.639 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:05 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.70:6838/2998426471,v1:172.21.15.70:6839/2998426471] up:boot 2024-04-26T20:25:05.639 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:05 smithi070 ceph-mon[29124]: fsmap 10 up:standby 2024-04-26T20:25:05.639 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:05 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:25:05.639 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:05 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1137242239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:05.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:05 smithi098 ceph-mon[32591]: Deploying daemon mds.a on smithi070 2024-04-26T20:25:05.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:05 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.70:6838/2998426471,v1:172.21.15.70:6839/2998426471] up:boot 2024-04-26T20:25:05.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:05 smithi098 ceph-mon[32591]: fsmap 10 up:standby 2024-04-26T20:25:05.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:05 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:25:05.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:05 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1137242239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:05.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:05 smithi080 ceph-mon[32278]: Deploying daemon mds.a on smithi070 2024-04-26T20:25:05.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:05 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.70:6838/2998426471,v1:172.21.15.70:6839/2998426471] up:boot 2024-04-26T20:25:05.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:05 smithi080 ceph-mon[32278]: fsmap 10 up:standby 2024-04-26T20:25:05.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:05 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:25:05.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:05 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1137242239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:06 smithi070 ceph-mon[29124]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:06.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:06 smithi098 ceph-mon[32591]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:06.719 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:06 smithi080 ceph-mon[32278]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:07.254 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:25:07.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 -- 172.21.15.70:0/3949757475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c103be0 msgr2=0x7f866c104060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:07.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 --2- 172.21.15.70:0/3949757475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c103be0 0x7f866c104060 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f865c009900 tx=0x7f865c02a410 comp rx=0 tx=0).stop 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 -- 172.21.15.70:0/3949757475 shutdown_connections 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 --2- 172.21.15.70:0/3949757475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f866c1045a0 0x7f866c10ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 --2- 172.21.15.70:0/3949757475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c103be0 0x7f866c104060 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 --2- 172.21.15.70:0/3949757475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f866c1029f0 0x7f866c102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 -- 172.21.15.70:0/3949757475 >> 172.21.15.70:0/3949757475 conn(0x7f866c0fdf60 msgr2=0x7f866c1003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 -- 172.21.15.70:0/3949757475 shutdown_connections 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 -- 172.21.15.70:0/3949757475 wait complete. 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 Processor -- start 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 -- start start 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f866c1029f0 0x7f866c198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f866c103be0 0x7f866c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:07.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1045a0 0x7f866c1a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f866c10e640 con 0x7f866c1045a0 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f866c10e4c0 con 0x7f866c103be0 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8672d5f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f866c10e7c0 con 0x7f866c1029f0 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f86712fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1045a0 0x7f866c1a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f86712fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1045a0 0x7f866c1a0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53204/0 (socket says 172.21.15.70:53204) 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f86712fc640 1 -- 172.21.15.70:0/334011160 learned_addr learned my addr 172.21.15.70:0/334011160 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.358+0000 7f8663fff640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f866c103be0 0x7f866c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f8670afb640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f866c1029f0 0x7f866c198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f86712fc640 1 -- 172.21.15.70:0/334011160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f866c1029f0 msgr2=0x7f866c198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f86712fc640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f866c1029f0 0x7f866c198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f86712fc640 1 -- 172.21.15.70:0/334011160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f866c103be0 msgr2=0x7f866c1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f86712fc640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f866c103be0 0x7f866c1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f86712fc640 1 -- 172.21.15.70:0/334011160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866c1a08f0 con 0x7f866c1045a0 2024-04-26T20:25:07.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f8670afb640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f866c1029f0 0x7f866c198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:07.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f86712fc640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1045a0 0x7f866c1a0250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f866400b970 tx=0x7f866400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:07.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f8661ffb640 1 -- 172.21.15.70:0/334011160 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664019070 con 0x7f866c1045a0 2024-04-26T20:25:07.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f8661ffb640 1 -- 172.21.15.70:0/334011160 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f866400cb40 con 0x7f866c1045a0 2024-04-26T20:25:07.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f8672d5f640 1 -- 172.21.15.70:0/334011160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f866c1a0be0 con 0x7f866c1045a0 2024-04-26T20:25:07.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f8661ffb640 1 -- 172.21.15.70:0/334011160 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664007650 con 0x7f866c1045a0 2024-04-26T20:25:07.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.359+0000 7f8672d5f640 1 -- 172.21.15.70:0/334011160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f866c1a11d0 con 0x7f866c1045a0 2024-04-26T20:25:07.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.360+0000 7f8672d5f640 1 -- 172.21.15.70:0/334011160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f866c109d90 con 0x7f866c1045a0 2024-04-26T20:25:07.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.361+0000 7f8661ffb640 1 -- 172.21.15.70:0/334011160 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f866401c070 con 0x7f866c1045a0 2024-04-26T20:25:07.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.362+0000 7f8661ffb640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f86540a3c30 0x7f86540a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:07.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.362+0000 7f8670afb640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f86540a3c30 0x7f86540a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:07.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.362+0000 7f8661ffb640 1 -- 172.21.15.70:0/334011160 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f86640cf400 con 0x7f866c1045a0 2024-04-26T20:25:07.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.362+0000 7f8670afb640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f86540a3c30 0x7f86540a60f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f866c199b80 tx=0x7f8668005e90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:07.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.366+0000 7f8661ffb640 1 -- 172.21.15.70:0/334011160 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f866409bc30 con 0x7f866c1045a0 2024-04-26T20:25:07.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.581+0000 7f8672d5f640 1 -- 172.21.15.70:0/334011160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f866c02dc80 con 0x7f866c1045a0 2024-04-26T20:25:07.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.581+0000 7f8661ffb640 1 -- 172.21.15.70:0/334011160 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9632 (secure 0 0 0) 0x7f866409ff30 con 0x7f866c1045a0 2024-04-26T20:25:07.582 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:07.582 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3333683222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3333683222},{"type":"v1","addr":"172.21.15.70:6841","nonce":3333683222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-26T20:25:07.583 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 12 2024-04-26T20:25:07.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.583+0000 7f8672d5f640 1 -- 172.21.15.70:0/334011160 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f86540a3c30 msgr2=0x7f86540a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:07.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.583+0000 7f8672d5f640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f86540a3c30 0x7f86540a60f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f866c199b80 tx=0x7f8668005e90 comp rx=0 tx=0).stop 2024-04-26T20:25:07.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.583+0000 7f8672d5f640 1 -- 172.21.15.70:0/334011160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1045a0 msgr2=0x7f866c1a0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:07.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.583+0000 7f8672d5f640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1045a0 0x7f866c1a0250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f866400b970 tx=0x7f866400be30 comp rx=0 tx=0).stop 2024-04-26T20:25:07.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.584+0000 7f8672d5f640 1 -- 172.21.15.70:0/334011160 shutdown_connections 2024-04-26T20:25:07.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.584+0000 7f8672d5f640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f86540a3c30 0x7f86540a60f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:07.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.584+0000 7f8672d5f640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1045a0 0x7f866c1a0250 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:07.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.584+0000 7f8672d5f640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f866c103be0 0x7f866c1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:07.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.584+0000 7f8672d5f640 1 --2- 172.21.15.70:0/334011160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f866c1029f0 0x7f866c198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:07.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.584+0000 7f8672d5f640 1 -- 172.21.15.70:0/334011160 >> 172.21.15.70:0/334011160 conn(0x7f866c0fdf60 msgr2=0x7f866c106f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:07.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.584+0000 7f8672d5f640 1 -- 172.21.15.70:0/334011160 shutdown_connections 2024-04-26T20:25:07.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:07.584+0000 7f8672d5f640 1 -- 172.21.15.70:0/334011160 wait complete. 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: Deploying daemon mds.b on smithi080 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.70:6840/3333683222,v1:172.21.15.70:6841/3333683222] up:boot 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: fsmap 11 up:standby 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/334011160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:08.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:08 smithi080 ceph-mon[32278]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:08.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:25:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:25:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: Deploying daemon mds.b on smithi080 2024-04-26T20:25:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.70:6840/3333683222,v1:172.21.15.70:6841/3333683222] up:boot 2024-04-26T20:25:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: fsmap 11 up:standby 2024-04-26T20:25:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:25:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/334011160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:08 smithi070 ceph-mon[29124]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:08.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:08.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:08.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:08.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:25:08.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:25:08.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:08.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: Deploying daemon mds.b on smithi080 2024-04-26T20:25:08.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.70:6840/3333683222,v1:172.21.15.70:6841/3333683222] up:boot 2024-04-26T20:25:08.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: fsmap 11 up:standby 2024-04-26T20:25:08.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:25:08.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/334011160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:08.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:08 smithi098 ceph-mon[32591]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:09.596 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:25:09.665 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:09 smithi080 systemd[1]: Starting Ceph mds.b for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:25:09.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.705+0000 7fe343262640 1 -- 172.21.15.70:0/125455634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe33c10d400 msgr2=0x7fe33c10d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:09.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.705+0000 7fe343262640 1 --2- 172.21.15.70:0/125455634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe33c10d400 0x7fe33c10d820 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009900 tx=0x7fe32c02a410 comp rx=0 tx=0).stop 2024-04-26T20:25:09.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.705+0000 7fe343262640 1 -- 172.21.15.70:0/125455634 shutdown_connections 2024-04-26T20:25:09.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.705+0000 7fe343262640 1 --2- 172.21.15.70:0/125455634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe33c10efb0 0x7fe33c115840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:09.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.705+0000 7fe343262640 1 --2- 172.21.15.70:0/125455634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe33c10e5f0 0x7fe33c10ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:09.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.705+0000 7fe343262640 1 --2- 172.21.15.70:0/125455634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe33c10d400 0x7fe33c10d820 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:09.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.705+0000 7fe343262640 1 -- 172.21.15.70:0/125455634 >> 172.21.15.70:0/125455634 conn(0x7fe33c06d6c0 msgr2=0x7fe33c06daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:09.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe343262640 1 -- 172.21.15.70:0/125455634 shutdown_connections 2024-04-26T20:25:09.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe343262640 1 -- 172.21.15.70:0/125455634 wait complete. 2024-04-26T20:25:09.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe343262640 1 Processor -- start 2024-04-26T20:25:09.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe343262640 1 -- start start 2024-04-26T20:25:09.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe343262640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe33c10d400 0x7fe33c1a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:09.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe343262640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe33c10e5f0 0x7fe33c1a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:09.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe343262640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe33c10efb0 0x7fe33c1aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:09.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe343262640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c118ff0 con 0x7fe33c10e5f0 2024-04-26T20:25:09.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe343262640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c118e70 con 0x7fe33c10d400 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe343262640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c119170 con 0x7fe33c10efb0 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe33bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe33c10e5f0 0x7fe33c1a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe33bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe33c10e5f0 0x7fe33c1a3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48464/0 (socket says 172.21.15.70:48464) 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe33bfff640 1 -- 172.21.15.70:0/2611598314 learned_addr learned my addr 172.21.15.70:0/2611598314 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.706+0000 7fe340ffe640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe33c10d400 0x7fe33c1a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.707+0000 7fe33bfff640 1 -- 172.21.15.70:0/2611598314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe33c10efb0 msgr2=0x7fe33c1aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.707+0000 7fe33bfff640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe33c10efb0 0x7fe33c1aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.707+0000 7fe33bfff640 1 -- 172.21.15.70:0/2611598314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe33c10d400 msgr2=0x7fe33c1a3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.707+0000 7fe33bfff640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe33c10d400 0x7fe33c1a3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.707+0000 7fe33bfff640 1 -- 172.21.15.70:0/2611598314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c1ab2b0 con 0x7fe33c10e5f0 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.707+0000 7fe33bfff640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe33c10e5f0 0x7fe33c1a3bd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c970 tx=0x7fe33000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:09.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.707+0000 7fe339ffb640 1 -- 172.21.15.70:0/2611598314 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330007bb0 con 0x7fe33c10e5f0 2024-04-26T20:25:09.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.707+0000 7fe339ffb640 1 -- 172.21.15.70:0/2611598314 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe330007d50 con 0x7fe33c10e5f0 2024-04-26T20:25:09.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.707+0000 7fe339ffb640 1 -- 172.21.15.70:0/2611598314 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33000f450 con 0x7fe33c10e5f0 2024-04-26T20:25:09.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.707+0000 7fe343262640 1 -- 172.21.15.70:0/2611598314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33c1ab5a0 con 0x7fe33c10e5f0 2024-04-26T20:25:09.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.707+0000 7fe343262640 1 -- 172.21.15.70:0/2611598314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33c1abaa0 con 0x7fe33c10e5f0 2024-04-26T20:25:09.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.708+0000 7fe343262640 1 -- 172.21.15.70:0/2611598314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33c114720 con 0x7fe33c10e5f0 2024-04-26T20:25:09.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.709+0000 7fe339ffb640 1 -- 172.21.15.70:0/2611598314 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fe3300046c0 con 0x7fe33c10e5f0 2024-04-26T20:25:09.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.710+0000 7fe339ffb640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3240a3bb0 0x7fe3240a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:09.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.710+0000 7fe340ffe640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3240a3bb0 0x7fe3240a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:09.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.710+0000 7fe339ffb640 1 -- 172.21.15.70:0/2611598314 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fe3300cfd10 con 0x7fe33c10e5f0 2024-04-26T20:25:09.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.710+0000 7fe340ffe640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3240a3bb0 0x7fe3240a6070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009230 tx=0x7fe32c031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:09.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.715+0000 7fe339ffb640 1 -- 172.21.15.70:0/2611598314 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fe330014030 con 0x7fe33c10e5f0 2024-04-26T20:25:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.931+0000 7fe343262640 1 -- 172.21.15.70:0/2611598314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe33c02dcd0 con 0x7fe33c10e5f0 2024-04-26T20:25:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.932+0000 7fe339ffb640 1 -- 172.21.15.70:0/2611598314 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9632 (secure 0 0 0) 0x7fe33009cb90 con 0x7fe33c10e5f0 2024-04-26T20:25:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:09.934 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3333683222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3333683222},{"type":"v1","addr":"172.21.15.70:6841","nonce":3333683222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-26T20:25:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 12 2024-04-26T20:25:09.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 -- 172.21.15.70:0/2611598314 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3240a3bb0 msgr2=0x7fe3240a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:09.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3240a3bb0 0x7fe3240a6070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009230 tx=0x7fe32c031510 comp rx=0 tx=0).stop 2024-04-26T20:25:09.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 -- 172.21.15.70:0/2611598314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe33c10e5f0 msgr2=0x7fe33c1a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:09.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe33c10e5f0 0x7fe33c1a3bd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c970 tx=0x7fe33000ce30 comp rx=0 tx=0).stop 2024-04-26T20:25:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 -- 172.21.15.70:0/2611598314 shutdown_connections 2024-04-26T20:25:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe3240a3bb0 0x7fe3240a6070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe33c10efb0 0x7fe33c1aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe33c10e5f0 0x7fe33c1a3bd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 --2- 172.21.15.70:0/2611598314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe33c10d400 0x7fe33c1a3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 -- 172.21.15.70:0/2611598314 >> 172.21.15.70:0/2611598314 conn(0x7fe33c06d6c0 msgr2=0x7fe33c1118f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 -- 172.21.15.70:0/2611598314 shutdown_connections 2024-04-26T20:25:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:09.934+0000 7fe343262640 1 -- 172.21.15.70:0/2611598314 wait complete. 2024-04-26T20:25:09.969 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:09 smithi080 podman[62194]: 2024-04-26 20:25:09.786488049 +0000 UTC m=+0.017876207 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:25:09.969 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:09 smithi080 podman[62194]: 2024-04-26 20:25:09.907342523 +0000 UTC m=+0.138730671 container create 65c65c3936300b1fd61230a82ebcb5ef98d649e4ec2875ef4717f2004c093595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-26T20:25:10.470 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:10 smithi080 podman[62194]: 2024-04-26 20:25:10.177195697 +0000 UTC m=+0.408583842 container init 65c65c3936300b1fd61230a82ebcb5ef98d649e4ec2875ef4717f2004c093595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:25:10.470 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:10 smithi080 podman[62194]: 2024-04-26 20:25:10.179902739 +0000 UTC m=+0.411290884 container start 65c65c3936300b1fd61230a82ebcb5ef98d649e4ec2875ef4717f2004c093595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:25:10.470 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:10 smithi080 ceph-mds[62213]: -- 172.21.15.80:0/304221645 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b70175fa40 con 0x55b701733000 2024-04-26T20:25:10.470 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b[62209]: starting mds.b at 2024-04-26T20:25:10.470 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:10 smithi080 bash[62194]: 65c65c3936300b1fd61230a82ebcb5ef98d649e4ec2875ef4717f2004c093595 2024-04-26T20:25:10.470 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:10 smithi080 systemd[1]: Started Ceph mds.b for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:25:11.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:10 smithi098 ceph-mon[32591]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:11.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:10 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2611598314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:11.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:10 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:11.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:10 smithi080 ceph-mon[32278]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:11.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:10 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2611598314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:11.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:10 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:11.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:10 smithi070 ceph-mon[29124]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:11.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:10 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2611598314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:11.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:11.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:10 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:11.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:25:11.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:11 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] up:boot 2024-04-26T20:25:11.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:11 smithi098 ceph-mon[32591]: fsmap 12 up:standby 2024-04-26T20:25:11.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:11 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:25:11.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:11 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] up:boot 2024-04-26T20:25:11.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:11 smithi080 ceph-mon[32278]: fsmap 12 up:standby 2024-04-26T20:25:11.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:11 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:25:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/91198056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b24105dc0 msgr2=0x7f2b241081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 --2- 172.21.15.70:0/91198056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b24105dc0 0x7f2b241081b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009900 tx=0x7f2b1402a410 comp rx=0 tx=0).stop 2024-04-26T20:25:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/91198056 shutdown_connections 2024-04-26T20:25:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 --2- 172.21.15.70:0/91198056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b241086f0 0x7f2b2410aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 --2- 172.21.15.70:0/91198056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b24105dc0 0x7f2b241081b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 --2- 172.21.15.70:0/91198056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b24103490 0x7f2b24105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/91198056 >> 172.21.15.70:0/91198056 conn(0x7f2b240fce00 msgr2=0x7f2b240ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/91198056 shutdown_connections 2024-04-26T20:25:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/91198056 wait complete. 2024-04-26T20:25:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 Processor -- start 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 -- start start 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b24103490 0x7f2b24198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b24105dc0 0x7f2b24199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b241086f0 0x7f2b241a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2410e5f0 con 0x7f2b24103490 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2410e470 con 0x7f2b24105dc0 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.052+0000 7f2b2b6d9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2410e770 con 0x7f2b241086f0 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b29475640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b24103490 0x7f2b24198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b29475640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b24103490 0x7f2b24198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48480/0 (socket says 172.21.15.70:48480) 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b29475640 1 -- 172.21.15.70:0/2048288696 learned_addr learned my addr 172.21.15.70:0/2048288696 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b28c74640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b24105dc0 0x7f2b24199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b29c76640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b241086f0 0x7f2b241a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b29475640 1 -- 172.21.15.70:0/2048288696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b241086f0 msgr2=0x7f2b241a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b29475640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b241086f0 0x7f2b241a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b29475640 1 -- 172.21.15.70:0/2048288696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b24105dc0 msgr2=0x7f2b24199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b29475640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b24105dc0 0x7f2b24199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b29475640 1 -- 172.21.15.70:0/2048288696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b241a0900 con 0x7f2b24103490 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b28c74640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b24105dc0 0x7f2b24199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b29475640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b24103490 0x7f2b24198cc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00ebc0 tx=0x7f2b1c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b1a7fc640 1 -- 172.21.15.70:0/2048288696 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c010630 con 0x7f2b24103490 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/2048288696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b241a0bf0 con 0x7f2b24103490 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b1a7fc640 1 -- 172.21.15.70:0/2048288696 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2b1c010ca0 con 0x7f2b24103490 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b1a7fc640 1 -- 172.21.15.70:0/2048288696 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c018ba0 con 0x7f2b24103490 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.053+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/2048288696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b241a1110 con 0x7f2b24103490 2024-04-26T20:25:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.054+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/2048288696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b240fe8f0 con 0x7f2b24103490 2024-04-26T20:25:12.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.056+0000 7f2b1a7fc640 1 -- 172.21.15.70:0/2048288696 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f2b1c0107d0 con 0x7f2b24103490 2024-04-26T20:25:12.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.056+0000 7f2b1a7fc640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2b100a3bb0 0x7f2b100a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.057+0000 7f2b1a7fc640 1 -- 172.21.15.70:0/2048288696 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f2b1c0d09a0 con 0x7f2b24103490 2024-04-26T20:25:12.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.057+0000 7f2b28c74640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2b100a3bb0 0x7f2b100a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.057+0000 7f2b28c74640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2b100a3bb0 0x7f2b100a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009230 tx=0x7f2b14031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.060+0000 7f2b1a7fc640 1 -- 172.21.15.70:0/2048288696 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2b1c010ac0 con 0x7f2b24103490 2024-04-26T20:25:12.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:11 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] up:boot 2024-04-26T20:25:12.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:11 smithi070 ceph-mon[29124]: fsmap 12 up:standby 2024-04-26T20:25:12.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:11 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:25:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.316+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/2048288696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b2402dad0 con 0x7f2b24103490 2024-04-26T20:25:12.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.318+0000 7f2b1a7fc640 1 -- 172.21.15.70:0/2048288696 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10458 (secure 0 0 0) 0x7f2b1c09d1d0 con 0x7f2b24103490 2024-04-26T20:25:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:12.320 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3333683222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3333683222},{"type":"v1","addr":"172.21.15.70:6841","nonce":3333683222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/4099319394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4099319394},{"type":"v1","addr":"172.21.15.80:6839","nonce":4099319394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-26T20:25:12.320 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 13 2024-04-26T20:25:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.320+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/2048288696 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2b100a3bb0 msgr2=0x7f2b100a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.320+0000 7f2b2b6d9640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2b100a3bb0 0x7f2b100a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009230 tx=0x7f2b14031510 comp rx=0 tx=0).stop 2024-04-26T20:25:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.320+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/2048288696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b24103490 msgr2=0x7f2b24198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.320+0000 7f2b2b6d9640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b24103490 0x7f2b24198cc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00ebc0 tx=0x7f2b1c00c6a0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.320+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/2048288696 shutdown_connections 2024-04-26T20:25:12.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.320+0000 7f2b2b6d9640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2b100a3bb0 0x7f2b100a6070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.320+0000 7f2b2b6d9640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b241086f0 0x7f2b241a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.321+0000 7f2b2b6d9640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b24105dc0 0x7f2b24199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.321+0000 7f2b2b6d9640 1 --2- 172.21.15.70:0/2048288696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b24103490 0x7f2b24198cc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.321+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/2048288696 >> 172.21.15.70:0/2048288696 conn(0x7f2b240fce00 msgr2=0x7f2b24103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.321+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/2048288696 shutdown_connections 2024-04-26T20:25:12.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.321+0000 7f2b2b6d9640 1 -- 172.21.15.70:0/2048288696 wait complete. 2024-04-26T20:25:12.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:25:12.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.431+0000 7f5718a1d640 1 -- 172.21.15.70:0/3560226938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5714103440 msgr2=0x7f5714109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.431+0000 7f5718a1d640 1 --2- 172.21.15.70:0/3560226938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5714103440 0x7f5714109cd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5704009900 tx=0x7f570402a410 comp rx=0 tx=0).stop 2024-04-26T20:25:12.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.431+0000 7f5718a1d640 1 -- 172.21.15.70:0/3560226938 shutdown_connections 2024-04-26T20:25:12.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.431+0000 7f5718a1d640 1 --2- 172.21.15.70:0/3560226938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5714103440 0x7f5714109cd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.431+0000 7f5718a1d640 1 --2- 172.21.15.70:0/3560226938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5714102a80 0x7f5714102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.431+0000 7f5718a1d640 1 --2- 172.21.15.70:0/3560226938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714101890 0x7f5714101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.431+0000 7f5718a1d640 1 -- 172.21.15.70:0/3560226938 >> 172.21.15.70:0/3560226938 conn(0x7f57140fce00 msgr2=0x7f57140ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.431+0000 7f5718a1d640 1 -- 172.21.15.70:0/3560226938 shutdown_connections 2024-04-26T20:25:12.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.431+0000 7f5718a1d640 1 -- 172.21.15.70:0/3560226938 wait complete. 2024-04-26T20:25:12.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f5718a1d640 1 Processor -- start 2024-04-26T20:25:12.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f5718a1d640 1 -- start start 2024-04-26T20:25:12.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f5718a1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5714101890 0x7f5714198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f5718a1d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714102a80 0x7f5714199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f5718a1d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5714103440 0x7f57141a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f5718a1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f571410e600 con 0x7f5714101890 2024-04-26T20:25:12.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f5718a1d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f571410e480 con 0x7f5714102a80 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f5718a1d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f571410e780 con 0x7f5714103440 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f571259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5714101890 0x7f5714198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f571259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5714101890 0x7f5714198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48494/0 (socket says 172.21.15.70:48494) 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f571259c640 1 -- 172.21.15.70:0/517214472 learned_addr learned my addr 172.21.15.70:0/517214472 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f5711d9b640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714102a80 0x7f5714199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.432+0000 7f5712d9d640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5714103440 0x7f57141a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f571259c640 1 -- 172.21.15.70:0/517214472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5714103440 msgr2=0x7f57141a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f571259c640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5714103440 0x7f57141a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f571259c640 1 -- 172.21.15.70:0/517214472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714102a80 msgr2=0x7f5714199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f571259c640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714102a80 0x7f5714199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f571259c640 1 -- 172.21.15.70:0/517214472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57141a0800 con 0x7f5714101890 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f5711d9b640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714102a80 0x7f5714199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f571259c640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5714101890 0x7f5714198be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f570c00e9c0 tx=0x7f570c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f57037fe640 1 -- 172.21.15.70:0/517214472 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c00cd80 con 0x7f5714101890 2024-04-26T20:25:12.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f5718a1d640 1 -- 172.21.15.70:0/517214472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57141a0af0 con 0x7f5714101890 2024-04-26T20:25:12.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f57037fe640 1 -- 172.21.15.70:0/517214472 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f570c0035f0 con 0x7f5714101890 2024-04-26T20:25:12.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f57037fe640 1 -- 172.21.15.70:0/517214472 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c010690 con 0x7f5714101890 2024-04-26T20:25:12.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.433+0000 7f5718a1d640 1 -- 172.21.15.70:0/517214472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57141a1090 con 0x7f5714101890 2024-04-26T20:25:12.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.434+0000 7f5718a1d640 1 -- 172.21.15.70:0/517214472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5714108bb0 con 0x7f5714101890 2024-04-26T20:25:12.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.435+0000 7f57037fe640 1 -- 172.21.15.70:0/517214472 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f570c0037a0 con 0x7f5714101890 2024-04-26T20:25:12.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.435+0000 7f57037fe640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56fc0a3bb0 0x7f56fc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.436+0000 7f5711d9b640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56fc0a3bb0 0x7f56fc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.436+0000 7f57037fe640 1 -- 172.21.15.70:0/517214472 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f570c0d0320 con 0x7f5714101890 2024-04-26T20:25:12.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.436+0000 7f5711d9b640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56fc0a3bb0 0x7f56fc0a6070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f571419a0f0 tx=0x7f5708009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.441+0000 7f57037fe640 1 -- 172.21.15.70:0/517214472 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f570c09d1a0 con 0x7f5714101890 2024-04-26T20:25:12.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.619+0000 7f5718a1d640 1 -- 172.21.15.70:0/517214472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f571402dd10 con 0x7f5714101890 2024-04-26T20:25:12.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.620+0000 7f57037fe640 1 -- 172.21.15.70:0/517214472 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18385 (secure 0 0 0) 0x7f570c09caa0 con 0x7f5714101890 2024-04-26T20:25:12.622 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:12.622 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":82,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:24:23.963706+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:25:12.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 -- 172.21.15.70:0/517214472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56fc0a3bb0 msgr2=0x7f56fc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56fc0a3bb0 0x7f56fc0a6070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f571419a0f0 tx=0x7f5708009500 comp rx=0 tx=0).stop 2024-04-26T20:25:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 -- 172.21.15.70:0/517214472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5714101890 msgr2=0x7f5714198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5714101890 0x7f5714198be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f570c00e9c0 tx=0x7f570c00ee80 comp rx=0 tx=0).stop 2024-04-26T20:25:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 -- 172.21.15.70:0/517214472 shutdown_connections 2024-04-26T20:25:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56fc0a3bb0 0x7f56fc0a6070 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5714103440 0x7f57141a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714102a80 0x7f5714199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 --2- 172.21.15.70:0/517214472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5714101890 0x7f5714198be0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 -- 172.21.15.70:0/517214472 >> 172.21.15.70:0/517214472 conn(0x7f57140fce00 msgr2=0x7f5714105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 -- 172.21.15.70:0/517214472 shutdown_connections 2024-04-26T20:25:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.622+0000 7f5718a1d640 1 -- 172.21.15.70:0/517214472 wait complete. 2024-04-26T20:25:12.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:20:33.781367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:25:12.636 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:25:12.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.735+0000 7f4166e3f640 1 -- 172.21.15.70:0/1582060588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4160103420 msgr2=0x7f4160109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.735+0000 7f4166e3f640 1 --2- 172.21.15.70:0/1582060588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4160103420 0x7f4160109cb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4158009ca0 tx=0x7f415802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.735+0000 7f4166e3f640 1 -- 172.21.15.70:0/1582060588 shutdown_connections 2024-04-26T20:25:12.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.735+0000 7f4166e3f640 1 --2- 172.21.15.70:0/1582060588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4160103420 0x7f4160109cb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.735+0000 7f4166e3f640 1 --2- 172.21.15.70:0/1582060588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4160102a60 0x7f4160102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.735+0000 7f4166e3f640 1 --2- 172.21.15.70:0/1582060588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4160101870 0x7f4160101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.735+0000 7f4166e3f640 1 -- 172.21.15.70:0/1582060588 >> 172.21.15.70:0/1582060588 conn(0x7f41600fce00 msgr2=0x7f41600ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.735+0000 7f4166e3f640 1 -- 172.21.15.70:0/1582060588 shutdown_connections 2024-04-26T20:25:12.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.735+0000 7f4166e3f640 1 -- 172.21.15.70:0/1582060588 wait complete. 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.735+0000 7f4166e3f640 1 Processor -- start 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f4166e3f640 1 -- start start 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f4166e3f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4160101870 0x7f416006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f4166e3f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4160102a60 0x7f416019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f4166e3f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4160103420 0x7f41601a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f4166e3f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f416010d4d0 con 0x7f4160102a60 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f4166e3f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f416010d350 con 0x7f4160103420 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f4166e3f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f416010d650 con 0x7f4160101870 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4160102a60 0x7f416019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4160102a60 0x7f416019fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48522/0 (socket says 172.21.15.70:48522) 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415ffff640 1 -- 172.21.15.70:0/2230304509 learned_addr learned my addr 172.21.15.70:0/2230304509 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f4164bdb640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4160101870 0x7f416006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f41653dc640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4160103420 0x7f41601a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415ffff640 1 -- 172.21.15.70:0/2230304509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4160101870 msgr2=0x7f416006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415ffff640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4160101870 0x7f416006bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415ffff640 1 -- 172.21.15.70:0/2230304509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4160103420 msgr2=0x7f41601a22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415ffff640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4160103420 0x7f41601a22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415ffff640 1 -- 172.21.15.70:0/2230304509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41601a2ad0 con 0x7f4160102a60 2024-04-26T20:25:12.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415ffff640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4160102a60 0x7f416019fd90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f414c00e9f0 tx=0x7f414c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415dffb640 1 -- 172.21.15.70:0/2230304509 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414c00cd80 con 0x7f4160102a60 2024-04-26T20:25:12.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f4166e3f640 1 -- 172.21.15.70:0/2230304509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41601a2d60 con 0x7f4160102a60 2024-04-26T20:25:12.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415dffb640 1 -- 172.21.15.70:0/2230304509 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f414c010900 con 0x7f4160102a60 2024-04-26T20:25:12.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.736+0000 7f415dffb640 1 -- 172.21.15.70:0/2230304509 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414c018920 con 0x7f4160102a60 2024-04-26T20:25:12.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.737+0000 7f4166e3f640 1 -- 172.21.15.70:0/2230304509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41601a3250 con 0x7f4160102a60 2024-04-26T20:25:12.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.738+0000 7f4166e3f640 1 -- 172.21.15.70:0/2230304509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4160108be0 con 0x7f4160102a60 2024-04-26T20:25:12.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.739+0000 7f415dffb640 1 -- 172.21.15.70:0/2230304509 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f414c010ab0 con 0x7f4160102a60 2024-04-26T20:25:12.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.739+0000 7f415dffb640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f41500a3be0 0x7f41500a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.739+0000 7f4164bdb640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f41500a3be0 0x7f41500a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.739+0000 7f415dffb640 1 -- 172.21.15.70:0/2230304509 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f414c0d0290 con 0x7f4160102a60 2024-04-26T20:25:12.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.740+0000 7f4164bdb640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f41500a3be0 0x7f41500a60a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4154005fd0 tx=0x7f415400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.744+0000 7f415dffb640 1 -- 172.21.15.70:0/2230304509 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f414c09cac0 con 0x7f4160102a60 2024-04-26T20:25:12.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.947+0000 7f4166e3f640 1 -- 172.21.15.70:0/2230304509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f416002dd20 con 0x7f4160102a60 2024-04-26T20:25:12.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.948+0000 7f415dffb640 1 -- 172.21.15.70:0/2230304509 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f414c0a0dc0 con 0x7f4160102a60 2024-04-26T20:25:12.949 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-04-26T20:25:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 -- 172.21.15.70:0/2230304509 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f41500a3be0 msgr2=0x7f41500a60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f41500a3be0 0x7f41500a60a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4154005fd0 tx=0x7f415400b390 comp rx=0 tx=0).stop 2024-04-26T20:25:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 -- 172.21.15.70:0/2230304509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4160102a60 msgr2=0x7f416019fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4160102a60 0x7f416019fd90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f414c00e9f0 tx=0x7f414c00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 -- 172.21.15.70:0/2230304509 shutdown_connections 2024-04-26T20:25:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f41500a3be0 0x7f41500a60a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4160103420 0x7f41601a22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4160102a60 0x7f416019fd90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 --2- 172.21.15.70:0/2230304509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4160101870 0x7f416006bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 -- 172.21.15.70:0/2230304509 >> 172.21.15.70:0/2230304509 conn(0x7f41600fce00 msgr2=0x7f4160105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 -- 172.21.15.70:0/2230304509 shutdown_connections 2024-04-26T20:25:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:12.950+0000 7f4166e3f640 1 -- 172.21.15.70:0/2230304509 wait complete. 2024-04-26T20:25:12.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:12 smithi070 ceph-mon[29124]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:12.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:12.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:12.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:12.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:12.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:12 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2048288696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:12.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:12.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:12.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:12 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/517214472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:12.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:12 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:12.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T20:25:13.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.087+0000 7f569ceb8640 1 -- 172.21.15.70:0/2578201094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5698102a80 msgr2=0x7f5698102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.087+0000 7f569ceb8640 1 --2- 172.21.15.70:0/2578201094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5698102a80 0x7f5698102f00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5680009900 tx=0x7f568002a410 comp rx=0 tx=0).stop 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 -- 172.21.15.70:0/2578201094 shutdown_connections 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 --2- 172.21.15.70:0/2578201094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5698103440 0x7f5698109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 --2- 172.21.15.70:0/2578201094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5698102a80 0x7f5698102f00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 --2- 172.21.15.70:0/2578201094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5698101890 0x7f5698101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 -- 172.21.15.70:0/2578201094 >> 172.21.15.70:0/2578201094 conn(0x7f56980fce00 msgr2=0x7f56980ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 -- 172.21.15.70:0/2578201094 shutdown_connections 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 -- 172.21.15.70:0/2578201094 wait complete. 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 Processor -- start 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 -- start start 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5698101890 0x7f569806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5698102a80 0x7f569819d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5698103440 0x7f569819ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f569810d4f0 con 0x7f5698102a80 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f569810d370 con 0x7f5698103440 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.088+0000 7f569ceb8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f569810d670 con 0x7f5698101890 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5698102a80 0x7f569819d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5698102a80 0x7f569819d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48540/0 (socket says 172.21.15.70:48540) 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568ffff640 1 -- 172.21.15.70:0/1727106224 learned_addr learned my addr 172.21.15.70:0/1727106224 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f5696d9d640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5698103440 0x7f569819ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f569659c640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5698101890 0x7f569806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568ffff640 1 -- 172.21.15.70:0/1727106224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5698101890 msgr2=0x7f569806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568ffff640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5698101890 0x7f569806a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568ffff640 1 -- 172.21.15.70:0/1727106224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5698103440 msgr2=0x7f569819ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568ffff640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5698103440 0x7f569819ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568ffff640 1 -- 172.21.15.70:0/1727106224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56981a0890 con 0x7f5698102a80 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568ffff640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5698102a80 0x7f569819d960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5680005940 tx=0x7f56800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568f7fe640 1 -- 172.21.15.70:0/1727106224 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568003f030 con 0x7f5698102a80 2024-04-26T20:25:13.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568f7fe640 1 -- 172.21.15.70:0/1727106224 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5680003cd0 con 0x7f5698102a80 2024-04-26T20:25:13.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f569ceb8640 1 -- 172.21.15.70:0/1727106224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56981a0ac0 con 0x7f5698102a80 2024-04-26T20:25:13.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f568f7fe640 1 -- 172.21.15.70:0/1727106224 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680035070 con 0x7f5698102a80 2024-04-26T20:25:13.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.089+0000 7f569ceb8640 1 -- 172.21.15.70:0/1727106224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56981a0fb0 con 0x7f5698102a80 2024-04-26T20:25:13.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.090+0000 7f569ceb8640 1 -- 172.21.15.70:0/1727106224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5698108c00 con 0x7f5698102a80 2024-04-26T20:25:13.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.091+0000 7f568f7fe640 1 -- 172.21.15.70:0/1727106224 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f5680042030 con 0x7f5698102a80 2024-04-26T20:25:13.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.092+0000 7f568f7fe640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56840a3bb0 0x7f56840a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.092+0000 7f569659c640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56840a3bb0 0x7f56840a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.092+0000 7f568f7fe640 1 -- 172.21.15.70:0/1727106224 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f56800f0410 con 0x7f5698102a80 2024-04-26T20:25:13.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.092+0000 7f569659c640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56840a3bb0 0x7f56840a6070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f56981028e0 tx=0x7f568800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.097+0000 7f568f7fe640 1 -- 172.21.15.70:0/1727106224 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f56800bcc40 con 0x7f5698102a80 2024-04-26T20:25:13.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:12 smithi098 ceph-mon[32591]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:13.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:12 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2048288696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:12 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/517214472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:13.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:12 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:12 smithi080 ceph-mon[32278]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:12 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2048288696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:12 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/517214472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:13.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:12 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:13.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.280+0000 7f569ceb8640 1 -- 172.21.15.70:0/1727106224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f569802dcf0 con 0x7f5698102a80 2024-04-26T20:25:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.281+0000 7f568f7fe640 1 -- 172.21.15.70:0/1727106224 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7f56800c0f40 con 0x7f5698102a80 2024-04-26T20:25:13.282 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:13.282 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2024-04-26T20:25:13.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:25:13.282 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2024-04-26T20:25:13.282 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2024-04-26T20:25:13.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:25:13.282 INFO:teuthology.orchestra.run.smithi070.stdout:] 2024-04-26T20:25:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 -- 172.21.15.70:0/1727106224 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56840a3bb0 msgr2=0x7f56840a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56840a3bb0 0x7f56840a6070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f56981028e0 tx=0x7f568800b390 comp rx=0 tx=0).stop 2024-04-26T20:25:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 -- 172.21.15.70:0/1727106224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5698102a80 msgr2=0x7f569819d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5698102a80 0x7f569819d960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5680005940 tx=0x7f56800042f0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 -- 172.21.15.70:0/1727106224 shutdown_connections 2024-04-26T20:25:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f56840a3bb0 0x7f56840a6070 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5698103440 0x7f569819ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5698102a80 0x7f569819d960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 --2- 172.21.15.70:0/1727106224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5698101890 0x7f569806a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 -- 172.21.15.70:0/1727106224 >> 172.21.15.70:0/1727106224 conn(0x7f56980fce00 msgr2=0x7f5698105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:13.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 -- 172.21.15.70:0/1727106224 shutdown_connections 2024-04-26T20:25:13.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.283+0000 7f569ceb8640 1 -- 172.21.15.70:0/1727106224 wait complete. 2024-04-26T20:25:13.295 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T20:25:13.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.397+0000 7f82f6409640 1 -- 172.21.15.70:0/2916967872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82f01086b0 msgr2=0x7f82f010aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.397+0000 7f82f6409640 1 --2- 172.21.15.70:0/2916967872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82f01086b0 0x7f82f010aaa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009ca0 tx=0x7f82e802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.397+0000 7f82f6409640 1 -- 172.21.15.70:0/2916967872 shutdown_connections 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.397+0000 7f82f6409640 1 --2- 172.21.15.70:0/2916967872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82f01086b0 0x7f82f010aaa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.397+0000 7f82f6409640 1 --2- 172.21.15.70:0/2916967872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82f0105d80 0x7f82f0108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.397+0000 7f82f6409640 1 --2- 172.21.15.70:0/2916967872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f0103450 0x7f82f0105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.397+0000 7f82f6409640 1 -- 172.21.15.70:0/2916967872 >> 172.21.15.70:0/2916967872 conn(0x7f82f00fce00 msgr2=0x7f82f00ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.397+0000 7f82f6409640 1 -- 172.21.15.70:0/2916967872 shutdown_connections 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.397+0000 7f82f6409640 1 -- 172.21.15.70:0/2916967872 wait complete. 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.398+0000 7f82f6409640 1 Processor -- start 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.398+0000 7f82f6409640 1 -- start start 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.398+0000 7f82f6409640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82f0103450 0x7f82f0198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.398+0000 7f82f6409640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82f0105d80 0x7f82f01991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.398+0000 7f82f6409640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f01086b0 0x7f82f01a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.398+0000 7f82f6409640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82f010e640 con 0x7f82f0105d80 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.398+0000 7f82f6409640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f82f010e4c0 con 0x7f82f0103450 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.398+0000 7f82f6409640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82f010e7c0 con 0x7f82f01086b0 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.398+0000 7f82ef7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82f0105d80 0x7f82f01991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.398+0000 7f82ef7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82f0105d80 0x7f82f01991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48554/0 (socket says 172.21.15.70:48554) 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.398+0000 7f82ef7fe640 1 -- 172.21.15.70:0/1705070843 learned_addr learned my addr 172.21.15.70:0/1705070843 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82f49a6640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f01086b0 0x7f82f01a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82effff640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82f0103450 0x7f82f0198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82ef7fe640 1 -- 172.21.15.70:0/1705070843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f01086b0 msgr2=0x7f82f01a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82ef7fe640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f01086b0 0x7f82f01a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82ef7fe640 1 -- 172.21.15.70:0/1705070843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82f0103450 msgr2=0x7f82f0198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82ef7fe640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82f0103450 0x7f82f0198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82ef7fe640 1 -- 172.21.15.70:0/1705070843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f01a08c0 con 0x7f82f0105d80 2024-04-26T20:25:13.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82f49a6640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f01086b0 0x7f82f01a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:13.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82ef7fe640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82f0105d80 0x7f82f01991c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f82e000e9c0 tx=0x7f82e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:13.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82ed7fa640 1 -- 172.21.15.70:0/1705070843 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e000cd80 con 0x7f82f0105d80 2024-04-26T20:25:13.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82f6409640 1 -- 172.21.15.70:0/1705070843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f01a0bb0 con 0x7f82f0105d80 2024-04-26T20:25:13.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82ed7fa640 1 -- 172.21.15.70:0/1705070843 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f82e00054f0 con 0x7f82f0105d80 2024-04-26T20:25:13.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82ed7fa640 1 -- 172.21.15.70:0/1705070843 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0010690 con 0x7f82f0105d80 2024-04-26T20:25:13.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.399+0000 7f82f6409640 1 -- 172.21.15.70:0/1705070843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f01a1100 con 0x7f82f0105d80 2024-04-26T20:25:13.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.400+0000 7f82f6409640 1 -- 172.21.15.70:0/1705070843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f00fe8f0 con 0x7f82f0105d80 2024-04-26T20:25:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.402+0000 7f82ed7fa640 1 -- 172.21.15.70:0/1705070843 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f82e00046c0 con 0x7f82f0105d80 2024-04-26T20:25:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.402+0000 7f82ed7fa640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f82d80a3bb0 0x7f82d80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.403+0000 7f82effff640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f82d80a3bb0 0x7f82d80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.403+0000 7f82ed7fa640 1 -- 172.21.15.70:0/1705070843 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f82e00d0750 con 0x7f82f0105d80 2024-04-26T20:25:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.403+0000 7f82effff640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f82d80a3bb0 0x7f82d80a6070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82f0199b50 tx=0x7f82e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:13.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.405+0000 7f82ed7fa640 1 -- 172.21.15.70:0/1705070843 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f82e009d5d0 con 0x7f82f0105d80 2024-04-26T20:25:13.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.601+0000 7f82f6409640 1 -- 172.21.15.70:0/1705070843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f82f002dad0 con 0x7f82f0105d80 2024-04-26T20:25:13.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.990+0000 7f82ed7fa640 1 -- 172.21.15.70:0/1705070843 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7f82e009ced0 con 0x7f82f0105d80 2024-04-26T20:25:13.991 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2024-04-26T20:25:13.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 -- 172.21.15.70:0/1705070843 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f82d80a3bb0 msgr2=0x7f82d80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f82d80a3bb0 0x7f82d80a6070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82f0199b50 tx=0x7f82e4005f90 comp rx=0 tx=0).stop 2024-04-26T20:25:13.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 -- 172.21.15.70:0/1705070843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82f0105d80 msgr2=0x7f82f01991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82f0105d80 0x7f82f01991c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f82e000e9c0 tx=0x7f82e000ee80 comp rx=0 tx=0).stop 2024-04-26T20:25:13.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 -- 172.21.15.70:0/1705070843 shutdown_connections 2024-04-26T20:25:13.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f82d80a3bb0 0x7f82d80a6070 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82f01086b0 0x7f82f01a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82f0105d80 0x7f82f01991c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 --2- 172.21.15.70:0/1705070843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82f0103450 0x7f82f0198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 -- 172.21.15.70:0/1705070843 >> 172.21.15.70:0/1705070843 conn(0x7f82f00fce00 msgr2=0x7f82f0103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:13.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 -- 172.21.15.70:0/1705070843 shutdown_connections 2024-04-26T20:25:13.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:13.992+0000 7f82f6409640 1 -- 172.21.15.70:0/1705070843 wait complete. 2024-04-26T20:25:14.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T20:25:14.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.112+0000 7f360a5cf640 1 -- 172.21.15.70:0/503912695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3604101850 msgr2=0x7f3604101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.112+0000 7f360a5cf640 1 --2- 172.21.15.70:0/503912695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3604101850 0x7f3604101c70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009900 tx=0x7f35f402a410 comp rx=0 tx=0).stop 2024-04-26T20:25:14.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 -- 172.21.15.70:0/503912695 shutdown_connections 2024-04-26T20:25:14.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 --2- 172.21.15.70:0/503912695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3604103400 0x7f3604109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 --2- 172.21.15.70:0/503912695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3604102a40 0x7f3604102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 --2- 172.21.15.70:0/503912695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3604101850 0x7f3604101c70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 -- 172.21.15.70:0/503912695 >> 172.21.15.70:0/503912695 conn(0x7f36040fcda0 msgr2=0x7f36040ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 -- 172.21.15.70:0/503912695 shutdown_connections 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 -- 172.21.15.70:0/503912695 wait complete. 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 Processor -- start 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 -- start start 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3604101850 0x7f3604198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3604102a40 0x7f3604199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.113+0000 7f360a5cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3604103400 0x7f36041a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f360a5cf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f360410e5c0 con 0x7f3604103400 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f360a5cf640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f360410e440 con 0x7f3604101850 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f360a5cf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f360410e740 con 0x7f3604102a40 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3608b6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3604103400 0x7f36041a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3603fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3604101850 0x7f3604198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3608b6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3604103400 0x7f36041a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48566/0 (socket says 172.21.15.70:48566) 2024-04-26T20:25:14.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3603fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3604101850 0x7f3604198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.70:58774/0 (socket says 172.21.15.70:58774) 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3608b6c640 1 -- 172.21.15.70:0/1471387087 learned_addr learned my addr 172.21.15.70:0/1471387087 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f36037fe640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3604102a40 0x7f3604199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3608b6c640 1 -- 172.21.15.70:0/1471387087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3604102a40 msgr2=0x7f3604199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3608b6c640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3604102a40 0x7f3604199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3608b6c640 1 -- 172.21.15.70:0/1471387087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3604101850 msgr2=0x7f3604198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3608b6c640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3604101850 0x7f3604198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3608b6c640 1 -- 172.21.15.70:0/1471387087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36041a0800 con 0x7f3604103400 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f36037fe640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3604102a40 0x7f3604199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3603fff640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3604101850 0x7f3604198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f3608b6c640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3604103400 0x7f36041a0190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00eb10 tx=0x7f35fc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f36017fa640 1 -- 172.21.15.70:0/1471387087 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc004b20 con 0x7f3604103400 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f36017fa640 1 -- 172.21.15.70:0/1471387087 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f35fc004cc0 con 0x7f3604103400 2024-04-26T20:25:14.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f360a5cf640 1 -- 172.21.15.70:0/1471387087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36041a0af0 con 0x7f3604103400 2024-04-26T20:25:14.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f36017fa640 1 -- 172.21.15.70:0/1471387087 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc010720 con 0x7f3604103400 2024-04-26T20:25:14.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.114+0000 7f360a5cf640 1 -- 172.21.15.70:0/1471387087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36041a0ff0 con 0x7f3604103400 2024-04-26T20:25:14.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.115+0000 7f360a5cf640 1 -- 172.21.15.70:0/1471387087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3604108b70 con 0x7f3604103400 2024-04-26T20:25:14.119 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:13 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:14.119 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:13 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:14.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:13 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:14.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:13 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2230304509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:25:14.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:13 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:14.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:13 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1727106224' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T20:25:14.120 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:13 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1705070843' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T20:25:14.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.117+0000 7f36017fa640 1 -- 172.21.15.70:0/1471387087 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f35fc0108c0 con 0x7f3604103400 2024-04-26T20:25:14.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.118+0000 7f36017fa640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35ec0a3bb0 0x7f35ec0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.118+0000 7f3603fff640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35ec0a3bb0 0x7f35ec0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.118+0000 7f36017fa640 1 -- 172.21.15.70:0/1471387087 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7497+0+0 (secure 0 0 0) 0x7f35fc0d0900 con 0x7f3604103400 2024-04-26T20:25:14.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.118+0000 7f3603fff640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35ec0a3bb0 0x7f35ec0a6070 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009230 tx=0x7f35f4031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.121+0000 7f36017fa640 1 -- 172.21.15.70:0/1471387087 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f35fc054060 con 0x7f3604103400 2024-04-26T20:25:14.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:13 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:14.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:13 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:14.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:13 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:14.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:13 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2230304509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:25:14.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:13 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:14.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:13 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1727106224' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T20:25:14.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:13 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1705070843' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T20:25:14.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:13 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:14.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:13 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:14.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:13 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:14.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:13 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2230304509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:25:14.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:13 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:14.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:13 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1727106224' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T20:25:14.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:13 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1705070843' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T20:25:14.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.305+0000 7f360a5cf640 1 -- 172.21.15.70:0/1471387087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f360402dad0 con 0x7f3604103400 2024-04-26T20:25:14.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.992+0000 7f36017fa640 1 -- 172.21.15.70:0/1471387087 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) ==== 170+0+0 (secure 0 0 0) 0x7f35fc09d610 con 0x7f3604103400 2024-04-26T20:25:14.993 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2024-04-26T20:25:14.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.995+0000 7f360a5cf640 1 -- 172.21.15.70:0/1471387087 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35ec0a3bb0 msgr2=0x7f35ec0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.995+0000 7f360a5cf640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35ec0a3bb0 0x7f35ec0a6070 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009230 tx=0x7f35f4031510 comp rx=0 tx=0).stop 2024-04-26T20:25:14.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.995+0000 7f360a5cf640 1 -- 172.21.15.70:0/1471387087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3604103400 msgr2=0x7f36041a0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.995+0000 7f360a5cf640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3604103400 0x7f36041a0190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00eb10 tx=0x7f35fc00c2d0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.995+0000 7f360a5cf640 1 -- 172.21.15.70:0/1471387087 shutdown_connections 2024-04-26T20:25:14.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.995+0000 7f360a5cf640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35ec0a3bb0 0x7f35ec0a6070 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.995+0000 7f360a5cf640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3604103400 0x7f36041a0190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.995+0000 7f360a5cf640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3604102a40 0x7f3604199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.995+0000 7f360a5cf640 1 --2- 172.21.15.70:0/1471387087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3604101850 0x7f3604198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.995+0000 7f360a5cf640 1 -- 172.21.15.70:0/1471387087 >> 172.21.15.70:0/1471387087 conn(0x7f36040fcda0 msgr2=0x7f3604105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.996+0000 7f360a5cf640 1 -- 172.21.15.70:0/1471387087 shutdown_connections 2024-04-26T20:25:14.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:14.996+0000 7f360a5cf640 1 -- 172.21.15.70:0/1471387087 wait complete. 2024-04-26T20:25:15.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T20:25:15.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.118+0000 7f1b7016a640 1 -- 172.21.15.70:0/1701031054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b68108650 msgr2=0x7f1b6810aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:15.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.118+0000 7f1b7016a640 1 --2- 172.21.15.70:0/1701031054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b68108650 0x7f1b6810aaa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009ca0 tx=0x7f1b6002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:15.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.118+0000 7f1b7016a640 1 -- 172.21.15.70:0/1701031054 shutdown_connections 2024-04-26T20:25:15.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.118+0000 7f1b7016a640 1 --2- 172.21.15.70:0/1701031054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b68108650 0x7f1b6810aaa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:15.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.118+0000 7f1b7016a640 1 --2- 172.21.15.70:0/1701031054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b68105d20 0x7f1b68108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:15.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.118+0000 7f1b7016a640 1 --2- 172.21.15.70:0/1701031054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b681033f0 0x7f1b681057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:15.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.118+0000 7f1b7016a640 1 -- 172.21.15.70:0/1701031054 >> 172.21.15.70:0/1701031054 conn(0x7f1b680fce00 msgr2=0x7f1b680ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:15.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.118+0000 7f1b7016a640 1 -- 172.21.15.70:0/1701031054 shutdown_connections 2024-04-26T20:25:15.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.118+0000 7f1b7016a640 1 -- 172.21.15.70:0/1701031054 wait complete. 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.118+0000 7f1b7016a640 1 Processor -- start 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.118+0000 7f1b7016a640 1 -- start start 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b7016a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b681033f0 0x7f1b68102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b7016a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b68105d20 0x7f1b681013a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b7016a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b68108650 0x7f1b681018e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b7016a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6810e5f0 con 0x7f1b68108650 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b7016a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6810e470 con 0x7f1b68105d20 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b7016a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6810e770 con 0x7f1b681033f0 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6e707640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b68108650 0x7f1b681018e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6d705640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b68105d20 0x7f1b681013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6e707640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b68108650 0x7f1b681018e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48586/0 (socket says 172.21.15.70:48586) 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6e707640 1 -- 172.21.15.70:0/1462331742 learned_addr learned my addr 172.21.15.70:0/1462331742 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6df06640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b681033f0 0x7f1b68102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6e707640 1 -- 172.21.15.70:0/1462331742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b681033f0 msgr2=0x7f1b68102d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6e707640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b681033f0 0x7f1b68102d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6e707640 1 -- 172.21.15.70:0/1462331742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b68105d20 msgr2=0x7f1b681013a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6e707640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b68105d20 0x7f1b681013a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6e707640 1 -- 172.21.15.70:0/1462331742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b68102170 con 0x7f1b68108650 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6d705640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b68105d20 0x7f1b681013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b6e707640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b68108650 0x7f1b681018e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009dc0 tx=0x7f1b60003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b5effd640 1 -- 172.21.15.70:0/1462331742 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b60004240 con 0x7f1b68108650 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b5effd640 1 -- 172.21.15.70:0/1462331742 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1b60003e40 con 0x7f1b68108650 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b7016a640 1 -- 172.21.15.70:0/1462331742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b681a2ce0 con 0x7f1b68108650 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b5effd640 1 -- 172.21.15.70:0/1462331742 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6002fe60 con 0x7f1b68108650 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.119+0000 7f1b7016a640 1 -- 172.21.15.70:0/1462331742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b681a3180 con 0x7f1b68108650 2024-04-26T20:25:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.120+0000 7f1b7016a640 1 -- 172.21.15.70:0/1462331742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b680fe8f0 con 0x7f1b68108650 2024-04-26T20:25:15.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.121+0000 7f1b5effd640 1 -- 172.21.15.70:0/1462331742 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f1b6002f660 con 0x7f1b68108650 2024-04-26T20:25:15.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.122+0000 7f1b5effd640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b540a3bb0 0x7f1b540a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:15.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.122+0000 7f1b5effd640 1 -- 172.21.15.70:0/1462331742 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7879+0+0 (secure 0 0 0) 0x7f1b600f1bb0 con 0x7f1b68108650 2024-04-26T20:25:15.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.122+0000 7f1b6df06640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b540a3bb0 0x7f1b540a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:15.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.122+0000 7f1b6df06640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b540a3bb0 0x7f1b540a6070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b580058c0 tx=0x7f1b5800a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:15.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.126+0000 7f1b5effd640 1 -- 172.21.15.70:0/1462331742 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1b600be7d0 con 0x7f1b68108650 2024-04-26T20:25:15.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:14 smithi098 ceph-mon[32591]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:15.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:14 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1705070843' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T20:25:15.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:14 smithi098 ceph-mon[32591]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T20:25:15.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:14 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1471387087' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T20:25:15.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:14 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:14 smithi080 ceph-mon[32278]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:15.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:14 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1705070843' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T20:25:15.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:14 smithi080 ceph-mon[32278]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T20:25:15.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:14 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1471387087' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T20:25:15.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:14 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:14 smithi070 ceph-mon[29124]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:15.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:14 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1705070843' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T20:25:15.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:14 smithi070 ceph-mon[29124]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T20:25:15.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:14 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1471387087' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T20:25:15.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:14 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:15.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.344+0000 7f1b7016a640 1 -- 172.21.15.70:0/1462331742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1b6802dad0 con 0x7f1b68108650 2024-04-26T20:25:15.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.997+0000 7f1b5effd640 1 -- 172.21.15.70:0/1462331742 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f1b600be0d0 con 0x7f1b68108650 2024-04-26T20:25:15.998 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T20:25:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 -- 172.21.15.70:0/1462331742 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b540a3bb0 msgr2=0x7f1b540a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b540a3bb0 0x7f1b540a6070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b580058c0 tx=0x7f1b5800a250 comp rx=0 tx=0).stop 2024-04-26T20:25:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 -- 172.21.15.70:0/1462331742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b68108650 msgr2=0x7f1b681018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b68108650 0x7f1b681018e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009dc0 tx=0x7f1b60003c20 comp rx=0 tx=0).stop 2024-04-26T20:25:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 -- 172.21.15.70:0/1462331742 shutdown_connections 2024-04-26T20:25:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b540a3bb0 0x7f1b540a6070 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b68108650 0x7f1b681018e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b68105d20 0x7f1b681013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 --2- 172.21.15.70:0/1462331742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b681033f0 0x7f1b68102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 -- 172.21.15.70:0/1462331742 >> 172.21.15.70:0/1462331742 conn(0x7f1b680fce00 msgr2=0x7f1b68103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 -- 172.21.15.70:0/1462331742 shutdown_connections 2024-04-26T20:25:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:15.999+0000 7f1b7016a640 1 -- 172.21.15.70:0/1462331742 wait complete. 2024-04-26T20:25:16.012 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:16.012 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:16.012 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:16.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:16.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:16.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:15 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1471387087' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T20:25:16.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:15 smithi070 ceph-mon[29124]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T20:25:16.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:15 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1462331742' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T20:25:16.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:15 smithi070 ceph-mon[29124]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T20:25:16.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:25:16.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.112+0000 7f13eea64640 1 -- 172.21.15.70:0/3744075526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e8104540 msgr2=0x7f13e810add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.112+0000 7f13eea64640 1 --2- 172.21.15.70:0/3744075526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e8104540 0x7f13e810add0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009900 tx=0x7f13e002a410 comp rx=0 tx=0).stop 2024-04-26T20:25:16.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.112+0000 7f13eea64640 1 -- 172.21.15.70:0/3744075526 shutdown_connections 2024-04-26T20:25:16.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.112+0000 7f13eea64640 1 --2- 172.21.15.70:0/3744075526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e8104540 0x7f13e810add0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.112+0000 7f13eea64640 1 --2- 172.21.15.70:0/3744075526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13e8103b80 0x7f13e8104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.112+0000 7f13eea64640 1 --2- 172.21.15.70:0/3744075526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13e8102990 0x7f13e8102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.112+0000 7f13eea64640 1 -- 172.21.15.70:0/3744075526 >> 172.21.15.70:0/3744075526 conn(0x7f13e80fdf20 msgr2=0x7f13e8100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.112+0000 7f13eea64640 1 -- 172.21.15.70:0/3744075526 shutdown_connections 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.112+0000 7f13eea64640 1 -- 172.21.15.70:0/3744075526 wait complete. 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.112+0000 7f13eea64640 1 Processor -- start 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.112+0000 7f13eea64640 1 -- start start 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13eea64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e8102990 0x7f13e80766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13eea64640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13e8103b80 0x7f13e8074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13eea64640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13e8104540 0x7f13e8075260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13eea64640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13e810e5f0 con 0x7f13e8102990 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13eea64640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f13e810e470 con 0x7f13e8103b80 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13eea64640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f13e810e770 con 0x7f13e8104540 2024-04-26T20:25:16.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13ec800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e8102990 0x7f13e80766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13ec800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e8102990 0x7f13e80766e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48612/0 (socket says 172.21.15.70:48612) 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13ec800640 1 -- 172.21.15.70:0/110021268 learned_addr learned my addr 172.21.15.70:0/110021268 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13dffff640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13e8103b80 0x7f13e8074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13ec800640 1 -- 172.21.15.70:0/110021268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13e8104540 msgr2=0x7f13e8075260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13ec800640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13e8104540 0x7f13e8075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13ec800640 1 -- 172.21.15.70:0/110021268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13e8103b80 msgr2=0x7f13e8074d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13ec800640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13e8103b80 0x7f13e8074d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13ec800640 1 -- 172.21.15.70:0/110021268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e8075af0 con 0x7f13e8102990 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13dffff640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13e8103b80 0x7f13e8074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13ec800640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e8102990 0x7f13e80766e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f13d800ebc0 tx=0x7f13d800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13e67fc640 1 -- 172.21.15.70:0/110021268 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8003b70 con 0x7f13e8102990 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13e67fc640 1 -- 172.21.15.70:0/110021268 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f13d8003d10 con 0x7f13e8102990 2024-04-26T20:25:16.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13eea64640 1 -- 172.21.15.70:0/110021268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e81a2dc0 con 0x7f13e8102990 2024-04-26T20:25:16.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13e67fc640 1 -- 172.21.15.70:0/110021268 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8019850 con 0x7f13e8102990 2024-04-26T20:25:16.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.113+0000 7f13eea64640 1 -- 172.21.15.70:0/110021268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e81a3220 con 0x7f13e8102990 2024-04-26T20:25:16.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.114+0000 7f13eea64640 1 -- 172.21.15.70:0/110021268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e8109c50 con 0x7f13e8102990 2024-04-26T20:25:16.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.115+0000 7f13e67fc640 1 -- 172.21.15.70:0/110021268 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f13d80199f0 con 0x7f13e8102990 2024-04-26T20:25:16.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.116+0000 7f13e67fc640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f13d40a3bb0 0x7f13d40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.116+0000 7f13dffff640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f13d40a3bb0 0x7f13d40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:16.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.116+0000 7f13e67fc640 1 -- 172.21.15.70:0/110021268 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f13d80d0c70 con 0x7f13e8102990 2024-04-26T20:25:16.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.117+0000 7f13dffff640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f13d40a3bb0 0x7f13d40a6070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f13e8076450 tx=0x7f13d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:16.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.121+0000 7f13e67fc640 1 -- 172.21.15.70:0/110021268 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f13d809d7a0 con 0x7f13e8102990 2024-04-26T20:25:16.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:16.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:16.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:16.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:16.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:16.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:15 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1471387087' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T20:25:16.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:15 smithi098 ceph-mon[32591]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T20:25:16.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:15 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1462331742' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T20:25:16.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:15 smithi098 ceph-mon[32591]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T20:25:16.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:16.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:25:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:15 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1471387087' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T20:25:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:15 smithi080 ceph-mon[32278]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T20:25:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:15 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1462331742' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T20:25:16.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:15 smithi080 ceph-mon[32278]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T20:25:16.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.299+0000 7f13eea64640 1 -- 172.21.15.70:0/110021268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13e8063670 con 0x7f13e8102990 2024-04-26T20:25:16.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.301+0000 7f13e67fc640 1 -- 172.21.15.70:0/110021268 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22161 (secure 0 0 0) 0x7f13d809d0a0 con 0x7f13e8102990 2024-04-26T20:25:16.302 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:16.302 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":85,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:25:15.345252+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:25:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 -- 172.21.15.70:0/110021268 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f13d40a3bb0 msgr2=0x7f13d40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f13d40a3bb0 0x7f13d40a6070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f13e8076450 tx=0x7f13d0005f90 comp rx=0 tx=0).stop 2024-04-26T20:25:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 -- 172.21.15.70:0/110021268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e8102990 msgr2=0x7f13e80766e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e8102990 0x7f13e80766e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f13d800ebc0 tx=0x7f13d800c6a0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 -- 172.21.15.70:0/110021268 shutdown_connections 2024-04-26T20:25:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f13d40a3bb0 0x7f13d40a6070 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13e8104540 0x7f13e8075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13e8103b80 0x7f13e8074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 --2- 172.21.15.70:0/110021268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e8102990 0x7f13e80766e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 -- 172.21.15.70:0/110021268 >> 172.21.15.70:0/110021268 conn(0x7f13e80fdf20 msgr2=0x7f13e8106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:16.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 -- 172.21.15.70:0/110021268 shutdown_connections 2024-04-26T20:25:16.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.303+0000 7f13eea64640 1 -- 172.21.15.70:0/110021268 wait complete. 2024-04-26T20:25:16.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:25:16.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.416+0000 7f2a28464640 1 -- 172.21.15.70:0/543596845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a20103470 msgr2=0x7f2a20105860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.416+0000 7f2a28464640 1 --2- 172.21.15.70:0/543596845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a20103470 0x7f2a20105860 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009ca0 tx=0x7f2a1002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.416+0000 7f2a28464640 1 -- 172.21.15.70:0/543596845 shutdown_connections 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.416+0000 7f2a28464640 1 --2- 172.21.15.70:0/543596845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a201086d0 0x7f2a2010aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.416+0000 7f2a28464640 1 --2- 172.21.15.70:0/543596845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a20105da0 0x7f2a20108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.416+0000 7f2a28464640 1 --2- 172.21.15.70:0/543596845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a20103470 0x7f2a20105860 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.416+0000 7f2a28464640 1 -- 172.21.15.70:0/543596845 >> 172.21.15.70:0/543596845 conn(0x7f2a200fce00 msgr2=0x7f2a200ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.416+0000 7f2a28464640 1 -- 172.21.15.70:0/543596845 shutdown_connections 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.416+0000 7f2a28464640 1 -- 172.21.15.70:0/543596845 wait complete. 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.416+0000 7f2a28464640 1 Processor -- start 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a28464640 1 -- start start 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a28464640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a20103470 0x7f2a20198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a28464640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a20105da0 0x7f2a201991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a28464640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a201086d0 0x7f2a201a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a28464640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2010e610 con 0x7f2a20103470 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a28464640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2010e490 con 0x7f2a201086d0 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a28464640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2010e790 con 0x7f2a20105da0 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a26200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a20103470 0x7f2a20198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a26200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a20103470 0x7f2a20198c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48626/0 (socket says 172.21.15.70:48626) 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a26200640 1 -- 172.21.15.70:0/3649042640 learned_addr learned my addr 172.21.15.70:0/3649042640 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a259ff640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a20105da0 0x7f2a201991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a26200640 1 -- 172.21.15.70:0/3649042640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a20105da0 msgr2=0x7f2a201991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a26200640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a20105da0 0x7f2a201991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a26200640 1 -- 172.21.15.70:0/3649042640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a201086d0 msgr2=0x7f2a201a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a26a01640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a201086d0 0x7f2a201a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a26200640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a201086d0 0x7f2a201a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a26200640 1 -- 172.21.15.70:0/3649042640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a201a08c0 con 0x7f2a20103470 2024-04-26T20:25:16.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a26200640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a20103470 0x7f2a20198c80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a10006010 tx=0x7f2a1002f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:16.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a1f7fe640 1 -- 172.21.15.70:0/3649042640 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10003cf0 con 0x7f2a20103470 2024-04-26T20:25:16.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a1f7fe640 1 -- 172.21.15.70:0/3649042640 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2a10004510 con 0x7f2a20103470 2024-04-26T20:25:16.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a1f7fe640 1 -- 172.21.15.70:0/3649042640 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1002fd30 con 0x7f2a20103470 2024-04-26T20:25:16.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a28464640 1 -- 172.21.15.70:0/3649042640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a201a0b50 con 0x7f2a20103470 2024-04-26T20:25:16.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.417+0000 7f2a28464640 1 -- 172.21.15.70:0/3649042640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a201a10f0 con 0x7f2a20103470 2024-04-26T20:25:16.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.418+0000 7f2a28464640 1 -- 172.21.15.70:0/3649042640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a200fe8f0 con 0x7f2a20103470 2024-04-26T20:25:16.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.419+0000 7f2a1f7fe640 1 -- 172.21.15.70:0/3649042640 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f2a100046c0 con 0x7f2a20103470 2024-04-26T20:25:16.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.420+0000 7f2a1f7fe640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2a080a3c30 0x7f2a080a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.420+0000 7f2a259ff640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2a080a3c30 0x7f2a080a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:16.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.420+0000 7f2a1f7fe640 1 -- 172.21.15.70:0/3649042640 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f2a100f1950 con 0x7f2a20103470 2024-04-26T20:25:16.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.420+0000 7f2a259ff640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2a080a3c30 0x7f2a080a60f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2a14005fd0 tx=0x7f2a14005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:16.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.425+0000 7f2a1f7fe640 1 -- 172.21.15.70:0/3649042640 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2a100be480 con 0x7f2a20103470 2024-04-26T20:25:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.604+0000 7f2a28464640 1 -- 172.21.15.70:0/3649042640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a2002dcd0 con 0x7f2a20103470 2024-04-26T20:25:16.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.605+0000 7f2a1f7fe640 1 -- 172.21.15.70:0/3649042640 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22161 (secure 0 0 0) 0x7f2a100bdd80 con 0x7f2a20103470 2024-04-26T20:25:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:16.607 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":85,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:25:15.345252+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.607+0000 7f2a28464640 1 -- 172.21.15.70:0/3649042640 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2a080a3c30 msgr2=0x7f2a080a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.608+0000 7f2a28464640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2a080a3c30 0x7f2a080a60f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2a14005fd0 tx=0x7f2a14005850 comp rx=0 tx=0).stop 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.608+0000 7f2a28464640 1 -- 172.21.15.70:0/3649042640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a20103470 msgr2=0x7f2a20198c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.608+0000 7f2a28464640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a20103470 0x7f2a20198c80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a10006010 tx=0x7f2a1002f450 comp rx=0 tx=0).stop 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.608+0000 7f2a28464640 1 -- 172.21.15.70:0/3649042640 shutdown_connections 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.608+0000 7f2a28464640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2a080a3c30 0x7f2a080a60f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.608+0000 7f2a28464640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a201086d0 0x7f2a201a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.608+0000 7f2a28464640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a20105da0 0x7f2a201991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.608+0000 7f2a28464640 1 --2- 172.21.15.70:0/3649042640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a20103470 0x7f2a20198c80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.608+0000 7f2a28464640 1 -- 172.21.15.70:0/3649042640 >> 172.21.15.70:0/3649042640 conn(0x7f2a200fce00 msgr2=0x7f2a20103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.608+0000 7f2a28464640 1 -- 172.21.15.70:0/3649042640 shutdown_connections 2024-04-26T20:25:16.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.608+0000 7f2a28464640 1 -- 172.21.15.70:0/3649042640 wait complete. 2024-04-26T20:25:16.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T20:25:16.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.721+0000 7f4409f38640 1 -- 172.21.15.70:0/3359424575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44041086b0 msgr2=0x7f440410aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.721+0000 7f4409f38640 1 --2- 172.21.15.70:0/3359424575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44041086b0 0x7f440410aaa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009ca0 tx=0x7f43fc02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.721+0000 7f4409f38640 1 -- 172.21.15.70:0/3359424575 shutdown_connections 2024-04-26T20:25:16.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.721+0000 7f4409f38640 1 --2- 172.21.15.70:0/3359424575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44041086b0 0x7f440410aaa0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.721+0000 7f4409f38640 1 --2- 172.21.15.70:0/3359424575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4404105d80 0x7f4404108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.721+0000 7f4409f38640 1 --2- 172.21.15.70:0/3359424575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4404103450 0x7f4404105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.721+0000 7f4409f38640 1 -- 172.21.15.70:0/3359424575 >> 172.21.15.70:0/3359424575 conn(0x7f44040fce00 msgr2=0x7f44040ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:16.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.721+0000 7f4409f38640 1 -- 172.21.15.70:0/3359424575 shutdown_connections 2024-04-26T20:25:16.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.721+0000 7f4409f38640 1 -- 172.21.15.70:0/3359424575 wait complete. 2024-04-26T20:25:16.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.721+0000 7f4409f38640 1 Processor -- start 2024-04-26T20:25:16.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4409f38640 1 -- start start 2024-04-26T20:25:16.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4409f38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4404103450 0x7f4404198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4409f38640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4404105d80 0x7f4404199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4409f38640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44041086b0 0x7f44041a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4409f38640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f440410e5d0 con 0x7f4404103450 2024-04-26T20:25:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4409f38640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f440410e450 con 0x7f44041086b0 2024-04-26T20:25:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4409f38640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f440410e750 con 0x7f4404105d80 2024-04-26T20:25:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f44037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4404103450 0x7f4404198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f44037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4404103450 0x7f4404198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48652/0 (socket says 172.21.15.70:48652) 2024-04-26T20:25:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f44037fe640 1 -- 172.21.15.70:0/2396530777 learned_addr learned my addr 172.21.15.70:0/2396530777 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4403fff640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44041086b0 0x7f44041a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4402ffd640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4404105d80 0x7f4404199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f44037fe640 1 -- 172.21.15.70:0/2396530777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4404105d80 msgr2=0x7f4404199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f44037fe640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4404105d80 0x7f4404199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f44037fe640 1 -- 172.21.15.70:0/2396530777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44041086b0 msgr2=0x7f44041a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f44037fe640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44041086b0 0x7f44041a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f44037fe640 1 -- 172.21.15.70:0/2396530777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44041a0800 con 0x7f4404103450 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4402ffd640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4404105d80 0x7f4404199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4403fff640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44041086b0 0x7f44041a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f44037fe640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4404103450 0x7f4404198be0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f43f400c920 tx=0x7f43f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.722+0000 7f4400ff9640 1 -- 172.21.15.70:0/2396530777 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4007c70 con 0x7f4404103450 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.723+0000 7f4409f38640 1 -- 172.21.15.70:0/2396530777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44041a0af0 con 0x7f4404103450 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.723+0000 7f4400ff9640 1 -- 172.21.15.70:0/2396530777 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f43f4007e10 con 0x7f4404103450 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.723+0000 7f4400ff9640 1 -- 172.21.15.70:0/2396530777 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f40188c0 con 0x7f4404103450 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.723+0000 7f4409f38640 1 -- 172.21.15.70:0/2396530777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44041a1090 con 0x7f4404103450 2024-04-26T20:25:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.724+0000 7f4409f38640 1 -- 172.21.15.70:0/2396530777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44040fe8f0 con 0x7f4404103450 2024-04-26T20:25:16.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.724+0000 7f4400ff9640 1 -- 172.21.15.70:0/2396530777 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f43f4018a60 con 0x7f4404103450 2024-04-26T20:25:16.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.725+0000 7f4400ff9640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f43ec0a3bb0 0x7f43ec0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:16.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.725+0000 7f4402ffd640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f43ec0a3bb0 0x7f43ec0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:16.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.725+0000 7f4400ff9640 1 -- 172.21.15.70:0/2396530777 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f43f40d04a0 con 0x7f4404103450 2024-04-26T20:25:16.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.725+0000 7f4402ffd640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f43ec0a3bb0 0x7f43ec0a6070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f440419a0f0 tx=0x7f43f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:16.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.730+0000 7f4400ff9640 1 -- 172.21.15.70:0/2396530777 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f43f4014030 con 0x7f4404103450 2024-04-26T20:25:16.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.948+0000 7f4409f38640 1 -- 172.21.15.70:0/2396530777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f440402dcc0 con 0x7f4404103450 2024-04-26T20:25:16.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:16.998+0000 7f4400ff9640 1 -- 172.21.15.70:0/2396530777 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f43f400de20 con 0x7f4404103450 2024-04-26T20:25:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 -- 172.21.15.70:0/2396530777 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f43ec0a3bb0 msgr2=0x7f43ec0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f43ec0a3bb0 0x7f43ec0a6070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f440419a0f0 tx=0x7f43f8005f90 comp rx=0 tx=0).stop 2024-04-26T20:25:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 -- 172.21.15.70:0/2396530777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4404103450 msgr2=0x7f4404198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4404103450 0x7f4404198be0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f43f400c920 tx=0x7f43f400cde0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 -- 172.21.15.70:0/2396530777 shutdown_connections 2024-04-26T20:25:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f43ec0a3bb0 0x7f43ec0a6070 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44041086b0 0x7f44041a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4404105d80 0x7f4404199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 --2- 172.21.15.70:0/2396530777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4404103450 0x7f4404198be0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 -- 172.21.15.70:0/2396530777 >> 172.21.15.70:0/2396530777 conn(0x7f44040fce00 msgr2=0x7f4404103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 -- 172.21.15.70:0/2396530777 shutdown_connections 2024-04-26T20:25:17.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.001+0000 7f4409f38640 1 -- 172.21.15.70:0/2396530777 wait complete. 2024-04-26T20:25:17.013 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-04-26T20:25:17.013 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-26T20:25:17.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.114+0000 7f2ca3af1640 1 -- 172.21.15.70:0/1499732039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c9c103420 msgr2=0x7f2c9c109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:17.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.114+0000 7f2ca3af1640 1 --2- 172.21.15.70:0/1499732039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c9c103420 0x7f2c9c109cb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009ca0 tx=0x7f2c9402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.114+0000 7f2ca3af1640 1 -- 172.21.15.70:0/1499732039 shutdown_connections 2024-04-26T20:25:17.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.114+0000 7f2ca3af1640 1 --2- 172.21.15.70:0/1499732039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c9c103420 0x7f2c9c109cb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.114+0000 7f2ca3af1640 1 --2- 172.21.15.70:0/1499732039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c9c102a60 0x7f2c9c102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.114+0000 7f2ca3af1640 1 --2- 172.21.15.70:0/1499732039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c9c101870 0x7f2c9c101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.114+0000 7f2ca3af1640 1 -- 172.21.15.70:0/1499732039 >> 172.21.15.70:0/1499732039 conn(0x7f2c9c0fcdc0 msgr2=0x7f2c9c0ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:17.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.114+0000 7f2ca3af1640 1 -- 172.21.15.70:0/1499732039 shutdown_connections 2024-04-26T20:25:17.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.114+0000 7f2ca3af1640 1 -- 172.21.15.70:0/1499732039 wait complete. 2024-04-26T20:25:17.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.114+0000 7f2ca3af1640 1 Processor -- start 2024-04-26T20:25:17.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca3af1640 1 -- start start 2024-04-26T20:25:17.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca3af1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c9c101870 0x7f2c9c06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:17.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca3af1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c9c102a60 0x7f2c9c19d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:17.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca3af1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c9c103420 0x7f2c9c1a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:17.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca3af1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c10d530 con 0x7f2c9c103420 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca3af1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c10d3b0 con 0x7f2c9c101870 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca3af1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c10d6b0 con 0x7f2c9c102a60 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca208e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c9c103420 0x7f2c9c1a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca208e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c9c103420 0x7f2c9c1a0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48672/0 (socket says 172.21.15.70:48672) 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca208e640 1 -- 172.21.15.70:0/527361603 learned_addr learned my addr 172.21.15.70:0/527361603 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca108c640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c9c102a60 0x7f2c9c19d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca188d640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c9c101870 0x7f2c9c06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca208e640 1 -- 172.21.15.70:0/527361603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c9c102a60 msgr2=0x7f2c9c19d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca208e640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c9c102a60 0x7f2c9c19d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca208e640 1 -- 172.21.15.70:0/527361603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c9c101870 msgr2=0x7f2c9c06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca208e640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c9c101870 0x7f2c9c06bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca208e640 1 -- 172.21.15.70:0/527361603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c1a0920 con 0x7f2c9c103420 2024-04-26T20:25:17.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca108c640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c9c102a60 0x7f2c9c19d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:17.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca208e640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c9c103420 0x7f2c9c1a0010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009dc0 tx=0x7f2c94003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:17.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2c92ffd640 1 -- 172.21.15.70:0/527361603 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94004240 con 0x7f2c9c103420 2024-04-26T20:25:17.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2c92ffd640 1 -- 172.21.15.70:0/527361603 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c94031830 con 0x7f2c9c103420 2024-04-26T20:25:17.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca3af1640 1 -- 172.21.15.70:0/527361603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9c1a0b50 con 0x7f2c9c103420 2024-04-26T20:25:17.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2c92ffd640 1 -- 172.21.15.70:0/527361603 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c940305c0 con 0x7f2c9c103420 2024-04-26T20:25:17.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.115+0000 7f2ca3af1640 1 -- 172.21.15.70:0/527361603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9c1a1120 con 0x7f2c9c103420 2024-04-26T20:25:17.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.116+0000 7f2ca3af1640 1 -- 172.21.15.70:0/527361603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9c108b90 con 0x7f2c9c103420 2024-04-26T20:25:17.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.117+0000 7f2c92ffd640 1 -- 172.21.15.70:0/527361603 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f2c9402f660 con 0x7f2c9c103420 2024-04-26T20:25:17.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.118+0000 7f2c92ffd640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c880a3bb0 0x7f2c880a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:17.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.118+0000 7f2ca188d640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c880a3bb0 0x7f2c880a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:17.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.118+0000 7f2c92ffd640 1 -- 172.21.15.70:0/527361603 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f2c940f1d50 con 0x7f2c9c103420 2024-04-26T20:25:17.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.119+0000 7f2ca188d640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c880a3bb0 0x7f2c880a6070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c1028c0 tx=0x7f2c98005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:17.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.122+0000 7f2c92ffd640 1 -- 172.21.15.70:0/527361603 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2c940be860 con 0x7f2c9c103420 2024-04-26T20:25:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:16 smithi098 ceph-mon[32591]: pgmap v288: 97 pgs: 4 creating+peering, 7 active+clean, 86 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:16 smithi098 ceph-mon[32591]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T20:25:17.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:16 smithi098 ceph-mon[32591]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T20:25:17.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:16 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1462331742' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T20:25:17.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:16 smithi098 ceph-mon[32591]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T20:25:17.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:16 smithi098 ceph-mon[32591]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T20:25:17.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:16 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/110021268' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:17.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:16 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3649042640' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:16 smithi080 ceph-mon[32278]: pgmap v288: 97 pgs: 4 creating+peering, 7 active+clean, 86 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:16 smithi080 ceph-mon[32278]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T20:25:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:16 smithi080 ceph-mon[32278]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T20:25:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:16 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1462331742' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T20:25:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:16 smithi080 ceph-mon[32278]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T20:25:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:16 smithi080 ceph-mon[32278]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T20:25:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:16 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/110021268' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:16 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3649042640' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:17.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:16 smithi070 ceph-mon[29124]: pgmap v288: 97 pgs: 4 creating+peering, 7 active+clean, 86 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:25:17.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:16 smithi070 ceph-mon[29124]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T20:25:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:16 smithi070 ceph-mon[29124]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T20:25:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:16 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1462331742' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T20:25:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:16 smithi070 ceph-mon[29124]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T20:25:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:16 smithi070 ceph-mon[29124]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T20:25:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:16 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/110021268' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:16 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3649042640' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:17.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.339+0000 7f2ca3af1640 1 -- 172.21.15.70:0/527361603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f2c9c02dd20 con 0x7f2c9c103420 2024-04-26T20:25:17.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.985+0000 7f2c92ffd640 1 -- 172.21.15.70:0/527361603 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v16) ==== 105+0+0 (secure 0 0 0) 0x7f2c940be160 con 0x7f2c9c103420 2024-04-26T20:25:17.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.987+0000 7f2ca3af1640 1 -- 172.21.15.70:0/527361603 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c880a3bb0 msgr2=0x7f2c880a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:17.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.987+0000 7f2ca3af1640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c880a3bb0 0x7f2c880a6070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c1028c0 tx=0x7f2c98005c60 comp rx=0 tx=0).stop 2024-04-26T20:25:17.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.987+0000 7f2ca3af1640 1 -- 172.21.15.70:0/527361603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c9c103420 msgr2=0x7f2c9c1a0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:17.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.987+0000 7f2ca3af1640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c9c103420 0x7f2c9c1a0010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009dc0 tx=0x7f2c94003c20 comp rx=0 tx=0).stop 2024-04-26T20:25:17.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.988+0000 7f2ca3af1640 1 -- 172.21.15.70:0/527361603 shutdown_connections 2024-04-26T20:25:17.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.988+0000 7f2ca3af1640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c880a3bb0 0x7f2c880a6070 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.988+0000 7f2ca3af1640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c9c103420 0x7f2c9c1a0010 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.988+0000 7f2ca3af1640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c9c102a60 0x7f2c9c19d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.988+0000 7f2ca3af1640 1 --2- 172.21.15.70:0/527361603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c9c101870 0x7f2c9c06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:17.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.988+0000 7f2ca3af1640 1 -- 172.21.15.70:0/527361603 >> 172.21.15.70:0/527361603 conn(0x7f2c9c0fcdc0 msgr2=0x7f2c9c105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:17.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.988+0000 7f2ca3af1640 1 -- 172.21.15.70:0/527361603 shutdown_connections 2024-04-26T20:25:17.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:17.988+0000 7f2ca3af1640 1 -- 172.21.15.70:0/527361603 wait complete. 2024-04-26T20:25:18.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-26T20:25:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.110+0000 7f114a35f640 1 -- 172.21.15.70:0/3207389475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1144103b80 msgr2=0x7f1144104000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.110+0000 7f114a35f640 1 --2- 172.21.15.70:0/3207389475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1144103b80 0x7f1144104000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1134009900 tx=0x7f113402a410 comp rx=0 tx=0).stop 2024-04-26T20:25:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.110+0000 7f114a35f640 1 -- 172.21.15.70:0/3207389475 shutdown_connections 2024-04-26T20:25:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.110+0000 7f114a35f640 1 --2- 172.21.15.70:0/3207389475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1144104540 0x7f114410add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.110+0000 7f114a35f640 1 --2- 172.21.15.70:0/3207389475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1144103b80 0x7f1144104000 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.110+0000 7f114a35f640 1 --2- 172.21.15.70:0/3207389475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1144102990 0x7f1144102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.110+0000 7f114a35f640 1 -- 172.21.15.70:0/3207389475 >> 172.21.15.70:0/3207389475 conn(0x7f11440fdf00 msgr2=0x7f1144100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.110+0000 7f114a35f640 1 -- 172.21.15.70:0/3207389475 shutdown_connections 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.110+0000 7f114a35f640 1 -- 172.21.15.70:0/3207389475 wait complete. 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.110+0000 7f114a35f640 1 Processor -- start 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.110+0000 7f114a35f640 1 -- start start 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f114a35f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1144102990 0x7f11440766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f114a35f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1144103b80 0x7f1144074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f114a35f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1144104540 0x7f1144075260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f114a35f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f114410e670 con 0x7f1144102990 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f114a35f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f114410e4f0 con 0x7f1144104540 2024-04-26T20:25:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f114a35f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f114410e7f0 con 0x7f1144103b80 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f1143fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1144102990 0x7f11440766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f1143fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1144102990 0x7f11440766e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48688/0 (socket says 172.21.15.70:48688) 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f1143fff640 1 -- 172.21.15.70:0/2375718749 learned_addr learned my addr 172.21.15.70:0/2375718749 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f11437fe640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1144103b80 0x7f1144074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f11488fc640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1144104540 0x7f1144075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f1143fff640 1 -- 172.21.15.70:0/2375718749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1144103b80 msgr2=0x7f1144074d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f1143fff640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1144103b80 0x7f1144074d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f1143fff640 1 -- 172.21.15.70:0/2375718749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1144104540 msgr2=0x7f1144075260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f1143fff640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1144104540 0x7f1144075260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f1143fff640 1 -- 172.21.15.70:0/2375718749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1144075af0 con 0x7f1144102990 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f1143fff640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1144102990 0x7f11440766e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f112c00b450 tx=0x7f112c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:18.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f11417fa640 1 -- 172.21.15.70:0/2375718749 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c015020 con 0x7f1144102990 2024-04-26T20:25:18.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f114a35f640 1 -- 172.21.15.70:0/2375718749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11441a2e90 con 0x7f1144102990 2024-04-26T20:25:18.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f11417fa640 1 -- 172.21.15.70:0/2375718749 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f112c011d60 con 0x7f1144102990 2024-04-26T20:25:18.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f11417fa640 1 -- 172.21.15.70:0/2375718749 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c00f340 con 0x7f1144102990 2024-04-26T20:25:18.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.111+0000 7f114a35f640 1 -- 172.21.15.70:0/2375718749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11441a32c0 con 0x7f1144102990 2024-04-26T20:25:18.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.112+0000 7f114a35f640 1 -- 172.21.15.70:0/2375718749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1144109d80 con 0x7f1144102990 2024-04-26T20:25:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.113+0000 7f11417fa640 1 -- 172.21.15.70:0/2375718749 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f112c018020 con 0x7f1144102990 2024-04-26T20:25:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.114+0000 7f11417fa640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11300a3bb0 0x7f11300a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.114+0000 7f11437fe640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11300a3bb0 0x7f11300a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.114+0000 7f11417fa640 1 -- 172.21.15.70:0/2375718749 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f112c0cfca0 con 0x7f1144102990 2024-04-26T20:25:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.114+0000 7f11437fe640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11300a3bb0 0x7f11300a6070 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1134000c00 tx=0x7f1134031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.119+0000 7f11417fa640 1 -- 172.21.15.70:0/2375718749 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f112c01f020 con 0x7f1144102990 2024-04-26T20:25:18.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:17 smithi098 ceph-mon[32591]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T20:25:18.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:17 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2396530777' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T20:25:18.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:17 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2396530777' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T20:25:18.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:17 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] up:active 2024-04-26T20:25:18.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:17 smithi098 ceph-mon[32591]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:25:18.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:17 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/527361603' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-26T20:25:18.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:17 smithi080 ceph-mon[32278]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T20:25:18.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:17 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2396530777' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T20:25:18.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:17 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2396530777' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T20:25:18.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:17 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] up:active 2024-04-26T20:25:18.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:17 smithi080 ceph-mon[32278]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:25:18.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:17 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/527361603' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-26T20:25:18.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:17 smithi070 ceph-mon[29124]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T20:25:18.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:17 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2396530777' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T20:25:18.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:17 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2396530777' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T20:25:18.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:17 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] up:active 2024-04-26T20:25:18.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:17 smithi070 ceph-mon[29124]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:25:18.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:17 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/527361603' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-26T20:25:18.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:18.336+0000 7f114a35f640 1 -- 172.21.15.70:0/2375718749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f114402dad0 con 0x7f1144102990 2024-04-26T20:25:19.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.001+0000 7f11417fa640 1 -- 172.21.15.70:0/2375718749 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f112c00d040 con 0x7f1144102990 2024-04-26T20:25:19.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 -- 172.21.15.70:0/2375718749 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11300a3bb0 msgr2=0x7f11300a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:19.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11300a3bb0 0x7f11300a6070 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1134000c00 tx=0x7f1134031510 comp rx=0 tx=0).stop 2024-04-26T20:25:19.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 -- 172.21.15.70:0/2375718749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1144102990 msgr2=0x7f11440766e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:19.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1144102990 0x7f11440766e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f112c00b450 tx=0x7f112c00b910 comp rx=0 tx=0).stop 2024-04-26T20:25:19.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 -- 172.21.15.70:0/2375718749 shutdown_connections 2024-04-26T20:25:19.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11300a3bb0 0x7f11300a6070 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:19.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1144104540 0x7f1144075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:19.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1144103b80 0x7f1144074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:19.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 --2- 172.21.15.70:0/2375718749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1144102990 0x7f11440766e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:19.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 -- 172.21.15.70:0/2375718749 >> 172.21.15.70:0/2375718749 conn(0x7f11440fdf00 msgr2=0x7f1144106f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:19.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 -- 172.21.15.70:0/2375718749 shutdown_connections 2024-04-26T20:25:19.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.004+0000 7f114a35f640 1 -- 172.21.15.70:0/2375718749 wait complete. 2024-04-26T20:25:19.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-26T20:25:19.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.127+0000 7f3e6b02c640 1 -- 172.21.15.70:0/466419757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64101870 msgr2=0x7f3e64101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:19.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.127+0000 7f3e6b02c640 1 --2- 172.21.15.70:0/466419757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64101870 0x7f3e64101c90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009900 tx=0x7f3e5802a410 comp rx=0 tx=0).stop 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.127+0000 7f3e6b02c640 1 -- 172.21.15.70:0/466419757 shutdown_connections 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.127+0000 7f3e6b02c640 1 --2- 172.21.15.70:0/466419757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e64103420 0x7f3e64109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.127+0000 7f3e6b02c640 1 --2- 172.21.15.70:0/466419757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e64102a60 0x7f3e64102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.127+0000 7f3e6b02c640 1 --2- 172.21.15.70:0/466419757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64101870 0x7f3e64101c90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.127+0000 7f3e6b02c640 1 -- 172.21.15.70:0/466419757 >> 172.21.15.70:0/466419757 conn(0x7f3e640fcdc0 msgr2=0x7f3e640ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.127+0000 7f3e6b02c640 1 -- 172.21.15.70:0/466419757 shutdown_connections 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.127+0000 7f3e6b02c640 1 -- 172.21.15.70:0/466419757 wait complete. 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e6b02c640 1 Processor -- start 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e6b02c640 1 -- start start 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e6b02c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e64101870 0x7f3e6406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e6b02c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e64102a60 0x7f3e6419da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e6b02c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64103420 0x7f3e641a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e6b02c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6410d530 con 0x7f3e64103420 2024-04-26T20:25:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e6b02c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6410d3b0 con 0x7f3e64101870 2024-04-26T20:25:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e6b02c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6410d6b0 con 0x7f3e64102a60 2024-04-26T20:25:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e695c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64103420 0x7f3e641a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e68dc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e64101870 0x7f3e6406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e695c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64103420 0x7f3e641a0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48710/0 (socket says 172.21.15.70:48710) 2024-04-26T20:25:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e695c9640 1 -- 172.21.15.70:0/2598585968 learned_addr learned my addr 172.21.15.70:0/2598585968 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e63fff640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e64102a60 0x7f3e6419da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e695c9640 1 -- 172.21.15.70:0/2598585968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e64102a60 msgr2=0x7f3e6419da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e695c9640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e64102a60 0x7f3e6419da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e695c9640 1 -- 172.21.15.70:0/2598585968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e64101870 msgr2=0x7f3e6406bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e695c9640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e64101870 0x7f3e6406bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e695c9640 1 -- 172.21.15.70:0/2598585968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e641a0960 con 0x7f3e64103420 2024-04-26T20:25:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e63fff640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e64102a60 0x7f3e6419da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e695c9640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64103420 0x7f3e641a0050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00b970 tx=0x7f3e5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.128+0000 7f3e61ffb640 1 -- 172.21.15.70:0/2598585968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c019070 con 0x7f3e64103420 2024-04-26T20:25:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.129+0000 7f3e61ffb640 1 -- 172.21.15.70:0/2598585968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3e5c00cb40 con 0x7f3e64103420 2024-04-26T20:25:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.129+0000 7f3e6b02c640 1 -- 172.21.15.70:0/2598585968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e641a0bf0 con 0x7f3e64103420 2024-04-26T20:25:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.129+0000 7f3e61ffb640 1 -- 172.21.15.70:0/2598585968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c007650 con 0x7f3e64103420 2024-04-26T20:25:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.129+0000 7f3e6b02c640 1 -- 172.21.15.70:0/2598585968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e641a11c0 con 0x7f3e64103420 2024-04-26T20:25:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.130+0000 7f3e6b02c640 1 -- 172.21.15.70:0/2598585968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e64108b90 con 0x7f3e64103420 2024-04-26T20:25:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.131+0000 7f3e61ffb640 1 -- 172.21.15.70:0/2598585968 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f3e5c01c070 con 0x7f3e64103420 2024-04-26T20:25:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.131+0000 7f3e61ffb640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3e540a3bb0 0x7f3e540a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.131+0000 7f3e68dc8640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3e540a3bb0 0x7f3e540a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.131+0000 7f3e61ffb640 1 -- 172.21.15.70:0/2598585968 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f3e5c0cf800 con 0x7f3e64103420 2024-04-26T20:25:19.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.132+0000 7f3e68dc8640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3e540a3bb0 0x7f3e540a6070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009230 tx=0x7f3e58031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:19.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.136+0000 7f3e61ffb640 1 -- 172.21.15.70:0/2598585968 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f3e5c09bce0 con 0x7f3e64103420 2024-04-26T20:25:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:18 smithi098 ceph-mon[32591]: pgmap v291: 97 pgs: 6 creating+peering, 34 active+clean, 57 unknown; 578 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 2 op/s 2024-04-26T20:25:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:18 smithi098 ceph-mon[32591]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T20:25:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:18 smithi098 ceph-mon[32591]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T20:25:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:18 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/527361603' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-26T20:25:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:18 smithi098 ceph-mon[32591]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-26T20:25:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:18 smithi098 ceph-mon[32591]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T20:25:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:18 smithi098 ceph-mon[32591]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T20:25:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:18 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2375718749' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T20:25:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:18 smithi080 ceph-mon[32278]: pgmap v291: 97 pgs: 6 creating+peering, 34 active+clean, 57 unknown; 578 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 2 op/s 2024-04-26T20:25:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:18 smithi080 ceph-mon[32278]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T20:25:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:18 smithi080 ceph-mon[32278]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T20:25:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:18 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/527361603' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-26T20:25:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:18 smithi080 ceph-mon[32278]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-26T20:25:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:18 smithi080 ceph-mon[32278]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T20:25:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:18 smithi080 ceph-mon[32278]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T20:25:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:18 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2375718749' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T20:25:19.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:18 smithi070 ceph-mon[29124]: pgmap v291: 97 pgs: 6 creating+peering, 34 active+clean, 57 unknown; 578 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 2 op/s 2024-04-26T20:25:19.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:18 smithi070 ceph-mon[29124]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T20:25:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:18 smithi070 ceph-mon[29124]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T20:25:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:18 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/527361603' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-26T20:25:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:18 smithi070 ceph-mon[29124]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-26T20:25:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:18 smithi070 ceph-mon[29124]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T20:25:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:18 smithi070 ceph-mon[29124]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T20:25:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:18 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2375718749' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T20:25:19.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:19.356+0000 7f3e6b02c640 1 -- 172.21.15.70:0/2598585968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f3e6402dd20 con 0x7f3e64103420 2024-04-26T20:25:20.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.010+0000 7f3e61ffb640 1 -- 172.21.15.70:0/2598585968 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7f3e5c09ffe0 con 0x7f3e64103420 2024-04-26T20:25:20.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.012+0000 7f3e6b02c640 1 -- 172.21.15.70:0/2598585968 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3e540a3bb0 msgr2=0x7f3e540a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:20.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.012+0000 7f3e6b02c640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3e540a3bb0 0x7f3e540a6070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009230 tx=0x7f3e58031510 comp rx=0 tx=0).stop 2024-04-26T20:25:20.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.012+0000 7f3e6b02c640 1 -- 172.21.15.70:0/2598585968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64103420 msgr2=0x7f3e641a0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.012+0000 7f3e6b02c640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64103420 0x7f3e641a0050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00b970 tx=0x7f3e5c00be30 comp rx=0 tx=0).stop 2024-04-26T20:25:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.012+0000 7f3e6b02c640 1 -- 172.21.15.70:0/2598585968 shutdown_connections 2024-04-26T20:25:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.012+0000 7f3e6b02c640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3e540a3bb0 0x7f3e540a6070 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.012+0000 7f3e6b02c640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64103420 0x7f3e641a0050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.012+0000 7f3e6b02c640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e64102a60 0x7f3e6419da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.012+0000 7f3e6b02c640 1 --2- 172.21.15.70:0/2598585968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e64101870 0x7f3e6406bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.012+0000 7f3e6b02c640 1 -- 172.21.15.70:0/2598585968 >> 172.21.15.70:0/2598585968 conn(0x7f3e640fcdc0 msgr2=0x7f3e64105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.013+0000 7f3e6b02c640 1 -- 172.21.15.70:0/2598585968 shutdown_connections 2024-04-26T20:25:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.013+0000 7f3e6b02c640 1 -- 172.21.15.70:0/2598585968 wait complete. 2024-04-26T20:25:20.028 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-04-26T20:25:20.029 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-26T20:25:20.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.131+0000 7f70208f1640 1 -- 172.21.15.70:0/4210254658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f701c101870 msgr2=0x7f701c101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:20.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.131+0000 7f70208f1640 1 --2- 172.21.15.70:0/4210254658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f701c101870 0x7f701c101c90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7010009900 tx=0x7f701002a410 comp rx=0 tx=0).stop 2024-04-26T20:25:20.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.131+0000 7f70208f1640 1 -- 172.21.15.70:0/4210254658 shutdown_connections 2024-04-26T20:25:20.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.131+0000 7f70208f1640 1 --2- 172.21.15.70:0/4210254658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f701c103420 0x7f701c109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:20.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.131+0000 7f70208f1640 1 --2- 172.21.15.70:0/4210254658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f701c102a60 0x7f701c102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:20.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.131+0000 7f70208f1640 1 --2- 172.21.15.70:0/4210254658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f701c101870 0x7f701c101c90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:20.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.131+0000 7f70208f1640 1 -- 172.21.15.70:0/4210254658 >> 172.21.15.70:0/4210254658 conn(0x7f701c0fce00 msgr2=0x7f701c0ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.131+0000 7f70208f1640 1 -- 172.21.15.70:0/4210254658 shutdown_connections 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.131+0000 7f70208f1640 1 -- 172.21.15.70:0/4210254658 wait complete. 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.131+0000 7f70208f1640 1 Processor -- start 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f70208f1640 1 -- start start 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f70208f1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f701c101870 0x7f701c10c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f70208f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f701c102a60 0x7f701c10a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f70208f1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f701c103420 0x7f701c10ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f70208f1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f701c10e5e0 con 0x7f701c102a60 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f70208f1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f701c10e460 con 0x7f701c101870 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f70208f1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f701c10e760 con 0x7f701c103420 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f7019d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f701c102a60 0x7f701c10a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f7019d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f701c102a60 0x7f701c10a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58218/0 (socket says 172.21.15.70:58218) 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f7019d9b640 1 -- 172.21.15.70:0/2918018275 learned_addr learned my addr 172.21.15.70:0/2918018275 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:20.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f701a59c640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f701c101870 0x7f701c10c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f701ad9d640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f701c103420 0x7f701c10ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f7019d9b640 1 -- 172.21.15.70:0/2918018275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f701c103420 msgr2=0x7f701c10ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f7019d9b640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f701c103420 0x7f701c10ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f7019d9b640 1 -- 172.21.15.70:0/2918018275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f701c101870 msgr2=0x7f701c10c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f7019d9b640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f701c101870 0x7f701c10c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f7019d9b640 1 -- 172.21.15.70:0/2918018275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701c10b600 con 0x7f701c102a60 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f701a59c640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f701c101870 0x7f701c10c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f7019d9b640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f701c102a60 0x7f701c10a830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f700c00d770 tx=0x7f700c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f700b7fe640 1 -- 172.21.15.70:0/2918018275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c017070 con 0x7f701c102a60 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f700b7fe640 1 -- 172.21.15.70:0/2918018275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f700c0054f0 con 0x7f701c102a60 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f70208f1640 1 -- 172.21.15.70:0/2918018275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f701c1a2e00 con 0x7f701c102a60 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.132+0000 7f700b7fe640 1 -- 172.21.15.70:0/2918018275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c004de0 con 0x7f701c102a60 2024-04-26T20:25:20.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.133+0000 7f70208f1640 1 -- 172.21.15.70:0/2918018275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f701c1a3210 con 0x7f701c102a60 2024-04-26T20:25:20.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.134+0000 7f70208f1640 1 -- 172.21.15.70:0/2918018275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f701c108c60 con 0x7f701c102a60 2024-04-26T20:25:20.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.135+0000 7f700b7fe640 1 -- 172.21.15.70:0/2918018275 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f700c004f80 con 0x7f701c102a60 2024-04-26T20:25:20.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.135+0000 7f700b7fe640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f70040a3bb0 0x7f70040a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:20.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.135+0000 7f701a59c640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f70040a3bb0 0x7f70040a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:20.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.135+0000 7f700b7fe640 1 -- 172.21.15.70:0/2918018275 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f700c0cfc60 con 0x7f701c102a60 2024-04-26T20:25:20.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.136+0000 7f701a59c640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f70040a3bb0 0x7f70040a6070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7010009230 tx=0x7f7010031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:20.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.140+0000 7f700b7fe640 1 -- 172.21.15.70:0/2918018275 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f700c09c140 con 0x7f701c102a60 2024-04-26T20:25:20.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2375718749' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T20:25:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] up:active 2024-04-26T20:25:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-mon[29124]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T20:25:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-mon[29124]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-26T20:25:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-mon[29124]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-04-26T20:25:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-mon[29124]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T20:25:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2598585968' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T20:25:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-mon[29124]: pgmap v292: 97 pgs: 6 creating+peering, 91 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 5 op/s 2024-04-26T20:25:20.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:20.345+0000 7f70208f1640 1 -- 172.21.15.70:0/2918018275 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f701c062d70 con 0x7f70040a3bb0 2024-04-26T20:25:20.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:20 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2375718749' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T20:25:20.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:20 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] up:active 2024-04-26T20:25:20.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:20 smithi098 ceph-mon[32591]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T20:25:20.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:20 smithi098 ceph-mon[32591]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-26T20:25:20.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:20 smithi098 ceph-mon[32591]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-04-26T20:25:20.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:20 smithi098 ceph-mon[32591]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T20:25:20.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:20 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2598585968' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T20:25:20.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:20 smithi098 ceph-mon[32591]: pgmap v292: 97 pgs: 6 creating+peering, 91 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 5 op/s 2024-04-26T20:25:20.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:20 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2375718749' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T20:25:20.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:20 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] up:active 2024-04-26T20:25:20.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:20 smithi080 ceph-mon[32278]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T20:25:20.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:20 smithi080 ceph-mon[32278]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-26T20:25:20.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:20 smithi080 ceph-mon[32278]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-04-26T20:25:20.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:20 smithi080 ceph-mon[32278]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T20:25:20.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:20 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2598585968' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T20:25:20.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:20 smithi080 ceph-mon[32278]: pgmap v292: 97 pgs: 6 creating+peering, 91 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 5 op/s 2024-04-26T20:25:20.784 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:25:20.350+0000 7f374a63f700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:25:20.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:25:20.350+0000 7f374a63f700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:25:20.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:25:20.350+0000 7f374a63f700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:25:20.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:25:20.350+0000 7f374a63f700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:25:20.785 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:25:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:25:20.350+0000 7f374a63f700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:25:21.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.039+0000 7f700b7fe640 1 -- 172.21.15.70:0/2918018275 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f701c062d70 con 0x7f70040a3bb0 2024-04-26T20:25:21.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 -- 172.21.15.70:0/2918018275 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f70040a3bb0 msgr2=0x7f70040a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f70040a3bb0 0x7f70040a6070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7010009230 tx=0x7f7010031510 comp rx=0 tx=0).stop 2024-04-26T20:25:21.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 -- 172.21.15.70:0/2918018275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f701c102a60 msgr2=0x7f701c10a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f701c102a60 0x7f701c10a830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f700c00d770 tx=0x7f700c00dc30 comp rx=0 tx=0).stop 2024-04-26T20:25:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 -- 172.21.15.70:0/2918018275 shutdown_connections 2024-04-26T20:25:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f70040a3bb0 0x7f70040a6070 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f701c103420 0x7f701c10ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f701c102a60 0x7f701c10a830 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 --2- 172.21.15.70:0/2918018275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f701c101870 0x7f701c10c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 -- 172.21.15.70:0/2918018275 >> 172.21.15.70:0/2918018275 conn(0x7f701c0fce00 msgr2=0x7f701c105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 -- 172.21.15.70:0/2918018275 shutdown_connections 2024-04-26T20:25:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.041+0000 7f70208f1640 1 -- 172.21.15.70:0/2918018275 wait complete. 2024-04-26T20:25:21.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-26T20:25:21.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.159+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/3982059626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e74103450 msgr2=0x7f0e74105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.159+0000 7f0e7c5c9640 1 --2- 172.21.15.70:0/3982059626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e74103450 0x7f0e74105840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009900 tx=0x7f0e7002a410 comp rx=0 tx=0).stop 2024-04-26T20:25:21.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.159+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/3982059626 shutdown_connections 2024-04-26T20:25:21.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.159+0000 7f0e7c5c9640 1 --2- 172.21.15.70:0/3982059626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e741086b0 0x7f0e7410aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.159+0000 7f0e7c5c9640 1 --2- 172.21.15.70:0/3982059626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e74105d80 0x7f0e74108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.159+0000 7f0e7c5c9640 1 --2- 172.21.15.70:0/3982059626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e74103450 0x7f0e74105840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.159+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/3982059626 >> 172.21.15.70:0/3982059626 conn(0x7f0e740fcdc0 msgr2=0x7f0e740ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:21.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.159+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/3982059626 shutdown_connections 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.159+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/3982059626 wait complete. 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7c5c9640 1 Processor -- start 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7c5c9640 1 -- start start 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7c5c9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e74103450 0x7f0e74198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7c5c9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e74105d80 0x7f0e741991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7c5c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e741086b0 0x7f0e741a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7c5c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7410e5f0 con 0x7f0e741086b0 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7c5c9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7410e470 con 0x7f0e74103450 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7c5c9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7410e770 con 0x7f0e74105d80 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7ab66640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e741086b0 0x7f0e741a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7ab66640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e741086b0 0x7f0e741a0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58246/0 (socket says 172.21.15.70:58246) 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7a365640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e74103450 0x7f0e74198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7ab66640 1 -- 172.21.15.70:0/2989093163 learned_addr learned my addr 172.21.15.70:0/2989093163 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e79b64640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e74105d80 0x7f0e741991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7ab66640 1 -- 172.21.15.70:0/2989093163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e74105d80 msgr2=0x7f0e741991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7ab66640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e74105d80 0x7f0e741991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7ab66640 1 -- 172.21.15.70:0/2989093163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e74103450 msgr2=0x7f0e74198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7ab66640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e74103450 0x7f0e74198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7ab66640 1 -- 172.21.15.70:0/2989093163 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e741a08f0 con 0x7f0e741086b0 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.160+0000 7f0e7a365640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e74103450 0x7f0e74198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.161+0000 7f0e7ab66640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e741086b0 0x7f0e741a0250 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00eb10 tx=0x7f0e6c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.161+0000 7f0e6b7fe640 1 -- 172.21.15.70:0/2989093163 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c004b20 con 0x7f0e741086b0 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.161+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/2989093163 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e741a0be0 con 0x7f0e741086b0 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.161+0000 7f0e6b7fe640 1 -- 172.21.15.70:0/2989093163 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0e6c004cc0 con 0x7f0e741086b0 2024-04-26T20:25:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.161+0000 7f0e6b7fe640 1 -- 172.21.15.70:0/2989093163 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c010720 con 0x7f0e741086b0 2024-04-26T20:25:21.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.161+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/2989093163 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e741a10e0 con 0x7f0e741086b0 2024-04-26T20:25:21.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.162+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/2989093163 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e740fe8b0 con 0x7f0e741086b0 2024-04-26T20:25:21.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.163+0000 7f0e6b7fe640 1 -- 172.21.15.70:0/2989093163 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0e6c0108c0 con 0x7f0e741086b0 2024-04-26T20:25:21.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.163+0000 7f0e6b7fe640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0e600a3bb0 0x7f0e600a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.163+0000 7f0e7a365640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0e600a3bb0 0x7f0e600a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.163+0000 7f0e6b7fe640 1 -- 172.21.15.70:0/2989093163 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f0e6c0d0aa0 con 0x7f0e741086b0 2024-04-26T20:25:21.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.164+0000 7f0e7a365640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0e600a3bb0 0x7f0e600a6070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009230 tx=0x7f0e70031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:21.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.167+0000 7f0e6b7fe640 1 -- 172.21.15.70:0/2989093163 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f0e6c054060 con 0x7f0e741086b0 2024-04-26T20:25:21.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:21 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2598585968' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T20:25:21.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:21 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] up:active 2024-04-26T20:25:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:21 smithi080 ceph-mon[32278]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-26T20:25:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:21 smithi080 ceph-mon[32278]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-26T20:25:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:21 smithi080 ceph-mon[32278]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-04-26T20:25:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:21 smithi080 ceph-mon[32278]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-04-26T20:25:21.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:21 smithi080 ceph-mon[32278]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:21.220 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b[62209]: 2024-04-26T20:25:20.842+0000 7fc27ecb9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T20:25:21.220 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b[62209]: 2024-04-26T20:25:20.842+0000 7fc27ecb9700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T20:25:21.220 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b[62209]: 2024-04-26T20:25:20.842+0000 7fc27ecb9700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T20:25:21.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:21 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2598585968' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T20:25:21.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:21 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] up:active 2024-04-26T20:25:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:21 smithi070 ceph-mon[29124]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-26T20:25:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:21 smithi070 ceph-mon[29124]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-26T20:25:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:21 smithi070 ceph-mon[29124]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-04-26T20:25:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:21 smithi070 ceph-mon[29124]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-04-26T20:25:21.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:21 smithi070 ceph-mon[29124]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:21.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.372+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/2989093163 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0e74062d70 con 0x7f0e600a3bb0 2024-04-26T20:25:21.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.401+0000 7f0e6b7fe640 1 -- 172.21.15.70:0/2989093163 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0e74062d70 con 0x7f0e600a3bb0 2024-04-26T20:25:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/2989093163 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0e600a3bb0 msgr2=0x7f0e600a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0e600a3bb0 0x7f0e600a6070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009230 tx=0x7f0e70031510 comp rx=0 tx=0).stop 2024-04-26T20:25:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/2989093163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e741086b0 msgr2=0x7f0e741a0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e741086b0 0x7f0e741a0250 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00eb10 tx=0x7f0e6c00c2d0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/2989093163 shutdown_connections 2024-04-26T20:25:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0e600a3bb0 0x7f0e600a6070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e741086b0 0x7f0e741a0250 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e74105d80 0x7f0e741991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 --2- 172.21.15.70:0/2989093163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e74103450 0x7f0e74198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/2989093163 >> 172.21.15.70:0/2989093163 conn(0x7f0e740fcdc0 msgr2=0x7f0e74103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:21.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/2989093163 shutdown_connections 2024-04-26T20:25:21.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.403+0000 7f0e7c5c9640 1 -- 172.21.15.70:0/2989093163 wait complete. 2024-04-26T20:25:21.414 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-26T20:25:21.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:21 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2598585968' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T20:25:21.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:21 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] up:active 2024-04-26T20:25:21.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:21 smithi098 ceph-mon[32591]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-26T20:25:21.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:21 smithi098 ceph-mon[32591]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-26T20:25:21.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:21 smithi098 ceph-mon[32591]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-04-26T20:25:21.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:21 smithi098 ceph-mon[32591]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-04-26T20:25:21.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:21 smithi098 ceph-mon[32591]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 -- 172.21.15.70:0/631718105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8afc103450 msgr2=0x7f8afc105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 --2- 172.21.15.70:0/631718105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8afc103450 0x7f8afc105840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009900 tx=0x7f8af002a410 comp rx=0 tx=0).stop 2024-04-26T20:25:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 -- 172.21.15.70:0/631718105 shutdown_connections 2024-04-26T20:25:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 --2- 172.21.15.70:0/631718105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8afc1086b0 0x7f8afc10aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 --2- 172.21.15.70:0/631718105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc105d80 0x7f8afc108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 --2- 172.21.15.70:0/631718105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8afc103450 0x7f8afc105840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 -- 172.21.15.70:0/631718105 >> 172.21.15.70:0/631718105 conn(0x7f8afc0fcdc0 msgr2=0x7f8afc0ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 -- 172.21.15.70:0/631718105 shutdown_connections 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 -- 172.21.15.70:0/631718105 wait complete. 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 Processor -- start 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 -- start start 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8afc103450 0x7f8afc102dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc105d80 0x7f8afc101400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8afc1086b0 0x7f8afc101940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc10e5f0 con 0x7f8afc1086b0 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc10e470 con 0x7f8afc103450 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b02cbd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc10e770 con 0x7f8afc105d80 2024-04-26T20:25:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b0125a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8afc1086b0 0x7f8afc101940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b0125a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8afc1086b0 0x7f8afc101940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58258/0 (socket says 172.21.15.70:58258) 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b0125a640 1 -- 172.21.15.70:0/3669851156 learned_addr learned my addr 172.21.15.70:0/3669851156 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.517+0000 7f8b00a59640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8afc103450 0x7f8afc102dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8afbfff640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc105d80 0x7f8afc101400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8b0125a640 1 -- 172.21.15.70:0/3669851156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc105d80 msgr2=0x7f8afc101400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8b0125a640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc105d80 0x7f8afc101400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8b0125a640 1 -- 172.21.15.70:0/3669851156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8afc103450 msgr2=0x7f8afc102dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8b0125a640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8afc103450 0x7f8afc102dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8b0125a640 1 -- 172.21.15.70:0/3669851156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc1021d0 con 0x7f8afc1086b0 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8b0125a640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8afc1086b0 0x7f8afc101940 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8af400eb10 tx=0x7f8af400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8af9ffb640 1 -- 172.21.15.70:0/3669851156 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4004b20 con 0x7f8afc1086b0 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8af9ffb640 1 -- 172.21.15.70:0/3669851156 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8af4004cc0 con 0x7f8afc1086b0 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8b02cbd640 1 -- 172.21.15.70:0/3669851156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8afc1a2dd0 con 0x7f8afc1086b0 2024-04-26T20:25:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8af9ffb640 1 -- 172.21.15.70:0/3669851156 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4010720 con 0x7f8afc1086b0 2024-04-26T20:25:21.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.518+0000 7f8b02cbd640 1 -- 172.21.15.70:0/3669851156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8afc1a3230 con 0x7f8afc1086b0 2024-04-26T20:25:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.519+0000 7f8b02cbd640 1 -- 172.21.15.70:0/3669851156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8afc0fe8b0 con 0x7f8afc1086b0 2024-04-26T20:25:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.520+0000 7f8af9ffb640 1 -- 172.21.15.70:0/3669851156 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f8af4005020 con 0x7f8afc1086b0 2024-04-26T20:25:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.521+0000 7f8af9ffb640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8aec0a3c30 0x7f8aec0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.521+0000 7f8b00a59640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8aec0a3c30 0x7f8aec0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.521+0000 7f8af9ffb640 1 -- 172.21.15.70:0/3669851156 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f8af40d0770 con 0x7f8afc1086b0 2024-04-26T20:25:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.521+0000 7f8b00a59640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8aec0a3c30 0x7f8aec0a60f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8af0000c00 tx=0x7f8af0031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:21.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.525+0000 7f8af9ffb640 1 -- 172.21.15.70:0/3669851156 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f8af409d2a0 con 0x7f8afc1086b0 2024-04-26T20:25:21.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.731+0000 7f8b02cbd640 1 -- 172.21.15.70:0/3669851156 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f8afc062e00 con 0x7f8aec0a3c30 2024-04-26T20:25:21.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.736+0000 7f8af9ffb640 1 -- 172.21.15.70:0/3669851156 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f8afc062e00 con 0x7f8aec0a3c30 2024-04-26T20:25:21.737 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/qa/sv_0/085cc778-08ad-426a-a78b-97a98551123e 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.738+0000 7f8b02cbd640 1 -- 172.21.15.70:0/3669851156 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8aec0a3c30 msgr2=0x7f8aec0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.739+0000 7f8b02cbd640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8aec0a3c30 0x7f8aec0a60f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8af0000c00 tx=0x7f8af0031510 comp rx=0 tx=0).stop 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.739+0000 7f8b02cbd640 1 -- 172.21.15.70:0/3669851156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8afc1086b0 msgr2=0x7f8afc101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.739+0000 7f8b02cbd640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8afc1086b0 0x7f8afc101940 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8af400eb10 tx=0x7f8af400c2d0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.739+0000 7f8b02cbd640 1 -- 172.21.15.70:0/3669851156 shutdown_connections 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.739+0000 7f8b02cbd640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8aec0a3c30 0x7f8aec0a60f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.739+0000 7f8b02cbd640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8afc1086b0 0x7f8afc101940 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.739+0000 7f8b02cbd640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc105d80 0x7f8afc101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.739+0000 7f8b02cbd640 1 --2- 172.21.15.70:0/3669851156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8afc103450 0x7f8afc102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.739+0000 7f8b02cbd640 1 -- 172.21.15.70:0/3669851156 >> 172.21.15.70:0/3669851156 conn(0x7f8afc0fcdc0 msgr2=0x7f8afc103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.739+0000 7f8b02cbd640 1 -- 172.21.15.70:0/3669851156 shutdown_connections 2024-04-26T20:25:21.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.739+0000 7f8b02cbd640 1 -- 172.21.15.70:0/3669851156 wait complete. 2024-04-26T20:25:21.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-26T20:25:21.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.853+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/876947985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c18101880 msgr2=0x7f8c18101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.853+0000 7f8c1fc9c640 1 --2- 172.21.15.70:0/876947985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c18101880 0x7f8c18101ca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009900 tx=0x7f8c1402a410 comp rx=0 tx=0).stop 2024-04-26T20:25:21.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.853+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/876947985 shutdown_connections 2024-04-26T20:25:21.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.853+0000 7f8c1fc9c640 1 --2- 172.21.15.70:0/876947985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c18103430 0x7f8c18109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.853+0000 7f8c1fc9c640 1 --2- 172.21.15.70:0/876947985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c18102a70 0x7f8c18102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.853+0000 7f8c1fc9c640 1 --2- 172.21.15.70:0/876947985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c18101880 0x7f8c18101ca0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.853+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/876947985 >> 172.21.15.70:0/876947985 conn(0x7f8c180fce10 msgr2=0x7f8c180ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:21.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.853+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/876947985 shutdown_connections 2024-04-26T20:25:21.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.853+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/876947985 wait complete. 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1fc9c640 1 Processor -- start 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1fc9c640 1 -- start start 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1fc9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c18101880 0x7f8c18198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1fc9c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c18102a70 0x7f8c18199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1fc9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c18103430 0x7f8c181a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1fc9c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1810e610 con 0x7f8c18103430 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1fc9c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1810e490 con 0x7f8c18101880 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1fc9c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1810e790 con 0x7f8c18102a70 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1e239640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c18103430 0x7f8c181a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1e239640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c18103430 0x7f8c181a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58272/0 (socket says 172.21.15.70:58272) 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1e239640 1 -- 172.21.15.70:0/2000039533 learned_addr learned my addr 172.21.15.70:0/2000039533 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1da38640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c18101880 0x7f8c18198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1d237640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c18102a70 0x7f8c18199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1e239640 1 -- 172.21.15.70:0/2000039533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c18102a70 msgr2=0x7f8c18199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1e239640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c18102a70 0x7f8c18199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1e239640 1 -- 172.21.15.70:0/2000039533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c18101880 msgr2=0x7f8c18198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:21.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1e239640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c18101880 0x7f8c18198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:21.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1e239640 1 -- 172.21.15.70:0/2000039533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c181a0910 con 0x7f8c18103430 2024-04-26T20:25:21.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1e239640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c18103430 0x7f8c181a0270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000eb10 tx=0x7f8c1000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:21.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c0effd640 1 -- 172.21.15.70:0/2000039533 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10004b20 con 0x7f8c18103430 2024-04-26T20:25:21.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/2000039533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c181a0c00 con 0x7f8c18103430 2024-04-26T20:25:21.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c0effd640 1 -- 172.21.15.70:0/2000039533 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8c10004cc0 con 0x7f8c18103430 2024-04-26T20:25:21.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c0effd640 1 -- 172.21.15.70:0/2000039533 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10010720 con 0x7f8c18103430 2024-04-26T20:25:21.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.854+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/2000039533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c181a1120 con 0x7f8c18103430 2024-04-26T20:25:21.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.855+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/2000039533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c18108c70 con 0x7f8c18103430 2024-04-26T20:25:21.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.857+0000 7f8c0effd640 1 -- 172.21.15.70:0/2000039533 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f8c100108c0 con 0x7f8c18103430 2024-04-26T20:25:21.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.857+0000 7f8c0effd640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8c040a3bb0 0x7f8c040a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:21.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.857+0000 7f8c1da38640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8c040a3bb0 0x7f8c040a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:21.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.857+0000 7f8c0effd640 1 -- 172.21.15.70:0/2000039533 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f8c100d0b70 con 0x7f8c18103430 2024-04-26T20:25:21.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.858+0000 7f8c1da38640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8c040a3bb0 0x7f8c040a6070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8c14005ab0 tx=0x7f8c14005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:21.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:21.861+0000 7f8c0effd640 1 -- 172.21.15.70:0/2000039533 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f8c10054060 con 0x7f8c18103430 2024-04-26T20:25:22.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:22 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] up:active 2024-04-26T20:25:22.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:22 smithi070 ceph-mon[29124]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-26T20:25:22.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:22 smithi070 ceph-mon[29124]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T20:25:22.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:22 smithi070 ceph-mon[29124]: Cluster is now healthy 2024-04-26T20:25:22.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:22 smithi070 ceph-mon[29124]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-04-26T20:25:22.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:22 smithi070 ceph-mon[29124]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-26T20:25:22.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:22 smithi070 ceph-mon[29124]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-04-26T20:25:22.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:22 smithi070 ceph-mon[29124]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:22.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:22 smithi070 ceph-mon[29124]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:22.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:22 smithi070 ceph-mon[29124]: pgmap v293: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 13 op/s 2024-04-26T20:25:22.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.040+0000 7f8c0effd640 1 -- 172.21.15.70:0/2000039533 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8c10099580 con 0x7f8c18103430 2024-04-26T20:25:22.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.076+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/2000039533 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8c18062d70 con 0x7f8c040a3bb0 2024-04-26T20:25:22.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.097+0000 7f8c0effd640 1 -- 172.21.15.70:0/2000039533 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8c18062d70 con 0x7f8c040a3bb0 2024-04-26T20:25:22.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/2000039533 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8c040a3bb0 msgr2=0x7f8c040a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8c040a3bb0 0x7f8c040a6070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8c14005ab0 tx=0x7f8c14005a20 comp rx=0 tx=0).stop 2024-04-26T20:25:22.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/2000039533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c18103430 msgr2=0x7f8c181a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c18103430 0x7f8c181a0270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000eb10 tx=0x7f8c1000c2d0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/2000039533 shutdown_connections 2024-04-26T20:25:22.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f8c040a3bb0 0x7f8c040a6070 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c18103430 0x7f8c181a0270 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c18102a70 0x7f8c18199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 --2- 172.21.15.70:0/2000039533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c18101880 0x7f8c18198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/2000039533 >> 172.21.15.70:0/2000039533 conn(0x7f8c180fce10 msgr2=0x7f8c18105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:22.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/2000039533 shutdown_connections 2024-04-26T20:25:22.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.099+0000 7f8c1fc9c640 1 -- 172.21.15.70:0/2000039533 wait complete. 2024-04-26T20:25:22.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-26T20:25:22.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.212+0000 7fa5ddc37640 1 -- 172.21.15.70:0/3601238760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5d8105d20 msgr2=0x7fa5d8108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.212+0000 7fa5ddc37640 1 --2- 172.21.15.70:0/3601238760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5d8105d20 0x7fa5d8108110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009900 tx=0x7fa5cc02a410 comp rx=0 tx=0).stop 2024-04-26T20:25:22.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.212+0000 7fa5ddc37640 1 -- 172.21.15.70:0/3601238760 shutdown_connections 2024-04-26T20:25:22.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.212+0000 7fa5ddc37640 1 --2- 172.21.15.70:0/3601238760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5d8108650 0x7fa5d810aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.212+0000 7fa5ddc37640 1 --2- 172.21.15.70:0/3601238760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5d8105d20 0x7fa5d8108110 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.212+0000 7fa5ddc37640 1 --2- 172.21.15.70:0/3601238760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d81033f0 0x7fa5d81057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.212+0000 7fa5ddc37640 1 -- 172.21.15.70:0/3601238760 >> 172.21.15.70:0/3601238760 conn(0x7fa5d80fcdc0 msgr2=0x7fa5d80ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.212+0000 7fa5ddc37640 1 -- 172.21.15.70:0/3601238760 shutdown_connections 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.212+0000 7fa5ddc37640 1 -- 172.21.15.70:0/3601238760 wait complete. 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5ddc37640 1 Processor -- start 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5ddc37640 1 -- start start 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5ddc37640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d81033f0 0x7fa5d8102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5ddc37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5d8105d20 0x7fa5d81013a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5ddc37640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5d8108650 0x7fa5d81018e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5ddc37640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d810e630 con 0x7fa5d8108650 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5ddc37640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d810e4b0 con 0x7fa5d81033f0 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5ddc37640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d810e7b0 con 0x7fa5d8105d20 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5d8108650 0x7fa5d81018e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5d8108650 0x7fa5d81018e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58288/0 (socket says 172.21.15.70:58288) 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d7fff640 1 -- 172.21.15.70:0/37387708 learned_addr learned my addr 172.21.15.70:0/37387708 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d81033f0 0x7fa5d8102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d6ffd640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5d8105d20 0x7fa5d81013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d7fff640 1 -- 172.21.15.70:0/37387708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5d8105d20 msgr2=0x7fa5d81013a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d7fff640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5d8105d20 0x7fa5d81013a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d7fff640 1 -- 172.21.15.70:0/37387708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d81033f0 msgr2=0x7fa5d8102d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d7fff640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d81033f0 0x7fa5d8102d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d7fff640 1 -- 172.21.15.70:0/37387708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d8102170 con 0x7fa5d8108650 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d6ffd640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5d8105d20 0x7fa5d81013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d77fe640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d81033f0 0x7fa5d8102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.213+0000 7fa5d7fff640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5d8108650 0x7fa5d81018e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000b970 tx=0x7fa5d000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.214+0000 7fa5d4ff9640 1 -- 172.21.15.70:0/37387708 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0019070 con 0x7fa5d8108650 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.214+0000 7fa5d4ff9640 1 -- 172.21.15.70:0/37387708 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa5d000cb40 con 0x7fa5d8108650 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.214+0000 7fa5d4ff9640 1 -- 172.21.15.70:0/37387708 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0007650 con 0x7fa5d8108650 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.214+0000 7fa5ddc37640 1 -- 172.21.15.70:0/37387708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5d81a2e50 con 0x7fa5d8108650 2024-04-26T20:25:22.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.214+0000 7fa5ddc37640 1 -- 172.21.15.70:0/37387708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5d81a3330 con 0x7fa5d8108650 2024-04-26T20:25:22.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.215+0000 7fa5ddc37640 1 -- 172.21.15.70:0/37387708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5d80fe8b0 con 0x7fa5d8108650 2024-04-26T20:25:22.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.216+0000 7fa5d4ff9640 1 -- 172.21.15.70:0/37387708 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa5d001c070 con 0x7fa5d8108650 2024-04-26T20:25:22.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.216+0000 7fa5d4ff9640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa5c00a3cc0 0x7fa5c00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.216+0000 7fa5d77fe640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa5c00a3cc0 0x7fa5c00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:22.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.216+0000 7fa5d4ff9640 1 -- 172.21.15.70:0/37387708 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fa5d00cf7a0 con 0x7fa5d8108650 2024-04-26T20:25:22.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.217+0000 7fa5d77fe640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa5c00a3cc0 0x7fa5c00a6180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009fc0 tx=0x7fa5c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:22.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.221+0000 7fa5d4ff9640 1 -- 172.21.15.70:0/37387708 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa5d009bc90 con 0x7fa5d8108650 2024-04-26T20:25:22.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.427+0000 7fa5ddc37640 1 -- 172.21.15.70:0/37387708 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fa5d8062e00 con 0x7fa5c00a3cc0 2024-04-26T20:25:22.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.432+0000 7fa5d4ff9640 1 -- 172.21.15.70:0/37387708 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa5d8062e00 con 0x7fa5c00a3cc0 2024-04-26T20:25:22.433 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/qa/sv_1/a3f80044-8f15-4eae-ab09-8a4de526b198 2024-04-26T20:25:22.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.434+0000 7fa5ddc37640 1 -- 172.21.15.70:0/37387708 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa5c00a3cc0 msgr2=0x7fa5c00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.434+0000 7fa5ddc37640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa5c00a3cc0 0x7fa5c00a6180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009fc0 tx=0x7fa5c8005f90 comp rx=0 tx=0).stop 2024-04-26T20:25:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.434+0000 7fa5ddc37640 1 -- 172.21.15.70:0/37387708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5d8108650 msgr2=0x7fa5d81018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.434+0000 7fa5ddc37640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5d8108650 0x7fa5d81018e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000b970 tx=0x7fa5d000be30 comp rx=0 tx=0).stop 2024-04-26T20:25:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.434+0000 7fa5ddc37640 1 -- 172.21.15.70:0/37387708 shutdown_connections 2024-04-26T20:25:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.434+0000 7fa5ddc37640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa5c00a3cc0 0x7fa5c00a6180 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.434+0000 7fa5ddc37640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5d8108650 0x7fa5d81018e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.434+0000 7fa5ddc37640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5d8105d20 0x7fa5d81013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.434+0000 7fa5ddc37640 1 --2- 172.21.15.70:0/37387708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d81033f0 0x7fa5d8102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.434+0000 7fa5ddc37640 1 -- 172.21.15.70:0/37387708 >> 172.21.15.70:0/37387708 conn(0x7fa5d80fcdc0 msgr2=0x7fa5d8103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.435+0000 7fa5ddc37640 1 -- 172.21.15.70:0/37387708 shutdown_connections 2024-04-26T20:25:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.435+0000 7fa5ddc37640 1 -- 172.21.15.70:0/37387708 wait complete. 2024-04-26T20:25:22.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:25:22.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:22 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] up:active 2024-04-26T20:25:22.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:22 smithi098 ceph-mon[32591]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-26T20:25:22.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:22 smithi098 ceph-mon[32591]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T20:25:22.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:22 smithi098 ceph-mon[32591]: Cluster is now healthy 2024-04-26T20:25:22.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:22 smithi098 ceph-mon[32591]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-04-26T20:25:22.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:22 smithi098 ceph-mon[32591]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-26T20:25:22.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:22 smithi098 ceph-mon[32591]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-04-26T20:25:22.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:22 smithi098 ceph-mon[32591]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:22.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:22 smithi098 ceph-mon[32591]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:22.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:22 smithi098 ceph-mon[32591]: pgmap v293: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 13 op/s 2024-04-26T20:25:22.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:22 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] up:active 2024-04-26T20:25:22.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:22 smithi080 ceph-mon[32278]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-26T20:25:22.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:22 smithi080 ceph-mon[32278]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T20:25:22.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:22 smithi080 ceph-mon[32278]: Cluster is now healthy 2024-04-26T20:25:22.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:22 smithi080 ceph-mon[32278]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-04-26T20:25:22.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:22 smithi080 ceph-mon[32278]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-26T20:25:22.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:22 smithi080 ceph-mon[32278]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-04-26T20:25:22.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:22 smithi080 ceph-mon[32278]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:22.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:22 smithi080 ceph-mon[32278]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:22.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:22 smithi080 ceph-mon[32278]: pgmap v293: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 13 op/s 2024-04-26T20:25:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.543+0000 7f452759d640 1 -- 172.21.15.70:0/3164802286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4520103520 msgr2=0x7f4520109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.543+0000 7f452759d640 1 --2- 172.21.15.70:0/3164802286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4520103520 0x7f4520109db0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4518009ca0 tx=0x7f451802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.543+0000 7f452759d640 1 -- 172.21.15.70:0/3164802286 shutdown_connections 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.543+0000 7f452759d640 1 --2- 172.21.15.70:0/3164802286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4520103520 0x7f4520109db0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.543+0000 7f452759d640 1 --2- 172.21.15.70:0/3164802286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4520102b60 0x7f4520102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.543+0000 7f452759d640 1 --2- 172.21.15.70:0/3164802286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4520101970 0x7f4520101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.543+0000 7f452759d640 1 -- 172.21.15.70:0/3164802286 >> 172.21.15.70:0/3164802286 conn(0x7f45200fcf00 msgr2=0x7f45200ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.543+0000 7f452759d640 1 -- 172.21.15.70:0/3164802286 shutdown_connections 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.543+0000 7f452759d640 1 -- 172.21.15.70:0/3164802286 wait complete. 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f452759d640 1 Processor -- start 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f452759d640 1 -- start start 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f452759d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4520101970 0x7f4520198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f452759d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4520102b60 0x7f4520199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f452759d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4520103520 0x7f45201a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f452759d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f452010e5f0 con 0x7f4520102b60 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f452759d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f452010e470 con 0x7f4520101970 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f452759d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f452010e770 con 0x7f4520103520 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f4524b38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4520102b60 0x7f4520199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f4524b38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4520102b60 0x7f4520199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58312/0 (socket says 172.21.15.70:58312) 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f4524b38640 1 -- 172.21.15.70:0/1422767756 learned_addr learned my addr 172.21.15.70:0/1422767756 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f4525339640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4520101970 0x7f4520198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f4525b3a640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4520103520 0x7f45201a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f4524b38640 1 -- 172.21.15.70:0/1422767756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4520103520 msgr2=0x7f45201a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f4524b38640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4520103520 0x7f45201a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f4524b38640 1 -- 172.21.15.70:0/1422767756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4520101970 msgr2=0x7f4520198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f4524b38640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4520101970 0x7f4520198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f4524b38640 1 -- 172.21.15.70:0/1422767756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45201a0830 con 0x7f4520102b60 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f4524b38640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4520102b60 0x7f4520199160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f451000c970 tx=0x7f451000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f45167fc640 1 -- 172.21.15.70:0/1422767756 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510007bb0 con 0x7f4520102b60 2024-04-26T20:25:22.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f45167fc640 1 -- 172.21.15.70:0/1422767756 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4510007d50 con 0x7f4520102b60 2024-04-26T20:25:22.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f452759d640 1 -- 172.21.15.70:0/1422767756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45201a0b20 con 0x7f4520102b60 2024-04-26T20:25:22.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f45167fc640 1 -- 172.21.15.70:0/1422767756 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451000f450 con 0x7f4520102b60 2024-04-26T20:25:22.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.544+0000 7f452759d640 1 -- 172.21.15.70:0/1422767756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45201a1020 con 0x7f4520102b60 2024-04-26T20:25:22.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.545+0000 7f452759d640 1 -- 172.21.15.70:0/1422767756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4520108c30 con 0x7f4520102b60 2024-04-26T20:25:22.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.546+0000 7f45167fc640 1 -- 172.21.15.70:0/1422767756 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f45100046c0 con 0x7f4520102b60 2024-04-26T20:25:22.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.547+0000 7f45167fc640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f450c0a3c40 0x7f450c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.547+0000 7f4525339640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f450c0a3c40 0x7f450c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:22.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.547+0000 7f45167fc640 1 -- 172.21.15.70:0/1422767756 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f45100d0220 con 0x7f4520102b60 2024-04-26T20:25:22.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.547+0000 7f4525339640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f450c0a3c40 0x7f450c0a6100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f452019a0f0 tx=0x7f451c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:22.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.551+0000 7f45167fc640 1 -- 172.21.15.70:0/1422767756 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f4510014030 con 0x7f4520102b60 2024-04-26T20:25:22.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.766+0000 7f452759d640 1 -- 172.21.15.70:0/1422767756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f452002dad0 con 0x7f4520102b60 2024-04-26T20:25:22.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.766+0000 7f45167fc640 1 -- 172.21.15.70:0/1422767756 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7f451009cc50 con 0x7f4520102b60 2024-04-26T20:25:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:22.767 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:25:15.345214+0000","modified":"2024-04-26T20:25:22.041593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24488,"mds_1":24481,"mds_2":24463,"mds_3":24461,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3333683222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3333683222},{"type":"v1","addr":"172.21.15.70:6841","nonce":3333683222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":3,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":1,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6839/4099319394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4099319394},{"type":"v1","addr":"172.21.15.80:6839","nonce":4099319394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24481,24488,24463,24461,24451]},"id":1}]} 2024-04-26T20:25:22.768 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2024-04-26T20:25:22.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.768+0000 7f452759d640 1 -- 172.21.15.70:0/1422767756 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f450c0a3c40 msgr2=0x7f450c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.768+0000 7f452759d640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f450c0a3c40 0x7f450c0a6100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f452019a0f0 tx=0x7f451c005f90 comp rx=0 tx=0).stop 2024-04-26T20:25:22.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.768+0000 7f452759d640 1 -- 172.21.15.70:0/1422767756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4520102b60 msgr2=0x7f4520199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.768+0000 7f452759d640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4520102b60 0x7f4520199160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f451000c970 tx=0x7f451000ce30 comp rx=0 tx=0).stop 2024-04-26T20:25:22.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.768+0000 7f452759d640 1 -- 172.21.15.70:0/1422767756 shutdown_connections 2024-04-26T20:25:22.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.768+0000 7f452759d640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f450c0a3c40 0x7f450c0a6100 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.768+0000 7f452759d640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4520103520 0x7f45201a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.768+0000 7f452759d640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4520102b60 0x7f4520199160 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.768+0000 7f452759d640 1 --2- 172.21.15.70:0/1422767756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4520101970 0x7f4520198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.768+0000 7f452759d640 1 -- 172.21.15.70:0/1422767756 >> 172.21.15.70:0/1422767756 conn(0x7f45200fcf00 msgr2=0x7f4520105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:22.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.769+0000 7f452759d640 1 -- 172.21.15.70:0/1422767756 shutdown_connections 2024-04-26T20:25:22.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.769+0000 7f452759d640 1 -- 172.21.15.70:0/1422767756 wait complete. 2024-04-26T20:25:22.781 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:25:22.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.877+0000 7f35d27f0640 1 -- 172.21.15.70:0/382346362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35cc100a10 msgr2=0x7f35cc100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.877+0000 7f35d27f0640 1 --2- 172.21.15.70:0/382346362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35cc100a10 0x7f35cc100e90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009900 tx=0x7f35c002a410 comp rx=0 tx=0).stop 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.877+0000 7f35d27f0640 1 -- 172.21.15.70:0/382346362 shutdown_connections 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.877+0000 7f35d27f0640 1 --2- 172.21.15.70:0/382346362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35cc1013d0 0x7f35cc10af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.877+0000 7f35d27f0640 1 --2- 172.21.15.70:0/382346362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35cc100a10 0x7f35cc100e90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.877+0000 7f35d27f0640 1 --2- 172.21.15.70:0/382346362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35cc103fa0 0x7f35cc1043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.877+0000 7f35d27f0640 1 -- 172.21.15.70:0/382346362 >> 172.21.15.70:0/382346362 conn(0x7f35cc0fc590 msgr2=0x7f35cc0fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.877+0000 7f35d27f0640 1 -- 172.21.15.70:0/382346362 shutdown_connections 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.877+0000 7f35d27f0640 1 -- 172.21.15.70:0/382346362 wait complete. 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35d27f0640 1 Processor -- start 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35d27f0640 1 -- start start 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35d27f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35cc100a10 0x7f35cc1036a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35d27f0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35cc1013d0 0x7f35cc101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35d27f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35cc103fa0 0x7f35cc102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35d27f0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc10e650 con 0x7f35cc100a10 2024-04-26T20:25:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35d27f0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc10e4d0 con 0x7f35cc103fa0 2024-04-26T20:25:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35d27f0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc10e7d0 con 0x7f35cc1013d0 2024-04-26T20:25:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35cbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35cc100a10 0x7f35cc1036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35cbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35cc100a10 0x7f35cc1036a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58326/0 (socket says 172.21.15.70:58326) 2024-04-26T20:25:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35cbfff640 1 -- 172.21.15.70:0/2681478887 learned_addr learned my addr 172.21.15.70:0/2681478887 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35d0d8d640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35cc103fa0 0x7f35cc102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35cbfff640 1 -- 172.21.15.70:0/2681478887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35cc1013d0 msgr2=0x7f35cc101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35cbfff640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35cc1013d0 0x7f35cc101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35cbfff640 1 -- 172.21.15.70:0/2681478887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35cc103fa0 msgr2=0x7f35cc102220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35cbfff640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35cc103fa0 0x7f35cc102220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.878+0000 7f35cbfff640 1 -- 172.21.15.70:0/2681478887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35cc102ab0 con 0x7f35cc100a10 2024-04-26T20:25:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.879+0000 7f35cbfff640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35cc100a10 0x7f35cc1036a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c970 tx=0x7f35bc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.879+0000 7f35c97fa640 1 -- 172.21.15.70:0/2681478887 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc004220 con 0x7f35cc100a10 2024-04-26T20:25:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.879+0000 7f35c97fa640 1 -- 172.21.15.70:0/2681478887 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f35bc0043c0 con 0x7f35cc100a10 2024-04-26T20:25:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.879+0000 7f35c97fa640 1 -- 172.21.15.70:0/2681478887 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc004a00 con 0x7f35cc100a10 2024-04-26T20:25:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.879+0000 7f35d27f0640 1 -- 172.21.15.70:0/2681478887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35cc1a2df0 con 0x7f35cc100a10 2024-04-26T20:25:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.879+0000 7f35d27f0640 1 -- 172.21.15.70:0/2681478887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35cc1a3200 con 0x7f35cc100a10 2024-04-26T20:25:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.880+0000 7f35d27f0640 1 -- 172.21.15.70:0/2681478887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35cc109f30 con 0x7f35cc100a10 2024-04-26T20:25:22.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.881+0000 7f35c97fa640 1 -- 172.21.15.70:0/2681478887 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f35bc0079b0 con 0x7f35cc100a10 2024-04-26T20:25:22.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.881+0000 7f35c97fa640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35b40a3c40 0x7f35b40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:22.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.882+0000 7f35cb7fe640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35b40a3c40 0x7f35b40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:22.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.882+0000 7f35c97fa640 1 -- 172.21.15.70:0/2681478887 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f35bc0d01a0 con 0x7f35cc100a10 2024-04-26T20:25:22.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.882+0000 7f35cb7fe640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35b40a3c40 0x7f35b40a6100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f35c00096c0 tx=0x7f35c0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:22.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:22.886+0000 7f35c97fa640 1 -- 172.21.15.70:0/2681478887 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f35bc014030 con 0x7f35cc100a10 2024-04-26T20:25:23.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.071+0000 7f35d27f0640 1 -- 172.21.15.70:0/2681478887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35cc02dd40 con 0x7f35cc100a10 2024-04-26T20:25:23.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.073+0000 7f35c97fa640 1 -- 172.21.15.70:0/2681478887 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22148 (secure 0 0 0) 0x7f35bc09cbd0 con 0x7f35cc100a10 2024-04-26T20:25:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:23.075 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:25:16.872684+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:25:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 -- 172.21.15.70:0/2681478887 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35b40a3c40 msgr2=0x7f35b40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35b40a3c40 0x7f35b40a6100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f35c00096c0 tx=0x7f35c0000bc0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 -- 172.21.15.70:0/2681478887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35cc100a10 msgr2=0x7f35cc1036a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35cc100a10 0x7f35cc1036a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c970 tx=0x7f35bc00cd70 comp rx=0 tx=0).stop 2024-04-26T20:25:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 -- 172.21.15.70:0/2681478887 shutdown_connections 2024-04-26T20:25:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f35b40a3c40 0x7f35b40a6100 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35cc103fa0 0x7f35cc102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35cc1013d0 0x7f35cc101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 --2- 172.21.15.70:0/2681478887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35cc100a10 0x7f35cc1036a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 -- 172.21.15.70:0/2681478887 >> 172.21.15.70:0/2681478887 conn(0x7f35cc0fc590 msgr2=0x7f35cc107100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:23.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 -- 172.21.15.70:0/2681478887 shutdown_connections 2024-04-26T20:25:23.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.076+0000 7f35d27f0640 1 -- 172.21.15.70:0/2681478887 wait complete. 2024-04-26T20:25:23.089 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T20:25:23.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:25:23.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 -- 172.21.15.70:0/1560929085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb64108670 msgr2=0x7ffb6410aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 --2- 172.21.15.70:0/1560929085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb64108670 0x7ffb6410aac0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009ca0 tx=0x7ffb5c02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 -- 172.21.15.70:0/1560929085 shutdown_connections 2024-04-26T20:25:23.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 --2- 172.21.15.70:0/1560929085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb64108670 0x7ffb6410aac0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 --2- 172.21.15.70:0/1560929085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb64105d40 0x7ffb64108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 --2- 172.21.15.70:0/1560929085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb64103410 0x7ffb64105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 -- 172.21.15.70:0/1560929085 >> 172.21.15.70:0/1560929085 conn(0x7ffb640fce00 msgr2=0x7ffb640ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:23.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 -- 172.21.15.70:0/1560929085 shutdown_connections 2024-04-26T20:25:23.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 -- 172.21.15.70:0/1560929085 wait complete. 2024-04-26T20:25:23.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 Processor -- start 2024-04-26T20:25:23.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 -- start start 2024-04-26T20:25:23.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb64103410 0x7ffb64198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:23.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb64105d40 0x7ffb64199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:23.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb64108670 0x7ffb641a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:23.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6410e670 con 0x7ffb64108670 2024-04-26T20:25:23.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6410e4f0 con 0x7ffb64103410 2024-04-26T20:25:23.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6bf91640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6410e7f0 con 0x7ffb64105d40 2024-04-26T20:25:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6a52e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb64108670 0x7ffb641a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6a52e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb64108670 0x7ffb641a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58330/0 (socket says 172.21.15.70:58330) 2024-04-26T20:25:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.189+0000 7ffb6a52e640 1 -- 172.21.15.70:0/743503071 learned_addr learned my addr 172.21.15.70:0/743503071 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb69d2d640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb64103410 0x7ffb64198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb6a52e640 1 -- 172.21.15.70:0/743503071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb64105d40 msgr2=0x7ffb64199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb6a52e640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb64105d40 0x7ffb64199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb6a52e640 1 -- 172.21.15.70:0/743503071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb64103410 msgr2=0x7ffb64198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb6a52e640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb64103410 0x7ffb64198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb6a52e640 1 -- 172.21.15.70:0/743503071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb641a07e0 con 0x7ffb64108670 2024-04-26T20:25:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb6a52e640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb64108670 0x7ffb641a0170 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009dc0 tx=0x7ffb5c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb5affd640 1 -- 172.21.15.70:0/743503071 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c004240 con 0x7ffb64108670 2024-04-26T20:25:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb6bf91640 1 -- 172.21.15.70:0/743503071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb641a0a70 con 0x7ffb64108670 2024-04-26T20:25:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb5affd640 1 -- 172.21.15.70:0/743503071 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb5c003e40 con 0x7ffb64108670 2024-04-26T20:25:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb5affd640 1 -- 172.21.15.70:0/743503071 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c02fe60 con 0x7ffb64108670 2024-04-26T20:25:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.190+0000 7ffb6bf91640 1 -- 172.21.15.70:0/743503071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb641a1040 con 0x7ffb64108670 2024-04-26T20:25:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.191+0000 7ffb6bf91640 1 -- 172.21.15.70:0/743503071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb640fe8f0 con 0x7ffb64108670 2024-04-26T20:25:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.192+0000 7ffb5affd640 1 -- 172.21.15.70:0/743503071 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ffb5c02f660 con 0x7ffb64108670 2024-04-26T20:25:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.193+0000 7ffb5affd640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ffb500a3c40 0x7ffb500a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.193+0000 7ffb69d2d640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ffb500a3c40 0x7ffb500a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.193+0000 7ffb5affd640 1 -- 172.21.15.70:0/743503071 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7ffb5c0f1be0 con 0x7ffb64108670 2024-04-26T20:25:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.193+0000 7ffb69d2d640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ffb500a3c40 0x7ffb500a6100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009990 tx=0x7ffb60009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:23.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.202+0000 7ffb5affd640 1 -- 172.21.15.70:0/743503071 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ffb5c0be720 con 0x7ffb64108670 2024-04-26T20:25:23.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:23 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] up:active 2024-04-26T20:25:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:23 smithi070 ceph-mon[29124]: fsmap cephfs:5 7 up:standby 5 up:active 2024-04-26T20:25:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:23 smithi070 ceph-mon[29124]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-26T20:25:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:23 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:23 smithi070 ceph-mon[29124]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:23 smithi070 ceph-mon[29124]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:23.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:23 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1422767756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:23.360 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:23 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] up:active 2024-04-26T20:25:23.360 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:23 smithi098 ceph-mon[32591]: fsmap cephfs:5 7 up:standby 5 up:active 2024-04-26T20:25:23.360 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:23 smithi098 ceph-mon[32591]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-26T20:25:23.360 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:23 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:23.360 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:23 smithi098 ceph-mon[32591]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:23.360 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:23 smithi098 ceph-mon[32591]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:23.360 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:23 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1422767756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:23.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.386+0000 7ffb6bf91640 1 -- 172.21.15.70:0/743503071 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb64062d70 con 0x7ffb500a3c40 2024-04-26T20:25:23.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.394+0000 7ffb5affd640 1 -- 172.21.15.70:0/743503071 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258839 (secure 0 0 0) 0x7ffb64062d70 con 0x7ffb500a3c40 2024-04-26T20:25:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:23.399 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-04-26T20:25:23.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.397+0000 7ffb6bf91640 1 -- 172.21.15.70:0/743503071 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ffb500a3c40 msgr2=0x7ffb500a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.397+0000 7ffb6bf91640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ffb500a3c40 0x7ffb500a6100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009990 tx=0x7ffb60009110 comp rx=0 tx=0).stop 2024-04-26T20:25:23.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.397+0000 7ffb6bf91640 1 -- 172.21.15.70:0/743503071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb64108670 msgr2=0x7ffb641a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.397+0000 7ffb6bf91640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb64108670 0x7ffb641a0170 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009dc0 tx=0x7ffb5c003c20 comp rx=0 tx=0).stop 2024-04-26T20:25:23.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.398+0000 7ffb6bf91640 1 -- 172.21.15.70:0/743503071 shutdown_connections 2024-04-26T20:25:23.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.398+0000 7ffb6bf91640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ffb500a3c40 0x7ffb500a6100 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.398+0000 7ffb6bf91640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb64108670 0x7ffb641a0170 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.398+0000 7ffb6bf91640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb64105d40 0x7ffb64199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.398+0000 7ffb6bf91640 1 --2- 172.21.15.70:0/743503071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb64103410 0x7ffb64198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.398+0000 7ffb6bf91640 1 -- 172.21.15.70:0/743503071 >> 172.21.15.70:0/743503071 conn(0x7ffb640fce00 msgr2=0x7ffb64103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:23.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.398+0000 7ffb6bf91640 1 -- 172.21.15.70:0/743503071 shutdown_connections 2024-04-26T20:25:23.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.398+0000 7ffb6bf91640 1 -- 172.21.15.70:0/743503071 wait complete. 2024-04-26T20:25:23.410 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-04-26T20:25:21.778045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594116,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":274,"num_write_kb":2964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219,"ondisk_log_size":219,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368588,"kb_used_data":11044,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573236,"statfs":{"total":1151940427776,"available":1151562993664,"internally_reserved":0,"allocated":11309056,"data_stored":7052552,"data_compressed":108180,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3748,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.784392"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016443+0000","last_change":"2024-04-26T20:25:15.898926+0000","last_active":"2024-04-26T20:25:17.016443+0000","last_peered":"2024-04-26T20:25:17.016443+0000","last_clean":"2024-04-26T20:25:17.016443+0000","last_became_active":"2024-04-26T20:25:15.897656+0000","last_became_peered":"2024-04-26T20:25:15.897656+0000","last_unstale":"2024-04-26T20:25:17.016443+0000","last_undegraded":"2024-04-26T20:25:17.016443+0000","last_fullsized":"2024-04-26T20:25:17.016443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:39.483318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015794+0000","last_change":"2024-04-26T20:25:15.891362+0000","last_active":"2024-04-26T20:25:17.015794+0000","last_peered":"2024-04-26T20:25:17.015794+0000","last_clean":"2024-04-26T20:25:17.015794+0000","last_became_active":"2024-04-26T20:25:15.891038+0000","last_became_peered":"2024-04-26T20:25:15.891038+0000","last_unstale":"2024-04-26T20:25:17.015794+0000","last_undegraded":"2024-04-26T20:25:17.015794+0000","last_fullsized":"2024-04-26T20:25:17.015794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:12.286584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016003+0000","last_change":"2024-04-26T20:25:15.896964+0000","last_active":"2024-04-26T20:25:17.016003+0000","last_peered":"2024-04-26T20:25:17.016003+0000","last_clean":"2024-04-26T20:25:17.016003+0000","last_became_active":"2024-04-26T20:25:15.896645+0000","last_became_peered":"2024-04-26T20:25:15.896645+0000","last_unstale":"2024-04-26T20:25:17.016003+0000","last_undegraded":"2024-04-26T20:25:17.016003+0000","last_fullsized":"2024-04-26T20:25:17.016003+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:48.748913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.881068+0000","last_change":"2024-04-26T20:25:15.901504+0000","last_active":"2024-04-26T20:25:16.881068+0000","last_peered":"2024-04-26T20:25:16.881068+0000","last_clean":"2024-04-26T20:25:16.881068+0000","last_became_active":"2024-04-26T20:25:15.900563+0000","last_became_peered":"2024-04-26T20:25:15.900563+0000","last_unstale":"2024-04-26T20:25:16.881068+0000","last_undegraded":"2024-04-26T20:25:16.881068+0000","last_fullsized":"2024-04-26T20:25:16.881068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:58.102101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.006125+0000","last_change":"2024-04-26T20:25:15.888692+0000","last_active":"2024-04-26T20:25:17.006125+0000","last_peered":"2024-04-26T20:25:17.006125+0000","last_clean":"2024-04-26T20:25:17.006125+0000","last_became_active":"2024-04-26T20:25:15.888344+0000","last_became_peered":"2024-04-26T20:25:15.888344+0000","last_unstale":"2024-04-26T20:25:17.006125+0000","last_undegraded":"2024-04-26T20:25:17.006125+0000","last_fullsized":"2024-04-26T20:25:17.006125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:53.206291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.898997+0000","last_change":"2024-04-26T20:25:15.895663+0000","last_active":"2024-04-26T20:25:15.898997+0000","last_peered":"2024-04-26T20:25:15.898997+0000","last_clean":"2024-04-26T20:25:15.898997+0000","last_became_active":"2024-04-26T20:25:15.895353+0000","last_became_peered":"2024-04-26T20:25:15.895353+0000","last_unstale":"2024-04-26T20:25:15.898997+0000","last_undegraded":"2024-04-26T20:25:15.898997+0000","last_fullsized":"2024-04-26T20:25:15.898997+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:37.354303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016004+0000","last_change":"2024-04-26T20:25:15.894426+0000","last_active":"2024-04-26T20:25:17.016004+0000","last_peered":"2024-04-26T20:25:17.016004+0000","last_clean":"2024-04-26T20:25:17.016004+0000","last_became_active":"2024-04-26T20:25:15.891514+0000","last_became_peered":"2024-04-26T20:25:15.891514+0000","last_unstale":"2024-04-26T20:25:17.016004+0000","last_undegraded":"2024-04-26T20:25:17.016004+0000","last_fullsized":"2024-04-26T20:25:17.016004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:17.286109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.892124+0000","last_change":"2024-04-26T20:25:15.889342+0000","last_active":"2024-04-26T20:25:15.892124+0000","last_peered":"2024-04-26T20:25:15.892124+0000","last_clean":"2024-04-26T20:25:15.892124+0000","last_became_active":"2024-04-26T20:25:15.886829+0000","last_became_peered":"2024-04-26T20:25:15.886829+0000","last_unstale":"2024-04-26T20:25:15.892124+0000","last_undegraded":"2024-04-26T20:25:15.892124+0000","last_fullsized":"2024-04-26T20:25:15.892124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:13.050371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.017417+0000","last_change":"2024-04-26T20:25:15.893991+0000","last_active":"2024-04-26T20:25:17.017417+0000","last_peered":"2024-04-26T20:25:17.017417+0000","last_clean":"2024-04-26T20:25:17.017417+0000","last_became_active":"2024-04-26T20:25:15.893653+0000","last_became_peered":"2024-04-26T20:25:15.893653+0000","last_unstale":"2024-04-26T20:25:17.017417+0000","last_undegraded":"2024-04-26T20:25:17.017417+0000","last_fullsized":"2024-04-26T20:25:17.017417+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:46.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.899024+0000","last_change":"2024-04-26T20:25:15.897852+0000","last_active":"2024-04-26T20:25:15.899024+0000","last_peered":"2024-04-26T20:25:15.899024+0000","last_clean":"2024-04-26T20:25:15.899024+0000","last_became_active":"2024-04-26T20:25:15.897433+0000","last_became_peered":"2024-04-26T20:25:15.897433+0000","last_unstale":"2024-04-26T20:25:15.899024+0000","last_undegraded":"2024-04-26T20:25:15.899024+0000","last_fullsized":"2024-04-26T20:25:15.899024+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.014091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016830+0000","last_change":"2024-04-26T20:25:15.890189+0000","last_active":"2024-04-26T20:25:17.016830+0000","last_peered":"2024-04-26T20:25:17.016830+0000","last_clean":"2024-04-26T20:25:17.016830+0000","last_became_active":"2024-04-26T20:25:15.889695+0000","last_became_peered":"2024-04-26T20:25:15.889695+0000","last_unstale":"2024-04-26T20:25:17.016830+0000","last_undegraded":"2024-04-26T20:25:17.016830+0000","last_fullsized":"2024-04-26T20:25:17.016830+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:06.598687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.880957+0000","last_change":"2024-04-26T20:25:15.900906+0000","last_active":"2024-04-26T20:25:16.880957+0000","last_peered":"2024-04-26T20:25:16.880957+0000","last_clean":"2024-04-26T20:25:16.880957+0000","last_became_active":"2024-04-26T20:25:15.899689+0000","last_became_peered":"2024-04-26T20:25:15.899689+0000","last_unstale":"2024-04-26T20:25:16.880957+0000","last_undegraded":"2024-04-26T20:25:16.880957+0000","last_fullsized":"2024-04-26T20:25:16.880957+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:03.042267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015919+0000","last_change":"2024-04-26T20:25:15.887410+0000","last_active":"2024-04-26T20:25:17.015919+0000","last_peered":"2024-04-26T20:25:17.015919+0000","last_clean":"2024-04-26T20:25:17.015919+0000","last_became_active":"2024-04-26T20:25:15.887112+0000","last_became_peered":"2024-04-26T20:25:15.887112+0000","last_unstale":"2024-04-26T20:25:17.015919+0000","last_undegraded":"2024-04-26T20:25:17.015919+0000","last_fullsized":"2024-04-26T20:25:17.015919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:23.149512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015446+0000","last_change":"2024-04-26T20:25:15.891275+0000","last_active":"2024-04-26T20:25:17.015446+0000","last_peered":"2024-04-26T20:25:17.015446+0000","last_clean":"2024-04-26T20:25:17.015446+0000","last_became_active":"2024-04-26T20:25:15.890947+0000","last_became_peered":"2024-04-26T20:25:15.890947+0000","last_unstale":"2024-04-26T20:25:17.015446+0000","last_undegraded":"2024-04-26T20:25:17.015446+0000","last_fullsized":"2024-04-26T20:25:17.015446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:29.000821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015532+0000","last_change":"2024-04-26T20:25:15.900806+0000","last_active":"2024-04-26T20:25:17.015532+0000","last_peered":"2024-04-26T20:25:17.015532+0000","last_clean":"2024-04-26T20:25:17.015532+0000","last_became_active":"2024-04-26T20:25:15.900560+0000","last_became_peered":"2024-04-26T20:25:15.900560+0000","last_unstale":"2024-04-26T20:25:17.015532+0000","last_undegraded":"2024-04-26T20:25:17.015532+0000","last_fullsized":"2024-04-26T20:25:17.015532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:51:08.728607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016350+0000","last_change":"2024-04-26T20:25:15.890862+0000","last_active":"2024-04-26T20:25:17.016350+0000","last_peered":"2024-04-26T20:25:17.016350+0000","last_clean":"2024-04-26T20:25:17.016350+0000","last_became_active":"2024-04-26T20:25:15.890504+0000","last_became_peered":"2024-04-26T20:25:15.890504+0000","last_unstale":"2024-04-26T20:25:17.016350+0000","last_undegraded":"2024-04-26T20:25:17.016350+0000","last_fullsized":"2024-04-26T20:25:17.016350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:31.207826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016667+0000","last_change":"2024-04-26T20:25:15.902984+0000","last_active":"2024-04-26T20:25:17.016667+0000","last_peered":"2024-04-26T20:25:17.016667+0000","last_clean":"2024-04-26T20:25:17.016667+0000","last_became_active":"2024-04-26T20:25:15.902644+0000","last_became_peered":"2024-04-26T20:25:15.902644+0000","last_unstale":"2024-04-26T20:25:17.016667+0000","last_undegraded":"2024-04-26T20:25:17.016667+0000","last_fullsized":"2024-04-26T20:25:17.016667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:39.054035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.004064+0000","last_change":"2024-04-26T20:25:15.890139+0000","last_active":"2024-04-26T20:25:17.004064+0000","last_peered":"2024-04-26T20:25:17.004064+0000","last_clean":"2024-04-26T20:25:17.004064+0000","last_became_active":"2024-04-26T20:25:15.889800+0000","last_became_peered":"2024-04-26T20:25:15.889800+0000","last_unstale":"2024-04-26T20:25:17.004064+0000","last_undegraded":"2024-04-26T20:25:17.004064+0000","last_fullsized":"2024-04-26T20:25:17.004064+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:14.886217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016450+0000","last_change":"2024-04-26T20:25:15.885580+0000","last_active":"2024-04-26T20:25:17.016450+0000","last_peered":"2024-04-26T20:25:17.016450+0000","last_clean":"2024-04-26T20:25:17.016450+0000","last_became_active":"2024-04-26T20:25:15.884518+0000","last_became_peered":"2024-04-26T20:25:15.884518+0000","last_unstale":"2024-04-26T20:25:17.016450+0000","last_undegraded":"2024-04-26T20:25:17.016450+0000","last_fullsized":"2024-04-26T20:25:17.016450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:48:49.587462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'11","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:20.023223+0000","last_change":"2024-04-26T20:25:15.009552+0000","last_active":"2024-04-26T20:25:20.023223+0000","last_peered":"2024-04-26T20:25:20.023223+0000","last_clean":"2024-04-26T20:25:20.023223+0000","last_became_active":"2024-04-26T20:25:15.009176+0000","last_became_peered":"2024-04-26T20:25:15.009176+0000","last_unstale":"2024-04-26T20:25:20.023223+0000","last_undegraded":"2024-04-26T20:25:20.023223+0000","last_fullsized":"2024-04-26T20:25:20.023223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:20.740317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.891400+0000","last_change":"2024-04-26T20:25:15.890270+0000","last_active":"2024-04-26T20:25:15.891400+0000","last_peered":"2024-04-26T20:25:15.891400+0000","last_clean":"2024-04-26T20:25:15.891400+0000","last_became_active":"2024-04-26T20:25:15.887668+0000","last_became_peered":"2024-04-26T20:25:15.887668+0000","last_unstale":"2024-04-26T20:25:15.891400+0000","last_undegraded":"2024-04-26T20:25:15.891400+0000","last_fullsized":"2024-04-26T20:25:15.891400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:58.710413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.008102+0000","last_change":"2024-04-26T20:25:15.012133+0000","last_active":"2024-04-26T20:25:16.008102+0000","last_peered":"2024-04-26T20:25:16.008102+0000","last_clean":"2024-04-26T20:25:16.008102+0000","last_became_active":"2024-04-26T20:25:15.011820+0000","last_became_peered":"2024-04-26T20:25:15.011820+0000","last_unstale":"2024-04-26T20:25:16.008102+0000","last_undegraded":"2024-04-26T20:25:16.008102+0000","last_fullsized":"2024-04-26T20:25:16.008102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:36.634590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016013+0000","last_change":"2024-04-26T20:25:15.893941+0000","last_active":"2024-04-26T20:25:17.016013+0000","last_peered":"2024-04-26T20:25:17.016013+0000","last_clean":"2024-04-26T20:25:17.016013+0000","last_became_active":"2024-04-26T20:25:15.893616+0000","last_became_peered":"2024-04-26T20:25:15.893616+0000","last_unstale":"2024-04-26T20:25:17.016013+0000","last_undegraded":"2024-04-26T20:25:17.016013+0000","last_fullsized":"2024-04-26T20:25:17.016013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:57.893700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:20.025867+0000","last_change":"2024-04-26T20:25:15.011497+0000","last_active":"2024-04-26T20:25:20.025867+0000","last_peered":"2024-04-26T20:25:20.025867+0000","last_clean":"2024-04-26T20:25:20.025867+0000","last_became_active":"2024-04-26T20:25:15.011122+0000","last_became_peered":"2024-04-26T20:25:15.011122+0000","last_unstale":"2024-04-26T20:25:20.025867+0000","last_undegraded":"2024-04-26T20:25:20.025867+0000","last_fullsized":"2024-04-26T20:25:20.025867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:01.130321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016072+0000","last_change":"2024-04-26T20:25:15.892041+0000","last_active":"2024-04-26T20:25:17.016072+0000","last_peered":"2024-04-26T20:25:17.016072+0000","last_clean":"2024-04-26T20:25:17.016072+0000","last_became_active":"2024-04-26T20:25:15.891648+0000","last_became_peered":"2024-04-26T20:25:15.891648+0000","last_unstale":"2024-04-26T20:25:17.016072+0000","last_undegraded":"2024-04-26T20:25:17.016072+0000","last_fullsized":"2024-04-26T20:25:17.016072+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:05.729057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.006280+0000","last_change":"2024-04-26T20:25:15.005211+0000","last_active":"2024-04-26T20:25:17.006280+0000","last_peered":"2024-04-26T20:25:17.006280+0000","last_clean":"2024-04-26T20:25:17.006280+0000","last_became_active":"2024-04-26T20:25:15.004879+0000","last_became_peered":"2024-04-26T20:25:15.004879+0000","last_unstale":"2024-04-26T20:25:17.006280+0000","last_undegraded":"2024-04-26T20:25:17.006280+0000","last_fullsized":"2024-04-26T20:25:17.006280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:01.865953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.882359+0000","last_change":"2024-04-26T20:25:15.895878+0000","last_active":"2024-04-26T20:25:16.882359+0000","last_peered":"2024-04-26T20:25:16.882359+0000","last_clean":"2024-04-26T20:25:16.882359+0000","last_became_active":"2024-04-26T20:25:15.895491+0000","last_became_peered":"2024-04-26T20:25:15.895491+0000","last_unstale":"2024-04-26T20:25:16.882359+0000","last_undegraded":"2024-04-26T20:25:16.882359+0000","last_fullsized":"2024-04-26T20:25:16.882359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:41.370320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:18.001036+0000","last_change":"2024-04-26T20:25:15.013186+0000","last_active":"2024-04-26T20:25:18.001036+0000","last_peered":"2024-04-26T20:25:18.001036+0000","last_clean":"2024-04-26T20:25:18.001036+0000","last_became_active":"2024-04-26T20:25:15.012856+0000","last_became_peered":"2024-04-26T20:25:15.012856+0000","last_unstale":"2024-04-26T20:25:18.001036+0000","last_undegraded":"2024-04-26T20:25:18.001036+0000","last_fullsized":"2024-04-26T20:25:18.001036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:46.978954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.006074+0000","last_change":"2024-04-26T20:25:15.896234+0000","last_active":"2024-04-26T20:25:17.006074+0000","last_peered":"2024-04-26T20:25:17.006074+0000","last_clean":"2024-04-26T20:25:17.006074+0000","last_became_active":"2024-04-26T20:25:15.895661+0000","last_became_peered":"2024-04-26T20:25:15.895661+0000","last_unstale":"2024-04-26T20:25:17.006074+0000","last_undegraded":"2024-04-26T20:25:17.006074+0000","last_fullsized":"2024-04-26T20:25:17.006074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:44.716677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.007411+0000","last_change":"2024-04-26T20:25:15.004635+0000","last_active":"2024-04-26T20:25:16.007411+0000","last_peered":"2024-04-26T20:25:16.007411+0000","last_clean":"2024-04-26T20:25:16.007411+0000","last_became_active":"2024-04-26T20:25:15.004099+0000","last_became_peered":"2024-04-26T20:25:15.004099+0000","last_unstale":"2024-04-26T20:25:16.007411+0000","last_undegraded":"2024-04-26T20:25:16.007411+0000","last_fullsized":"2024-04-26T20:25:16.007411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:28.770212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.882578+0000","last_change":"2024-04-26T20:25:15.898180+0000","last_active":"2024-04-26T20:25:16.882578+0000","last_peered":"2024-04-26T20:25:16.882578+0000","last_clean":"2024-04-26T20:25:16.882578+0000","last_became_active":"2024-04-26T20:25:15.897631+0000","last_became_peered":"2024-04-26T20:25:15.897631+0000","last_unstale":"2024-04-26T20:25:16.882578+0000","last_undegraded":"2024-04-26T20:25:16.882578+0000","last_fullsized":"2024-04-26T20:25:16.882578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:17.936321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015439+0000","last_change":"2024-04-26T20:25:15.003966+0000","last_active":"2024-04-26T20:25:17.015439+0000","last_peered":"2024-04-26T20:25:17.015439+0000","last_clean":"2024-04-26T20:25:17.015439+0000","last_became_active":"2024-04-26T20:25:15.003611+0000","last_became_peered":"2024-04-26T20:25:15.003611+0000","last_unstale":"2024-04-26T20:25:17.015439+0000","last_undegraded":"2024-04-26T20:25:17.015439+0000","last_fullsized":"2024-04-26T20:25:17.015439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:46.494480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.893152+0000","last_change":"2024-04-26T20:25:15.892263+0000","last_active":"2024-04-26T20:25:15.893152+0000","last_peered":"2024-04-26T20:25:15.893152+0000","last_clean":"2024-04-26T20:25:15.893152+0000","last_became_active":"2024-04-26T20:25:15.891912+0000","last_became_peered":"2024-04-26T20:25:15.891912+0000","last_unstale":"2024-04-26T20:25:15.893152+0000","last_undegraded":"2024-04-26T20:25:15.893152+0000","last_fullsized":"2024-04-26T20:25:15.893152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:49:02.411947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.998503+0000","last_change":"2024-04-26T20:25:15.007227+0000","last_active":"2024-04-26T20:25:17.998503+0000","last_peered":"2024-04-26T20:25:17.998503+0000","last_clean":"2024-04-26T20:25:17.998503+0000","last_became_active":"2024-04-26T20:25:15.006901+0000","last_became_peered":"2024-04-26T20:25:15.006901+0000","last_unstale":"2024-04-26T20:25:17.998503+0000","last_undegraded":"2024-04-26T20:25:17.998503+0000","last_fullsized":"2024-04-26T20:25:17.998503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:55.391429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.004023+0000","last_change":"2024-04-26T20:25:15.887979+0000","last_active":"2024-04-26T20:25:17.004023+0000","last_peered":"2024-04-26T20:25:17.004023+0000","last_clean":"2024-04-26T20:25:17.004023+0000","last_became_active":"2024-04-26T20:25:15.887302+0000","last_became_peered":"2024-04-26T20:25:15.887302+0000","last_unstale":"2024-04-26T20:25:17.004023+0000","last_undegraded":"2024-04-26T20:25:17.004023+0000","last_fullsized":"2024-04-26T20:25:17.004023+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:41:08.662082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.880308+0000","last_change":"2024-04-26T20:25:15.005718+0000","last_active":"2024-04-26T20:25:15.880308+0000","last_peered":"2024-04-26T20:25:15.880308+0000","last_clean":"2024-04-26T20:25:15.880308+0000","last_became_active":"2024-04-26T20:25:15.005397+0000","last_became_peered":"2024-04-26T20:25:15.005397+0000","last_unstale":"2024-04-26T20:25:15.880308+0000","last_undegraded":"2024-04-26T20:25:15.880308+0000","last_fullsized":"2024-04-26T20:25:15.880308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:02.398788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.017480+0000","last_change":"2024-04-26T20:25:15.893214+0000","last_active":"2024-04-26T20:25:17.017480+0000","last_peered":"2024-04-26T20:25:17.017480+0000","last_clean":"2024-04-26T20:25:17.017480+0000","last_became_active":"2024-04-26T20:25:15.892615+0000","last_became_peered":"2024-04-26T20:25:15.892615+0000","last_unstale":"2024-04-26T20:25:17.017480+0000","last_undegraded":"2024-04-26T20:25:17.017480+0000","last_fullsized":"2024-04-26T20:25:17.017480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:51.940520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016819+0000","last_change":"2024-04-26T20:25:15.011667+0000","last_active":"2024-04-26T20:25:17.016819+0000","last_peered":"2024-04-26T20:25:17.016819+0000","last_clean":"2024-04-26T20:25:17.016819+0000","last_became_active":"2024-04-26T20:25:15.011315+0000","last_became_peered":"2024-04-26T20:25:15.011315+0000","last_unstale":"2024-04-26T20:25:17.016819+0000","last_undegraded":"2024-04-26T20:25:17.016819+0000","last_fullsized":"2024-04-26T20:25:17.016819+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:58.527548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015858+0000","last_change":"2024-04-26T20:25:15.900729+0000","last_active":"2024-04-26T20:25:17.015858+0000","last_peered":"2024-04-26T20:25:17.015858+0000","last_clean":"2024-04-26T20:25:17.015858+0000","last_became_active":"2024-04-26T20:25:15.900427+0000","last_became_peered":"2024-04-26T20:25:15.900427+0000","last_unstale":"2024-04-26T20:25:17.015858+0000","last_undegraded":"2024-04-26T20:25:17.015858+0000","last_fullsized":"2024-04-26T20:25:17.015858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:02.321351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.998347+0000","last_change":"2024-04-26T20:25:15.012186+0000","last_active":"2024-04-26T20:25:17.998347+0000","last_peered":"2024-04-26T20:25:17.998347+0000","last_clean":"2024-04-26T20:25:17.998347+0000","last_became_active":"2024-04-26T20:25:15.011853+0000","last_became_peered":"2024-04-26T20:25:15.011853+0000","last_unstale":"2024-04-26T20:25:17.998347+0000","last_undegraded":"2024-04-26T20:25:17.998347+0000","last_fullsized":"2024-04-26T20:25:17.998347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:33.893616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016754+0000","last_change":"2024-04-26T20:25:15.900656+0000","last_active":"2024-04-26T20:25:17.016754+0000","last_peered":"2024-04-26T20:25:17.016754+0000","last_clean":"2024-04-26T20:25:17.016754+0000","last_became_active":"2024-04-26T20:25:15.899663+0000","last_became_peered":"2024-04-26T20:25:15.899663+0000","last_unstale":"2024-04-26T20:25:17.016754+0000","last_undegraded":"2024-04-26T20:25:17.016754+0000","last_fullsized":"2024-04-26T20:25:17.016754+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:40.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.010538+0000","last_change":"2024-04-26T20:25:15.009991+0000","last_active":"2024-04-26T20:25:16.010538+0000","last_peered":"2024-04-26T20:25:16.010538+0000","last_clean":"2024-04-26T20:25:16.010538+0000","last_became_active":"2024-04-26T20:25:15.008562+0000","last_became_peered":"2024-04-26T20:25:15.008562+0000","last_unstale":"2024-04-26T20:25:16.010538+0000","last_undegraded":"2024-04-26T20:25:16.010538+0000","last_fullsized":"2024-04-26T20:25:16.010538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:42.120258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.006325+0000","last_change":"2024-04-26T20:25:15.892134+0000","last_active":"2024-04-26T20:25:17.006325+0000","last_peered":"2024-04-26T20:25:17.006325+0000","last_clean":"2024-04-26T20:25:17.006325+0000","last_became_active":"2024-04-26T20:25:15.890965+0000","last_became_peered":"2024-04-26T20:25:15.890965+0000","last_unstale":"2024-04-26T20:25:17.006325+0000","last_undegraded":"2024-04-26T20:25:17.006325+0000","last_fullsized":"2024-04-26T20:25:17.006325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:11.834642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016191+0000","last_change":"2024-04-26T20:25:15.006020+0000","last_active":"2024-04-26T20:25:17.016191+0000","last_peered":"2024-04-26T20:25:17.016191+0000","last_clean":"2024-04-26T20:25:17.016191+0000","last_became_active":"2024-04-26T20:25:15.005579+0000","last_became_peered":"2024-04-26T20:25:15.005579+0000","last_unstale":"2024-04-26T20:25:17.016191+0000","last_undegraded":"2024-04-26T20:25:17.016191+0000","last_fullsized":"2024-04-26T20:25:17.016191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:51.777497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015976+0000","last_change":"2024-04-26T20:25:15.888561+0000","last_active":"2024-04-26T20:25:17.015976+0000","last_peered":"2024-04-26T20:25:17.015976+0000","last_clean":"2024-04-26T20:25:17.015976+0000","last_became_active":"2024-04-26T20:25:15.888249+0000","last_became_peered":"2024-04-26T20:25:15.888249+0000","last_unstale":"2024-04-26T20:25:17.015976+0000","last_undegraded":"2024-04-26T20:25:17.015976+0000","last_fullsized":"2024-04-26T20:25:17.015976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:29.352406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.998149+0000","last_change":"2024-04-26T20:25:15.010139+0000","last_active":"2024-04-26T20:25:17.998149+0000","last_peered":"2024-04-26T20:25:17.998149+0000","last_clean":"2024-04-26T20:25:17.998149+0000","last_became_active":"2024-04-26T20:25:15.009826+0000","last_became_peered":"2024-04-26T20:25:15.009826+0000","last_unstale":"2024-04-26T20:25:17.998149+0000","last_undegraded":"2024-04-26T20:25:17.998149+0000","last_fullsized":"2024-04-26T20:25:17.998149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:31.801205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016424+0000","last_change":"2024-04-26T20:25:15.886316+0000","last_active":"2024-04-26T20:25:17.016424+0000","last_peered":"2024-04-26T20:25:17.016424+0000","last_clean":"2024-04-26T20:25:17.016424+0000","last_became_active":"2024-04-26T20:25:15.885983+0000","last_became_peered":"2024-04-26T20:25:15.885983+0000","last_unstale":"2024-04-26T20:25:17.016424+0000","last_undegraded":"2024-04-26T20:25:17.016424+0000","last_fullsized":"2024-04-26T20:25:17.016424+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:51.018655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.880527+0000","last_change":"2024-04-26T20:25:15.009046+0000","last_active":"2024-04-26T20:25:16.880527+0000","last_peered":"2024-04-26T20:25:16.880527+0000","last_clean":"2024-04-26T20:25:16.880527+0000","last_became_active":"2024-04-26T20:25:15.006321+0000","last_became_peered":"2024-04-26T20:25:15.006321+0000","last_unstale":"2024-04-26T20:25:16.880527+0000","last_undegraded":"2024-04-26T20:25:16.880527+0000","last_fullsized":"2024-04-26T20:25:16.880527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:30.993709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015924+0000","last_change":"2024-04-26T20:25:15.896722+0000","last_active":"2024-04-26T20:25:17.015924+0000","last_peered":"2024-04-26T20:25:17.015924+0000","last_clean":"2024-04-26T20:25:17.015924+0000","last_became_active":"2024-04-26T20:25:15.896377+0000","last_became_peered":"2024-04-26T20:25:15.896377+0000","last_unstale":"2024-04-26T20:25:17.015924+0000","last_undegraded":"2024-04-26T20:25:17.015924+0000","last_fullsized":"2024-04-26T20:25:17.015924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:39.899679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'16","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:19.018273+0000","last_change":"2024-04-26T20:25:15.016262+0000","last_active":"2024-04-26T20:25:19.018273+0000","last_peered":"2024-04-26T20:25:19.018273+0000","last_clean":"2024-04-26T20:25:19.018273+0000","last_became_active":"2024-04-26T20:25:15.015744+0000","last_became_peered":"2024-04-26T20:25:15.015744+0000","last_unstale":"2024-04-26T20:25:19.018273+0000","last_undegraded":"2024-04-26T20:25:19.018273+0000","last_fullsized":"2024-04-26T20:25:19.018273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:50.231250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.881943+0000","last_change":"2024-04-26T20:25:15.894702+0000","last_active":"2024-04-26T20:25:16.881943+0000","last_peered":"2024-04-26T20:25:16.881943+0000","last_clean":"2024-04-26T20:25:16.881943+0000","last_became_active":"2024-04-26T20:25:15.894338+0000","last_became_peered":"2024-04-26T20:25:15.894338+0000","last_unstale":"2024-04-26T20:25:16.881943+0000","last_undegraded":"2024-04-26T20:25:16.881943+0000","last_fullsized":"2024-04-26T20:25:16.881943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:01.515041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.006419+0000","last_change":"2024-04-26T20:25:15.011207+0000","last_active":"2024-04-26T20:25:17.006419+0000","last_peered":"2024-04-26T20:25:17.006419+0000","last_clean":"2024-04-26T20:25:17.006419+0000","last_became_active":"2024-04-26T20:25:15.010733+0000","last_became_peered":"2024-04-26T20:25:15.010733+0000","last_unstale":"2024-04-26T20:25:17.006419+0000","last_undegraded":"2024-04-26T20:25:17.006419+0000","last_fullsized":"2024-04-26T20:25:17.006419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:35.584041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016300+0000","last_change":"2024-04-26T20:25:15.896061+0000","last_active":"2024-04-26T20:25:17.016300+0000","last_peered":"2024-04-26T20:25:17.016300+0000","last_clean":"2024-04-26T20:25:17.016300+0000","last_became_active":"2024-04-26T20:25:15.895712+0000","last_became_peered":"2024-04-26T20:25:15.895712+0000","last_unstale":"2024-04-26T20:25:17.016300+0000","last_undegraded":"2024-04-26T20:25:17.016300+0000","last_fullsized":"2024-04-26T20:25:17.016300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.663831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.004025+0000","last_change":"2024-04-26T20:25:15.010300+0000","last_active":"2024-04-26T20:25:17.004025+0000","last_peered":"2024-04-26T20:25:17.004025+0000","last_clean":"2024-04-26T20:25:17.004025+0000","last_became_active":"2024-04-26T20:25:15.009999+0000","last_became_peered":"2024-04-26T20:25:15.009999+0000","last_unstale":"2024-04-26T20:25:17.004025+0000","last_undegraded":"2024-04-26T20:25:17.004025+0000","last_fullsized":"2024-04-26T20:25:17.004025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:07.394664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.889053+0000","last_change":"2024-04-26T20:25:15.888356+0000","last_active":"2024-04-26T20:25:15.889053+0000","last_peered":"2024-04-26T20:25:15.889053+0000","last_clean":"2024-04-26T20:25:15.889053+0000","last_became_active":"2024-04-26T20:25:15.888056+0000","last_became_peered":"2024-04-26T20:25:15.888056+0000","last_unstale":"2024-04-26T20:25:15.889053+0000","last_undegraded":"2024-04-26T20:25:15.889053+0000","last_fullsized":"2024-04-26T20:25:15.889053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:37.514179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016438+0000","last_change":"2024-04-26T20:25:15.008552+0000","last_active":"2024-04-26T20:25:17.016438+0000","last_peered":"2024-04-26T20:25:17.016438+0000","last_clean":"2024-04-26T20:25:17.016438+0000","last_became_active":"2024-04-26T20:25:15.008217+0000","last_became_peered":"2024-04-26T20:25:15.008217+0000","last_unstale":"2024-04-26T20:25:17.016438+0000","last_undegraded":"2024-04-26T20:25:17.016438+0000","last_fullsized":"2024-04-26T20:25:17.016438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:23.803674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.899097+0000","last_change":"2024-04-26T20:25:15.896655+0000","last_active":"2024-04-26T20:25:15.899097+0000","last_peered":"2024-04-26T20:25:15.899097+0000","last_clean":"2024-04-26T20:25:15.899097+0000","last_became_active":"2024-04-26T20:25:15.896335+0000","last_became_peered":"2024-04-26T20:25:15.896335+0000","last_unstale":"2024-04-26T20:25:15.899097+0000","last_undegraded":"2024-04-26T20:25:15.899097+0000","last_fullsized":"2024-04-26T20:25:15.899097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:34.198534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.882015+0000","last_change":"2024-04-26T20:25:15.901665+0000","last_active":"2024-04-26T20:25:16.882015+0000","last_peered":"2024-04-26T20:25:16.882015+0000","last_clean":"2024-04-26T20:25:16.882015+0000","last_became_active":"2024-04-26T20:25:15.901335+0000","last_became_peered":"2024-04-26T20:25:15.901335+0000","last_unstale":"2024-04-26T20:25:16.882015+0000","last_undegraded":"2024-04-26T20:25:16.882015+0000","last_fullsized":"2024-04-26T20:25:16.882015+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:11.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015290+0000","last_change":"2024-04-26T20:25:15.012015+0000","last_active":"2024-04-26T20:25:17.015290+0000","last_peered":"2024-04-26T20:25:17.015290+0000","last_clean":"2024-04-26T20:25:17.015290+0000","last_became_active":"2024-04-26T20:25:15.011705+0000","last_became_peered":"2024-04-26T20:25:15.011705+0000","last_unstale":"2024-04-26T20:25:17.015290+0000","last_undegraded":"2024-04-26T20:25:17.015290+0000","last_fullsized":"2024-04-26T20:25:17.015290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:10.213375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.885810+0000","last_change":"2024-04-26T20:25:15.885294+0000","last_active":"2024-04-26T20:25:15.885810+0000","last_peered":"2024-04-26T20:25:15.885810+0000","last_clean":"2024-04-26T20:25:15.885810+0000","last_became_active":"2024-04-26T20:25:15.884963+0000","last_became_peered":"2024-04-26T20:25:15.884963+0000","last_unstale":"2024-04-26T20:25:15.885810+0000","last_undegraded":"2024-04-26T20:25:15.885810+0000","last_fullsized":"2024-04-26T20:25:15.885810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:17.919770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.880741+0000","last_change":"2024-04-26T20:25:15.006101+0000","last_active":"2024-04-26T20:25:16.880741+0000","last_peered":"2024-04-26T20:25:16.880741+0000","last_clean":"2024-04-26T20:25:16.880741+0000","last_became_active":"2024-04-26T20:25:15.005566+0000","last_became_peered":"2024-04-26T20:25:15.005566+0000","last_unstale":"2024-04-26T20:25:16.880741+0000","last_undegraded":"2024-04-26T20:25:16.880741+0000","last_fullsized":"2024-04-26T20:25:16.880741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:15.392418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":350,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015902+0000","last_change":"2024-04-26T20:23:58.975689+0000","last_active":"2024-04-26T20:25:17.015902+0000","last_peered":"2024-04-26T20:25:17.015902+0000","last_clean":"2024-04-26T20:25:17.015902+0000","last_became_active":"2024-04-26T20:23:58.975250+0000","last_became_peered":"2024-04-26T20:23:58.975250+0000","last_unstale":"2024-04-26T20:25:17.015902+0000","last_undegraded":"2024-04-26T20:25:17.015902+0000","last_fullsized":"2024-04-26T20:25:17.015902+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:20:34.477920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:20:34.477920+0000","last_clean_scrub_stamp":"2024-04-26T20:20:34.477920+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:51.870155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015342+0000","last_change":"2024-04-26T20:25:15.895244+0000","last_active":"2024-04-26T20:25:17.015342+0000","last_peered":"2024-04-26T20:25:17.015342+0000","last_clean":"2024-04-26T20:25:17.015342+0000","last_became_active":"2024-04-26T20:25:15.894943+0000","last_became_peered":"2024-04-26T20:25:15.894943+0000","last_unstale":"2024-04-26T20:25:17.015342+0000","last_undegraded":"2024-04-26T20:25:17.015342+0000","last_fullsized":"2024-04-26T20:25:17.015342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:03.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016047+0000","last_change":"2024-04-26T20:25:15.013105+0000","last_active":"2024-04-26T20:25:17.016047+0000","last_peered":"2024-04-26T20:25:17.016047+0000","last_clean":"2024-04-26T20:25:17.016047+0000","last_became_active":"2024-04-26T20:25:15.012815+0000","last_became_peered":"2024-04-26T20:25:15.012815+0000","last_unstale":"2024-04-26T20:25:17.016047+0000","last_undegraded":"2024-04-26T20:25:17.016047+0000","last_fullsized":"2024-04-26T20:25:17.016047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:15.941868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:20.025226+0000","last_change":"2024-04-26T20:25:15.016081+0000","last_active":"2024-04-26T20:25:20.025226+0000","last_peered":"2024-04-26T20:25:20.025226+0000","last_clean":"2024-04-26T20:25:20.025226+0000","last_became_active":"2024-04-26T20:25:15.015766+0000","last_became_peered":"2024-04-26T20:25:15.015766+0000","last_unstale":"2024-04-26T20:25:20.025226+0000","last_undegraded":"2024-04-26T20:25:20.025226+0000","last_fullsized":"2024-04-26T20:25:20.025226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:21:56.377141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015890+0000","last_change":"2024-04-26T20:25:15.881988+0000","last_active":"2024-04-26T20:25:17.015890+0000","last_peered":"2024-04-26T20:25:17.015890+0000","last_clean":"2024-04-26T20:25:17.015890+0000","last_became_active":"2024-04-26T20:25:15.881615+0000","last_became_peered":"2024-04-26T20:25:15.881615+0000","last_unstale":"2024-04-26T20:25:17.015890+0000","last_undegraded":"2024-04-26T20:25:17.015890+0000","last_fullsized":"2024-04-26T20:25:17.015890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:24.511442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:20.024891+0000","last_change":"2024-04-26T20:25:15.005468+0000","last_active":"2024-04-26T20:25:20.024891+0000","last_peered":"2024-04-26T20:25:20.024891+0000","last_clean":"2024-04-26T20:25:20.024891+0000","last_became_active":"2024-04-26T20:25:15.005164+0000","last_became_peered":"2024-04-26T20:25:15.005164+0000","last_unstale":"2024-04-26T20:25:20.024891+0000","last_undegraded":"2024-04-26T20:25:20.024891+0000","last_fullsized":"2024-04-26T20:25:20.024891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:58.964128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.894138+0000","last_change":"2024-04-26T20:25:15.893298+0000","last_active":"2024-04-26T20:25:15.894138+0000","last_peered":"2024-04-26T20:25:15.894138+0000","last_clean":"2024-04-26T20:25:15.894138+0000","last_became_active":"2024-04-26T20:25:15.892981+0000","last_became_peered":"2024-04-26T20:25:15.892981+0000","last_unstale":"2024-04-26T20:25:15.894138+0000","last_undegraded":"2024-04-26T20:25:15.894138+0000","last_fullsized":"2024-04-26T20:25:15.894138+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:25.665985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.880918+0000","last_change":"2024-04-26T20:25:15.007962+0000","last_active":"2024-04-26T20:25:16.880918+0000","last_peered":"2024-04-26T20:25:16.880918+0000","last_clean":"2024-04-26T20:25:16.880918+0000","last_became_active":"2024-04-26T20:25:15.007592+0000","last_became_peered":"2024-04-26T20:25:15.007592+0000","last_unstale":"2024-04-26T20:25:16.880918+0000","last_undegraded":"2024-04-26T20:25:16.880918+0000","last_fullsized":"2024-04-26T20:25:16.880918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:26.364350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015954+0000","last_change":"2024-04-26T20:25:15.895272+0000","last_active":"2024-04-26T20:25:17.015954+0000","last_peered":"2024-04-26T20:25:17.015954+0000","last_clean":"2024-04-26T20:25:17.015954+0000","last_became_active":"2024-04-26T20:25:15.894962+0000","last_became_peered":"2024-04-26T20:25:15.894962+0000","last_unstale":"2024-04-26T20:25:17.015954+0000","last_undegraded":"2024-04-26T20:25:17.015954+0000","last_fullsized":"2024-04-26T20:25:17.015954+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:13.714365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.999014+0000","last_change":"2024-04-26T20:25:15.014580+0000","last_active":"2024-04-26T20:25:17.999014+0000","last_peered":"2024-04-26T20:25:17.999014+0000","last_clean":"2024-04-26T20:25:17.999014+0000","last_became_active":"2024-04-26T20:25:15.014320+0000","last_became_peered":"2024-04-26T20:25:15.014320+0000","last_unstale":"2024-04-26T20:25:17.999014+0000","last_undegraded":"2024-04-26T20:25:17.999014+0000","last_fullsized":"2024-04-26T20:25:17.999014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:43.689597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.005988+0000","last_change":"2024-04-26T20:25:15.891833+0000","last_active":"2024-04-26T20:25:17.005988+0000","last_peered":"2024-04-26T20:25:17.005988+0000","last_clean":"2024-04-26T20:25:17.005988+0000","last_became_active":"2024-04-26T20:25:15.891514+0000","last_became_peered":"2024-04-26T20:25:15.891514+0000","last_unstale":"2024-04-26T20:25:17.005988+0000","last_undegraded":"2024-04-26T20:25:17.005988+0000","last_fullsized":"2024-04-26T20:25:17.005988+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:16.673434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.878523+0000","last_change":"2024-04-26T20:25:15.006756+0000","last_active":"2024-04-26T20:25:15.878523+0000","last_peered":"2024-04-26T20:25:15.878523+0000","last_clean":"2024-04-26T20:25:15.878523+0000","last_became_active":"2024-04-26T20:25:15.006297+0000","last_became_peered":"2024-04-26T20:25:15.006297+0000","last_unstale":"2024-04-26T20:25:15.878523+0000","last_undegraded":"2024-04-26T20:25:15.878523+0000","last_fullsized":"2024-04-26T20:25:15.878523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:28.797708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015976+0000","last_change":"2024-04-26T20:25:15.891105+0000","last_active":"2024-04-26T20:25:17.015976+0000","last_peered":"2024-04-26T20:25:17.015976+0000","last_clean":"2024-04-26T20:25:17.015976+0000","last_became_active":"2024-04-26T20:25:15.890761+0000","last_became_peered":"2024-04-26T20:25:15.890761+0000","last_unstale":"2024-04-26T20:25:17.015976+0000","last_undegraded":"2024-04-26T20:25:17.015976+0000","last_fullsized":"2024-04-26T20:25:17.015976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:48.010351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015955+0000","last_change":"2024-04-26T20:25:15.009981+0000","last_active":"2024-04-26T20:25:17.015955+0000","last_peered":"2024-04-26T20:25:17.015955+0000","last_clean":"2024-04-26T20:25:17.015955+0000","last_became_active":"2024-04-26T20:25:15.009662+0000","last_became_peered":"2024-04-26T20:25:15.009662+0000","last_unstale":"2024-04-26T20:25:17.015955+0000","last_undegraded":"2024-04-26T20:25:17.015955+0000","last_fullsized":"2024-04-26T20:25:17.015955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:53.199823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.891401+0000","last_change":"2024-04-26T20:25:15.889831+0000","last_active":"2024-04-26T20:25:15.891401+0000","last_peered":"2024-04-26T20:25:15.891401+0000","last_clean":"2024-04-26T20:25:15.891401+0000","last_became_active":"2024-04-26T20:25:15.887421+0000","last_became_peered":"2024-04-26T20:25:15.887421+0000","last_unstale":"2024-04-26T20:25:15.891401+0000","last_undegraded":"2024-04-26T20:25:15.891401+0000","last_fullsized":"2024-04-26T20:25:15.891401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:42.899000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.998806+0000","last_change":"2024-04-26T20:25:15.007963+0000","last_active":"2024-04-26T20:25:17.998806+0000","last_peered":"2024-04-26T20:25:17.998806+0000","last_clean":"2024-04-26T20:25:17.998806+0000","last_became_active":"2024-04-26T20:25:15.007598+0000","last_became_peered":"2024-04-26T20:25:15.007598+0000","last_unstale":"2024-04-26T20:25:17.998806+0000","last_undegraded":"2024-04-26T20:25:17.998806+0000","last_fullsized":"2024-04-26T20:25:17.998806+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:31.490912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016611+0000","last_change":"2024-04-26T20:25:15.890349+0000","last_active":"2024-04-26T20:25:17.016611+0000","last_peered":"2024-04-26T20:25:17.016611+0000","last_clean":"2024-04-26T20:25:17.016611+0000","last_became_active":"2024-04-26T20:25:15.890022+0000","last_became_peered":"2024-04-26T20:25:15.890022+0000","last_unstale":"2024-04-26T20:25:17.016611+0000","last_undegraded":"2024-04-26T20:25:17.016611+0000","last_fullsized":"2024-04-26T20:25:17.016611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:41.283095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016122+0000","last_change":"2024-04-26T20:25:15.012522+0000","last_active":"2024-04-26T20:25:17.016122+0000","last_peered":"2024-04-26T20:25:17.016122+0000","last_clean":"2024-04-26T20:25:17.016122+0000","last_became_active":"2024-04-26T20:25:15.012157+0000","last_became_peered":"2024-04-26T20:25:15.012157+0000","last_unstale":"2024-04-26T20:25:17.016122+0000","last_undegraded":"2024-04-26T20:25:17.016122+0000","last_fullsized":"2024-04-26T20:25:17.016122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:54.598330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016842+0000","last_change":"2024-04-26T20:25:15.896016+0000","last_active":"2024-04-26T20:25:17.016842+0000","last_peered":"2024-04-26T20:25:17.016842+0000","last_clean":"2024-04-26T20:25:17.016842+0000","last_became_active":"2024-04-26T20:25:15.895467+0000","last_became_peered":"2024-04-26T20:25:15.895467+0000","last_unstale":"2024-04-26T20:25:17.016842+0000","last_undegraded":"2024-04-26T20:25:17.016842+0000","last_fullsized":"2024-04-26T20:25:17.016842+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:28.368634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.882057+0000","last_change":"2024-04-26T20:25:15.010645+0000","last_active":"2024-04-26T20:25:16.882057+0000","last_peered":"2024-04-26T20:25:16.882057+0000","last_clean":"2024-04-26T20:25:16.882057+0000","last_became_active":"2024-04-26T20:25:15.010337+0000","last_became_peered":"2024-04-26T20:25:15.010337+0000","last_unstale":"2024-04-26T20:25:16.882057+0000","last_undegraded":"2024-04-26T20:25:16.882057+0000","last_fullsized":"2024-04-26T20:25:16.882057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:40.081464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016699+0000","last_change":"2024-04-26T20:25:15.896806+0000","last_active":"2024-04-26T20:25:17.016699+0000","last_peered":"2024-04-26T20:25:17.016699+0000","last_clean":"2024-04-26T20:25:17.016699+0000","last_became_active":"2024-04-26T20:25:15.896459+0000","last_became_peered":"2024-04-26T20:25:15.896459+0000","last_unstale":"2024-04-26T20:25:17.016699+0000","last_undegraded":"2024-04-26T20:25:17.016699+0000","last_fullsized":"2024-04-26T20:25:17.016699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:25.407874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015629+0000","last_change":"2024-04-26T20:25:15.013291+0000","last_active":"2024-04-26T20:25:17.015629+0000","last_peered":"2024-04-26T20:25:17.015629+0000","last_clean":"2024-04-26T20:25:17.015629+0000","last_became_active":"2024-04-26T20:25:15.012442+0000","last_became_peered":"2024-04-26T20:25:15.012442+0000","last_unstale":"2024-04-26T20:25:17.015629+0000","last_undegraded":"2024-04-26T20:25:17.015629+0000","last_fullsized":"2024-04-26T20:25:17.015629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:56.913314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.017146+0000","last_change":"2024-04-26T20:25:15.897364+0000","last_active":"2024-04-26T20:25:17.017146+0000","last_peered":"2024-04-26T20:25:17.017146+0000","last_clean":"2024-04-26T20:25:17.017146+0000","last_became_active":"2024-04-26T20:25:15.895699+0000","last_became_peered":"2024-04-26T20:25:15.895699+0000","last_unstale":"2024-04-26T20:25:17.017146+0000","last_undegraded":"2024-04-26T20:25:17.017146+0000","last_fullsized":"2024-04-26T20:25:17.017146+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:49.507200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016162+0000","last_change":"2024-04-26T20:25:15.895932+0000","last_active":"2024-04-26T20:25:17.016162+0000","last_peered":"2024-04-26T20:25:17.016162+0000","last_clean":"2024-04-26T20:25:17.016162+0000","last_became_active":"2024-04-26T20:25:15.895583+0000","last_became_peered":"2024-04-26T20:25:15.895583+0000","last_unstale":"2024-04-26T20:25:17.016162+0000","last_undegraded":"2024-04-26T20:25:17.016162+0000","last_fullsized":"2024-04-26T20:25:17.016162+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:24.865728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015974+0000","last_change":"2024-04-26T20:25:15.899267+0000","last_active":"2024-04-26T20:25:17.015974+0000","last_peered":"2024-04-26T20:25:17.015974+0000","last_clean":"2024-04-26T20:25:17.015974+0000","last_became_active":"2024-04-26T20:25:15.898841+0000","last_became_peered":"2024-04-26T20:25:15.898841+0000","last_unstale":"2024-04-26T20:25:17.015974+0000","last_undegraded":"2024-04-26T20:25:17.015974+0000","last_fullsized":"2024-04-26T20:25:17.015974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:28.448452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015843+0000","last_change":"2024-04-26T20:25:15.886667+0000","last_active":"2024-04-26T20:25:17.015843+0000","last_peered":"2024-04-26T20:25:17.015843+0000","last_clean":"2024-04-26T20:25:17.015843+0000","last_became_active":"2024-04-26T20:25:15.886338+0000","last_became_peered":"2024-04-26T20:25:15.886338+0000","last_unstale":"2024-04-26T20:25:17.015843+0000","last_undegraded":"2024-04-26T20:25:17.015843+0000","last_fullsized":"2024-04-26T20:25:17.015843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:20.666594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015726+0000","last_change":"2024-04-26T20:25:15.895551+0000","last_active":"2024-04-26T20:25:17.015726+0000","last_peered":"2024-04-26T20:25:17.015726+0000","last_clean":"2024-04-26T20:25:17.015726+0000","last_became_active":"2024-04-26T20:25:15.895129+0000","last_became_peered":"2024-04-26T20:25:15.895129+0000","last_unstale":"2024-04-26T20:25:17.015726+0000","last_undegraded":"2024-04-26T20:25:17.015726+0000","last_fullsized":"2024-04-26T20:25:17.015726+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.959022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016022+0000","last_change":"2024-04-26T20:25:15.895286+0000","last_active":"2024-04-26T20:25:17.016022+0000","last_peered":"2024-04-26T20:25:17.016022+0000","last_clean":"2024-04-26T20:25:17.016022+0000","last_became_active":"2024-04-26T20:25:15.894954+0000","last_became_peered":"2024-04-26T20:25:15.894954+0000","last_unstale":"2024-04-26T20:25:17.016022+0000","last_undegraded":"2024-04-26T20:25:17.016022+0000","last_fullsized":"2024-04-26T20:25:17.016022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:02.805037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016496+0000","last_change":"2024-04-26T20:25:15.896824+0000","last_active":"2024-04-26T20:25:17.016496+0000","last_peered":"2024-04-26T20:25:17.016496+0000","last_clean":"2024-04-26T20:25:17.016496+0000","last_became_active":"2024-04-26T20:25:15.896337+0000","last_became_peered":"2024-04-26T20:25:15.896337+0000","last_unstale":"2024-04-26T20:25:17.016496+0000","last_undegraded":"2024-04-26T20:25:17.016496+0000","last_fullsized":"2024-04-26T20:25:17.016496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:31.105915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016385+0000","last_change":"2024-04-26T20:25:15.890207+0000","last_active":"2024-04-26T20:25:17.016385+0000","last_peered":"2024-04-26T20:25:17.016385+0000","last_clean":"2024-04-26T20:25:17.016385+0000","last_became_active":"2024-04-26T20:25:15.889890+0000","last_became_peered":"2024-04-26T20:25:15.889890+0000","last_unstale":"2024-04-26T20:25:17.016385+0000","last_undegraded":"2024-04-26T20:25:17.016385+0000","last_fullsized":"2024-04-26T20:25:17.016385+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:44.562779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.898009+0000","last_change":"2024-04-26T20:25:15.897407+0000","last_active":"2024-04-26T20:25:15.898009+0000","last_peered":"2024-04-26T20:25:15.898009+0000","last_clean":"2024-04-26T20:25:15.898009+0000","last_became_active":"2024-04-26T20:25:15.897076+0000","last_became_peered":"2024-04-26T20:25:15.897076+0000","last_unstale":"2024-04-26T20:25:15.898009+0000","last_undegraded":"2024-04-26T20:25:15.898009+0000","last_fullsized":"2024-04-26T20:25:15.898009+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:48.063282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.881900+0000","last_change":"2024-04-26T20:25:15.895097+0000","last_active":"2024-04-26T20:25:16.881900+0000","last_peered":"2024-04-26T20:25:16.881900+0000","last_clean":"2024-04-26T20:25:16.881900+0000","last_became_active":"2024-04-26T20:25:15.894647+0000","last_became_peered":"2024-04-26T20:25:15.894647+0000","last_unstale":"2024-04-26T20:25:16.881900+0000","last_undegraded":"2024-04-26T20:25:16.881900+0000","last_fullsized":"2024-04-26T20:25:16.881900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:48.651323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.886575+0000","last_change":"2024-04-26T20:25:15.886174+0000","last_active":"2024-04-26T20:25:15.886575+0000","last_peered":"2024-04-26T20:25:15.886575+0000","last_clean":"2024-04-26T20:25:15.886575+0000","last_became_active":"2024-04-26T20:25:15.885869+0000","last_became_peered":"2024-04-26T20:25:15.885869+0000","last_unstale":"2024-04-26T20:25:15.886575+0000","last_undegraded":"2024-04-26T20:25:15.886575+0000","last_fullsized":"2024-04-26T20:25:15.886575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:31.393136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016422+0000","last_change":"2024-04-26T20:25:15.888377+0000","last_active":"2024-04-26T20:25:17.016422+0000","last_peered":"2024-04-26T20:25:17.016422+0000","last_clean":"2024-04-26T20:25:17.016422+0000","last_became_active":"2024-04-26T20:25:15.888042+0000","last_became_peered":"2024-04-26T20:25:15.888042+0000","last_unstale":"2024-04-26T20:25:17.016422+0000","last_undegraded":"2024-04-26T20:25:17.016422+0000","last_fullsized":"2024-04-26T20:25:17.016422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.922321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015830+0000","last_change":"2024-04-26T20:25:15.887255+0000","last_active":"2024-04-26T20:25:17.015830+0000","last_peered":"2024-04-26T20:25:17.015830+0000","last_clean":"2024-04-26T20:25:17.015830+0000","last_became_active":"2024-04-26T20:25:15.886936+0000","last_became_peered":"2024-04-26T20:25:15.886936+0000","last_unstale":"2024-04-26T20:25:17.015830+0000","last_undegraded":"2024-04-26T20:25:17.015830+0000","last_fullsized":"2024-04-26T20:25:17.015830+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:54.135181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015998+0000","last_change":"2024-04-26T20:25:15.893371+0000","last_active":"2024-04-26T20:25:17.015998+0000","last_peered":"2024-04-26T20:25:17.015998+0000","last_clean":"2024-04-26T20:25:17.015998+0000","last_became_active":"2024-04-26T20:25:15.892490+0000","last_became_peered":"2024-04-26T20:25:15.892490+0000","last_unstale":"2024-04-26T20:25:17.015998+0000","last_undegraded":"2024-04-26T20:25:17.015998+0000","last_fullsized":"2024-04-26T20:25:17.015998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:39.337577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":211446,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3748,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":10372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":441572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":983040,"data_stored":1025176,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776153,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":442480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037790,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":442310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299426,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":1032522,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462952,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":909312,"data_stored":433002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":443184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":442266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":937984,"data_stored":443218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149750,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":433106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888114,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":441594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724589,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":1032122,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:25:23.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:25:23.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:23 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] up:active 2024-04-26T20:25:23.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:23 smithi080 ceph-mon[32278]: fsmap cephfs:5 7 up:standby 5 up:active 2024-04-26T20:25:23.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:23 smithi080 ceph-mon[32278]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-26T20:25:23.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:23 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:23.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:23 smithi080 ceph-mon[32278]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:23.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:23 smithi080 ceph-mon[32278]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:25:23.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:23 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1422767756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:23.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1284912367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b58101890 msgr2=0x7f1b58101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 --2- 172.21.15.70:0/1284912367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b58101890 0x7f1b58101cb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009900 tx=0x7f1b4c02a410 comp rx=0 tx=0).stop 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1284912367 shutdown_connections 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 --2- 172.21.15.70:0/1284912367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b58103440 0x7f1b58109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 --2- 172.21.15.70:0/1284912367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b58102a80 0x7f1b58102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 --2- 172.21.15.70:0/1284912367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b58101890 0x7f1b58101cb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1284912367 >> 172.21.15.70:0/1284912367 conn(0x7f1b580fce00 msgr2=0x7f1b580ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1284912367 shutdown_connections 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1284912367 wait complete. 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 Processor -- start 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 -- start start 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b58101890 0x7f1b58198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b58102a80 0x7f1b581991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b58103440 0x7f1b581a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5810d4f0 con 0x7f1b58102a80 2024-04-26T20:25:23.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5810d370 con 0x7f1b58103440 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.560+0000 7f1b5ebbd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5810d670 con 0x7f1b58101890 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b57fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b58102a80 0x7f1b581991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b57fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b58102a80 0x7f1b581991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58348/0 (socket says 172.21.15.70:58348) 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b57fff640 1 -- 172.21.15.70:0/1702099447 learned_addr learned my addr 172.21.15.70:0/1702099447 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b5c959640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b58101890 0x7f1b58198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b5d15a640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b58103440 0x7f1b581a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b57fff640 1 -- 172.21.15.70:0/1702099447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b58101890 msgr2=0x7f1b58198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b57fff640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b58101890 0x7f1b58198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b57fff640 1 -- 172.21.15.70:0/1702099447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b58103440 msgr2=0x7f1b581a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b57fff640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b58103440 0x7f1b581a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b57fff640 1 -- 172.21.15.70:0/1702099447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b581a08c0 con 0x7f1b58102a80 2024-04-26T20:25:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b57fff640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b58102a80 0x7f1b581991c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400d950 tx=0x7f1b4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b55ffb640 1 -- 172.21.15.70:0/1702099447 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b44017030 con 0x7f1b58102a80 2024-04-26T20:25:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1702099447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b581a0bb0 con 0x7f1b58102a80 2024-04-26T20:25:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b55ffb640 1 -- 172.21.15.70:0/1702099447 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1b44004020 con 0x7f1b58102a80 2024-04-26T20:25:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b55ffb640 1 -- 172.21.15.70:0/1702099447 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b440047a0 con 0x7f1b58102a80 2024-04-26T20:25:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.561+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1702099447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b581a1150 con 0x7f1b58102a80 2024-04-26T20:25:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.562+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1702099447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b581a1380 con 0x7f1b58102a80 2024-04-26T20:25:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.563+0000 7f1b55ffb640 1 -- 172.21.15.70:0/1702099447 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1b440041d0 con 0x7f1b58102a80 2024-04-26T20:25:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.564+0000 7f1b55ffb640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b480a3c40 0x7f1b480a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.564+0000 7f1b5c959640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b480a3c40 0x7f1b480a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.564+0000 7f1b55ffb640 1 -- 172.21.15.70:0/1702099447 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f1b440cfef0 con 0x7f1b58102a80 2024-04-26T20:25:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.564+0000 7f1b5c959640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b480a3c40 0x7f1b480a6100 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b58199b50 tx=0x7f1b4c031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:23.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.573+0000 7f1b55ffb640 1 -- 172.21.15.70:0/1702099447 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1b4409c820 con 0x7f1b58102a80 2024-04-26T20:25:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.750+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1702099447 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b581a1550 con 0x7f1b480a3c40 2024-04-26T20:25:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.758+0000 7f1b55ffb640 1 -- 172.21.15.70:0/1702099447 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258839 (secure 0 0 0) 0x7f1b581a1550 con 0x7f1b480a3c40 2024-04-26T20:25:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-04-26T20:25:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1702099447 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b480a3c40 msgr2=0x7f1b480a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b480a3c40 0x7f1b480a6100 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b58199b50 tx=0x7f1b4c031510 comp rx=0 tx=0).stop 2024-04-26T20:25:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1702099447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b58102a80 msgr2=0x7f1b581991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b58102a80 0x7f1b581991c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400d950 tx=0x7f1b4400de10 comp rx=0 tx=0).stop 2024-04-26T20:25:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1702099447 shutdown_connections 2024-04-26T20:25:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f1b480a3c40 0x7f1b480a6100 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b58103440 0x7f1b581a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b58102a80 0x7f1b581991c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 --2- 172.21.15.70:0/1702099447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b58101890 0x7f1b58198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1702099447 >> 172.21.15.70:0/1702099447 conn(0x7f1b580fce00 msgr2=0x7f1b580fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:23.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1702099447 shutdown_connections 2024-04-26T20:25:23.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:23.761+0000 7f1b5ebbd640 1 -- 172.21.15.70:0/1702099447 wait complete. 2024-04-26T20:25:23.773 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-04-26T20:25:21.778045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594116,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":274,"num_write_kb":2964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219,"ondisk_log_size":219,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368588,"kb_used_data":11044,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573236,"statfs":{"total":1151940427776,"available":1151562993664,"internally_reserved":0,"allocated":11309056,"data_stored":7052552,"data_compressed":108180,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3748,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.784392"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016443+0000","last_change":"2024-04-26T20:25:15.898926+0000","last_active":"2024-04-26T20:25:17.016443+0000","last_peered":"2024-04-26T20:25:17.016443+0000","last_clean":"2024-04-26T20:25:17.016443+0000","last_became_active":"2024-04-26T20:25:15.897656+0000","last_became_peered":"2024-04-26T20:25:15.897656+0000","last_unstale":"2024-04-26T20:25:17.016443+0000","last_undegraded":"2024-04-26T20:25:17.016443+0000","last_fullsized":"2024-04-26T20:25:17.016443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:39.483318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015794+0000","last_change":"2024-04-26T20:25:15.891362+0000","last_active":"2024-04-26T20:25:17.015794+0000","last_peered":"2024-04-26T20:25:17.015794+0000","last_clean":"2024-04-26T20:25:17.015794+0000","last_became_active":"2024-04-26T20:25:15.891038+0000","last_became_peered":"2024-04-26T20:25:15.891038+0000","last_unstale":"2024-04-26T20:25:17.015794+0000","last_undegraded":"2024-04-26T20:25:17.015794+0000","last_fullsized":"2024-04-26T20:25:17.015794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:12.286584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016003+0000","last_change":"2024-04-26T20:25:15.896964+0000","last_active":"2024-04-26T20:25:17.016003+0000","last_peered":"2024-04-26T20:25:17.016003+0000","last_clean":"2024-04-26T20:25:17.016003+0000","last_became_active":"2024-04-26T20:25:15.896645+0000","last_became_peered":"2024-04-26T20:25:15.896645+0000","last_unstale":"2024-04-26T20:25:17.016003+0000","last_undegraded":"2024-04-26T20:25:17.016003+0000","last_fullsized":"2024-04-26T20:25:17.016003+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:48.748913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.881068+0000","last_change":"2024-04-26T20:25:15.901504+0000","last_active":"2024-04-26T20:25:16.881068+0000","last_peered":"2024-04-26T20:25:16.881068+0000","last_clean":"2024-04-26T20:25:16.881068+0000","last_became_active":"2024-04-26T20:25:15.900563+0000","last_became_peered":"2024-04-26T20:25:15.900563+0000","last_unstale":"2024-04-26T20:25:16.881068+0000","last_undegraded":"2024-04-26T20:25:16.881068+0000","last_fullsized":"2024-04-26T20:25:16.881068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:58.102101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.006125+0000","last_change":"2024-04-26T20:25:15.888692+0000","last_active":"2024-04-26T20:25:17.006125+0000","last_peered":"2024-04-26T20:25:17.006125+0000","last_clean":"2024-04-26T20:25:17.006125+0000","last_became_active":"2024-04-26T20:25:15.888344+0000","last_became_peered":"2024-04-26T20:25:15.888344+0000","last_unstale":"2024-04-26T20:25:17.006125+0000","last_undegraded":"2024-04-26T20:25:17.006125+0000","last_fullsized":"2024-04-26T20:25:17.006125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:53.206291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.898997+0000","last_change":"2024-04-26T20:25:15.895663+0000","last_active":"2024-04-26T20:25:15.898997+0000","last_peered":"2024-04-26T20:25:15.898997+0000","last_clean":"2024-04-26T20:25:15.898997+0000","last_became_active":"2024-04-26T20:25:15.895353+0000","last_became_peered":"2024-04-26T20:25:15.895353+0000","last_unstale":"2024-04-26T20:25:15.898997+0000","last_undegraded":"2024-04-26T20:25:15.898997+0000","last_fullsized":"2024-04-26T20:25:15.898997+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:37.354303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016004+0000","last_change":"2024-04-26T20:25:15.894426+0000","last_active":"2024-04-26T20:25:17.016004+0000","last_peered":"2024-04-26T20:25:17.016004+0000","last_clean":"2024-04-26T20:25:17.016004+0000","last_became_active":"2024-04-26T20:25:15.891514+0000","last_became_peered":"2024-04-26T20:25:15.891514+0000","last_unstale":"2024-04-26T20:25:17.016004+0000","last_undegraded":"2024-04-26T20:25:17.016004+0000","last_fullsized":"2024-04-26T20:25:17.016004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:17.286109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.892124+0000","last_change":"2024-04-26T20:25:15.889342+0000","last_active":"2024-04-26T20:25:15.892124+0000","last_peered":"2024-04-26T20:25:15.892124+0000","last_clean":"2024-04-26T20:25:15.892124+0000","last_became_active":"2024-04-26T20:25:15.886829+0000","last_became_peered":"2024-04-26T20:25:15.886829+0000","last_unstale":"2024-04-26T20:25:15.892124+0000","last_undegraded":"2024-04-26T20:25:15.892124+0000","last_fullsized":"2024-04-26T20:25:15.892124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:13.050371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.017417+0000","last_change":"2024-04-26T20:25:15.893991+0000","last_active":"2024-04-26T20:25:17.017417+0000","last_peered":"2024-04-26T20:25:17.017417+0000","last_clean":"2024-04-26T20:25:17.017417+0000","last_became_active":"2024-04-26T20:25:15.893653+0000","last_became_peered":"2024-04-26T20:25:15.893653+0000","last_unstale":"2024-04-26T20:25:17.017417+0000","last_undegraded":"2024-04-26T20:25:17.017417+0000","last_fullsized":"2024-04-26T20:25:17.017417+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:46.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.899024+0000","last_change":"2024-04-26T20:25:15.897852+0000","last_active":"2024-04-26T20:25:15.899024+0000","last_peered":"2024-04-26T20:25:15.899024+0000","last_clean":"2024-04-26T20:25:15.899024+0000","last_became_active":"2024-04-26T20:25:15.897433+0000","last_became_peered":"2024-04-26T20:25:15.897433+0000","last_unstale":"2024-04-26T20:25:15.899024+0000","last_undegraded":"2024-04-26T20:25:15.899024+0000","last_fullsized":"2024-04-26T20:25:15.899024+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.014091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016830+0000","last_change":"2024-04-26T20:25:15.890189+0000","last_active":"2024-04-26T20:25:17.016830+0000","last_peered":"2024-04-26T20:25:17.016830+0000","last_clean":"2024-04-26T20:25:17.016830+0000","last_became_active":"2024-04-26T20:25:15.889695+0000","last_became_peered":"2024-04-26T20:25:15.889695+0000","last_unstale":"2024-04-26T20:25:17.016830+0000","last_undegraded":"2024-04-26T20:25:17.016830+0000","last_fullsized":"2024-04-26T20:25:17.016830+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:06.598687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.880957+0000","last_change":"2024-04-26T20:25:15.900906+0000","last_active":"2024-04-26T20:25:16.880957+0000","last_peered":"2024-04-26T20:25:16.880957+0000","last_clean":"2024-04-26T20:25:16.880957+0000","last_became_active":"2024-04-26T20:25:15.899689+0000","last_became_peered":"2024-04-26T20:25:15.899689+0000","last_unstale":"2024-04-26T20:25:16.880957+0000","last_undegraded":"2024-04-26T20:25:16.880957+0000","last_fullsized":"2024-04-26T20:25:16.880957+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:03.042267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015919+0000","last_change":"2024-04-26T20:25:15.887410+0000","last_active":"2024-04-26T20:25:17.015919+0000","last_peered":"2024-04-26T20:25:17.015919+0000","last_clean":"2024-04-26T20:25:17.015919+0000","last_became_active":"2024-04-26T20:25:15.887112+0000","last_became_peered":"2024-04-26T20:25:15.887112+0000","last_unstale":"2024-04-26T20:25:17.015919+0000","last_undegraded":"2024-04-26T20:25:17.015919+0000","last_fullsized":"2024-04-26T20:25:17.015919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:23.149512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015446+0000","last_change":"2024-04-26T20:25:15.891275+0000","last_active":"2024-04-26T20:25:17.015446+0000","last_peered":"2024-04-26T20:25:17.015446+0000","last_clean":"2024-04-26T20:25:17.015446+0000","last_became_active":"2024-04-26T20:25:15.890947+0000","last_became_peered":"2024-04-26T20:25:15.890947+0000","last_unstale":"2024-04-26T20:25:17.015446+0000","last_undegraded":"2024-04-26T20:25:17.015446+0000","last_fullsized":"2024-04-26T20:25:17.015446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:29.000821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015532+0000","last_change":"2024-04-26T20:25:15.900806+0000","last_active":"2024-04-26T20:25:17.015532+0000","last_peered":"2024-04-26T20:25:17.015532+0000","last_clean":"2024-04-26T20:25:17.015532+0000","last_became_active":"2024-04-26T20:25:15.900560+0000","last_became_peered":"2024-04-26T20:25:15.900560+0000","last_unstale":"2024-04-26T20:25:17.015532+0000","last_undegraded":"2024-04-26T20:25:17.015532+0000","last_fullsized":"2024-04-26T20:25:17.015532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:51:08.728607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016350+0000","last_change":"2024-04-26T20:25:15.890862+0000","last_active":"2024-04-26T20:25:17.016350+0000","last_peered":"2024-04-26T20:25:17.016350+0000","last_clean":"2024-04-26T20:25:17.016350+0000","last_became_active":"2024-04-26T20:25:15.890504+0000","last_became_peered":"2024-04-26T20:25:15.890504+0000","last_unstale":"2024-04-26T20:25:17.016350+0000","last_undegraded":"2024-04-26T20:25:17.016350+0000","last_fullsized":"2024-04-26T20:25:17.016350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:31.207826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016667+0000","last_change":"2024-04-26T20:25:15.902984+0000","last_active":"2024-04-26T20:25:17.016667+0000","last_peered":"2024-04-26T20:25:17.016667+0000","last_clean":"2024-04-26T20:25:17.016667+0000","last_became_active":"2024-04-26T20:25:15.902644+0000","last_became_peered":"2024-04-26T20:25:15.902644+0000","last_unstale":"2024-04-26T20:25:17.016667+0000","last_undegraded":"2024-04-26T20:25:17.016667+0000","last_fullsized":"2024-04-26T20:25:17.016667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:39.054035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.004064+0000","last_change":"2024-04-26T20:25:15.890139+0000","last_active":"2024-04-26T20:25:17.004064+0000","last_peered":"2024-04-26T20:25:17.004064+0000","last_clean":"2024-04-26T20:25:17.004064+0000","last_became_active":"2024-04-26T20:25:15.889800+0000","last_became_peered":"2024-04-26T20:25:15.889800+0000","last_unstale":"2024-04-26T20:25:17.004064+0000","last_undegraded":"2024-04-26T20:25:17.004064+0000","last_fullsized":"2024-04-26T20:25:17.004064+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:14.886217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016450+0000","last_change":"2024-04-26T20:25:15.885580+0000","last_active":"2024-04-26T20:25:17.016450+0000","last_peered":"2024-04-26T20:25:17.016450+0000","last_clean":"2024-04-26T20:25:17.016450+0000","last_became_active":"2024-04-26T20:25:15.884518+0000","last_became_peered":"2024-04-26T20:25:15.884518+0000","last_unstale":"2024-04-26T20:25:17.016450+0000","last_undegraded":"2024-04-26T20:25:17.016450+0000","last_fullsized":"2024-04-26T20:25:17.016450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:48:49.587462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'11","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:20.023223+0000","last_change":"2024-04-26T20:25:15.009552+0000","last_active":"2024-04-26T20:25:20.023223+0000","last_peered":"2024-04-26T20:25:20.023223+0000","last_clean":"2024-04-26T20:25:20.023223+0000","last_became_active":"2024-04-26T20:25:15.009176+0000","last_became_peered":"2024-04-26T20:25:15.009176+0000","last_unstale":"2024-04-26T20:25:20.023223+0000","last_undegraded":"2024-04-26T20:25:20.023223+0000","last_fullsized":"2024-04-26T20:25:20.023223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:20.740317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.891400+0000","last_change":"2024-04-26T20:25:15.890270+0000","last_active":"2024-04-26T20:25:15.891400+0000","last_peered":"2024-04-26T20:25:15.891400+0000","last_clean":"2024-04-26T20:25:15.891400+0000","last_became_active":"2024-04-26T20:25:15.887668+0000","last_became_peered":"2024-04-26T20:25:15.887668+0000","last_unstale":"2024-04-26T20:25:15.891400+0000","last_undegraded":"2024-04-26T20:25:15.891400+0000","last_fullsized":"2024-04-26T20:25:15.891400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:58.710413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.008102+0000","last_change":"2024-04-26T20:25:15.012133+0000","last_active":"2024-04-26T20:25:16.008102+0000","last_peered":"2024-04-26T20:25:16.008102+0000","last_clean":"2024-04-26T20:25:16.008102+0000","last_became_active":"2024-04-26T20:25:15.011820+0000","last_became_peered":"2024-04-26T20:25:15.011820+0000","last_unstale":"2024-04-26T20:25:16.008102+0000","last_undegraded":"2024-04-26T20:25:16.008102+0000","last_fullsized":"2024-04-26T20:25:16.008102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:36.634590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016013+0000","last_change":"2024-04-26T20:25:15.893941+0000","last_active":"2024-04-26T20:25:17.016013+0000","last_peered":"2024-04-26T20:25:17.016013+0000","last_clean":"2024-04-26T20:25:17.016013+0000","last_became_active":"2024-04-26T20:25:15.893616+0000","last_became_peered":"2024-04-26T20:25:15.893616+0000","last_unstale":"2024-04-26T20:25:17.016013+0000","last_undegraded":"2024-04-26T20:25:17.016013+0000","last_fullsized":"2024-04-26T20:25:17.016013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:57.893700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:20.025867+0000","last_change":"2024-04-26T20:25:15.011497+0000","last_active":"2024-04-26T20:25:20.025867+0000","last_peered":"2024-04-26T20:25:20.025867+0000","last_clean":"2024-04-26T20:25:20.025867+0000","last_became_active":"2024-04-26T20:25:15.011122+0000","last_became_peered":"2024-04-26T20:25:15.011122+0000","last_unstale":"2024-04-26T20:25:20.025867+0000","last_undegraded":"2024-04-26T20:25:20.025867+0000","last_fullsized":"2024-04-26T20:25:20.025867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:01.130321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016072+0000","last_change":"2024-04-26T20:25:15.892041+0000","last_active":"2024-04-26T20:25:17.016072+0000","last_peered":"2024-04-26T20:25:17.016072+0000","last_clean":"2024-04-26T20:25:17.016072+0000","last_became_active":"2024-04-26T20:25:15.891648+0000","last_became_peered":"2024-04-26T20:25:15.891648+0000","last_unstale":"2024-04-26T20:25:17.016072+0000","last_undegraded":"2024-04-26T20:25:17.016072+0000","last_fullsized":"2024-04-26T20:25:17.016072+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:05.729057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.006280+0000","last_change":"2024-04-26T20:25:15.005211+0000","last_active":"2024-04-26T20:25:17.006280+0000","last_peered":"2024-04-26T20:25:17.006280+0000","last_clean":"2024-04-26T20:25:17.006280+0000","last_became_active":"2024-04-26T20:25:15.004879+0000","last_became_peered":"2024-04-26T20:25:15.004879+0000","last_unstale":"2024-04-26T20:25:17.006280+0000","last_undegraded":"2024-04-26T20:25:17.006280+0000","last_fullsized":"2024-04-26T20:25:17.006280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:01.865953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.882359+0000","last_change":"2024-04-26T20:25:15.895878+0000","last_active":"2024-04-26T20:25:16.882359+0000","last_peered":"2024-04-26T20:25:16.882359+0000","last_clean":"2024-04-26T20:25:16.882359+0000","last_became_active":"2024-04-26T20:25:15.895491+0000","last_became_peered":"2024-04-26T20:25:15.895491+0000","last_unstale":"2024-04-26T20:25:16.882359+0000","last_undegraded":"2024-04-26T20:25:16.882359+0000","last_fullsized":"2024-04-26T20:25:16.882359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:41.370320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:18.001036+0000","last_change":"2024-04-26T20:25:15.013186+0000","last_active":"2024-04-26T20:25:18.001036+0000","last_peered":"2024-04-26T20:25:18.001036+0000","last_clean":"2024-04-26T20:25:18.001036+0000","last_became_active":"2024-04-26T20:25:15.012856+0000","last_became_peered":"2024-04-26T20:25:15.012856+0000","last_unstale":"2024-04-26T20:25:18.001036+0000","last_undegraded":"2024-04-26T20:25:18.001036+0000","last_fullsized":"2024-04-26T20:25:18.001036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:46.978954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.006074+0000","last_change":"2024-04-26T20:25:15.896234+0000","last_active":"2024-04-26T20:25:17.006074+0000","last_peered":"2024-04-26T20:25:17.006074+0000","last_clean":"2024-04-26T20:25:17.006074+0000","last_became_active":"2024-04-26T20:25:15.895661+0000","last_became_peered":"2024-04-26T20:25:15.895661+0000","last_unstale":"2024-04-26T20:25:17.006074+0000","last_undegraded":"2024-04-26T20:25:17.006074+0000","last_fullsized":"2024-04-26T20:25:17.006074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:44.716677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.007411+0000","last_change":"2024-04-26T20:25:15.004635+0000","last_active":"2024-04-26T20:25:16.007411+0000","last_peered":"2024-04-26T20:25:16.007411+0000","last_clean":"2024-04-26T20:25:16.007411+0000","last_became_active":"2024-04-26T20:25:15.004099+0000","last_became_peered":"2024-04-26T20:25:15.004099+0000","last_unstale":"2024-04-26T20:25:16.007411+0000","last_undegraded":"2024-04-26T20:25:16.007411+0000","last_fullsized":"2024-04-26T20:25:16.007411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:28.770212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.882578+0000","last_change":"2024-04-26T20:25:15.898180+0000","last_active":"2024-04-26T20:25:16.882578+0000","last_peered":"2024-04-26T20:25:16.882578+0000","last_clean":"2024-04-26T20:25:16.882578+0000","last_became_active":"2024-04-26T20:25:15.897631+0000","last_became_peered":"2024-04-26T20:25:15.897631+0000","last_unstale":"2024-04-26T20:25:16.882578+0000","last_undegraded":"2024-04-26T20:25:16.882578+0000","last_fullsized":"2024-04-26T20:25:16.882578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:17.936321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015439+0000","last_change":"2024-04-26T20:25:15.003966+0000","last_active":"2024-04-26T20:25:17.015439+0000","last_peered":"2024-04-26T20:25:17.015439+0000","last_clean":"2024-04-26T20:25:17.015439+0000","last_became_active":"2024-04-26T20:25:15.003611+0000","last_became_peered":"2024-04-26T20:25:15.003611+0000","last_unstale":"2024-04-26T20:25:17.015439+0000","last_undegraded":"2024-04-26T20:25:17.015439+0000","last_fullsized":"2024-04-26T20:25:17.015439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:46.494480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.893152+0000","last_change":"2024-04-26T20:25:15.892263+0000","last_active":"2024-04-26T20:25:15.893152+0000","last_peered":"2024-04-26T20:25:15.893152+0000","last_clean":"2024-04-26T20:25:15.893152+0000","last_became_active":"2024-04-26T20:25:15.891912+0000","last_became_peered":"2024-04-26T20:25:15.891912+0000","last_unstale":"2024-04-26T20:25:15.893152+0000","last_undegraded":"2024-04-26T20:25:15.893152+0000","last_fullsized":"2024-04-26T20:25:15.893152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:49:02.411947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.998503+0000","last_change":"2024-04-26T20:25:15.007227+0000","last_active":"2024-04-26T20:25:17.998503+0000","last_peered":"2024-04-26T20:25:17.998503+0000","last_clean":"2024-04-26T20:25:17.998503+0000","last_became_active":"2024-04-26T20:25:15.006901+0000","last_became_peered":"2024-04-26T20:25:15.006901+0000","last_unstale":"2024-04-26T20:25:17.998503+0000","last_undegraded":"2024-04-26T20:25:17.998503+0000","last_fullsized":"2024-04-26T20:25:17.998503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:55.391429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.004023+0000","last_change":"2024-04-26T20:25:15.887979+0000","last_active":"2024-04-26T20:25:17.004023+0000","last_peered":"2024-04-26T20:25:17.004023+0000","last_clean":"2024-04-26T20:25:17.004023+0000","last_became_active":"2024-04-26T20:25:15.887302+0000","last_became_peered":"2024-04-26T20:25:15.887302+0000","last_unstale":"2024-04-26T20:25:17.004023+0000","last_undegraded":"2024-04-26T20:25:17.004023+0000","last_fullsized":"2024-04-26T20:25:17.004023+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:41:08.662082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.880308+0000","last_change":"2024-04-26T20:25:15.005718+0000","last_active":"2024-04-26T20:25:15.880308+0000","last_peered":"2024-04-26T20:25:15.880308+0000","last_clean":"2024-04-26T20:25:15.880308+0000","last_became_active":"2024-04-26T20:25:15.005397+0000","last_became_peered":"2024-04-26T20:25:15.005397+0000","last_unstale":"2024-04-26T20:25:15.880308+0000","last_undegraded":"2024-04-26T20:25:15.880308+0000","last_fullsized":"2024-04-26T20:25:15.880308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:02.398788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.017480+0000","last_change":"2024-04-26T20:25:15.893214+0000","last_active":"2024-04-26T20:25:17.017480+0000","last_peered":"2024-04-26T20:25:17.017480+0000","last_clean":"2024-04-26T20:25:17.017480+0000","last_became_active":"2024-04-26T20:25:15.892615+0000","last_became_peered":"2024-04-26T20:25:15.892615+0000","last_unstale":"2024-04-26T20:25:17.017480+0000","last_undegraded":"2024-04-26T20:25:17.017480+0000","last_fullsized":"2024-04-26T20:25:17.017480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:51.940520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016819+0000","last_change":"2024-04-26T20:25:15.011667+0000","last_active":"2024-04-26T20:25:17.016819+0000","last_peered":"2024-04-26T20:25:17.016819+0000","last_clean":"2024-04-26T20:25:17.016819+0000","last_became_active":"2024-04-26T20:25:15.011315+0000","last_became_peered":"2024-04-26T20:25:15.011315+0000","last_unstale":"2024-04-26T20:25:17.016819+0000","last_undegraded":"2024-04-26T20:25:17.016819+0000","last_fullsized":"2024-04-26T20:25:17.016819+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:58.527548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015858+0000","last_change":"2024-04-26T20:25:15.900729+0000","last_active":"2024-04-26T20:25:17.015858+0000","last_peered":"2024-04-26T20:25:17.015858+0000","last_clean":"2024-04-26T20:25:17.015858+0000","last_became_active":"2024-04-26T20:25:15.900427+0000","last_became_peered":"2024-04-26T20:25:15.900427+0000","last_unstale":"2024-04-26T20:25:17.015858+0000","last_undegraded":"2024-04-26T20:25:17.015858+0000","last_fullsized":"2024-04-26T20:25:17.015858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:02.321351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.998347+0000","last_change":"2024-04-26T20:25:15.012186+0000","last_active":"2024-04-26T20:25:17.998347+0000","last_peered":"2024-04-26T20:25:17.998347+0000","last_clean":"2024-04-26T20:25:17.998347+0000","last_became_active":"2024-04-26T20:25:15.011853+0000","last_became_peered":"2024-04-26T20:25:15.011853+0000","last_unstale":"2024-04-26T20:25:17.998347+0000","last_undegraded":"2024-04-26T20:25:17.998347+0000","last_fullsized":"2024-04-26T20:25:17.998347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:33.893616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016754+0000","last_change":"2024-04-26T20:25:15.900656+0000","last_active":"2024-04-26T20:25:17.016754+0000","last_peered":"2024-04-26T20:25:17.016754+0000","last_clean":"2024-04-26T20:25:17.016754+0000","last_became_active":"2024-04-26T20:25:15.899663+0000","last_became_peered":"2024-04-26T20:25:15.899663+0000","last_unstale":"2024-04-26T20:25:17.016754+0000","last_undegraded":"2024-04-26T20:25:17.016754+0000","last_fullsized":"2024-04-26T20:25:17.016754+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:40.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.010538+0000","last_change":"2024-04-26T20:25:15.009991+0000","last_active":"2024-04-26T20:25:16.010538+0000","last_peered":"2024-04-26T20:25:16.010538+0000","last_clean":"2024-04-26T20:25:16.010538+0000","last_became_active":"2024-04-26T20:25:15.008562+0000","last_became_peered":"2024-04-26T20:25:15.008562+0000","last_unstale":"2024-04-26T20:25:16.010538+0000","last_undegraded":"2024-04-26T20:25:16.010538+0000","last_fullsized":"2024-04-26T20:25:16.010538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:42.120258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.006325+0000","last_change":"2024-04-26T20:25:15.892134+0000","last_active":"2024-04-26T20:25:17.006325+0000","last_peered":"2024-04-26T20:25:17.006325+0000","last_clean":"2024-04-26T20:25:17.006325+0000","last_became_active":"2024-04-26T20:25:15.890965+0000","last_became_peered":"2024-04-26T20:25:15.890965+0000","last_unstale":"2024-04-26T20:25:17.006325+0000","last_undegraded":"2024-04-26T20:25:17.006325+0000","last_fullsized":"2024-04-26T20:25:17.006325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:11.834642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016191+0000","last_change":"2024-04-26T20:25:15.006020+0000","last_active":"2024-04-26T20:25:17.016191+0000","last_peered":"2024-04-26T20:25:17.016191+0000","last_clean":"2024-04-26T20:25:17.016191+0000","last_became_active":"2024-04-26T20:25:15.005579+0000","last_became_peered":"2024-04-26T20:25:15.005579+0000","last_unstale":"2024-04-26T20:25:17.016191+0000","last_undegraded":"2024-04-26T20:25:17.016191+0000","last_fullsized":"2024-04-26T20:25:17.016191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:51.777497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015976+0000","last_change":"2024-04-26T20:25:15.888561+0000","last_active":"2024-04-26T20:25:17.015976+0000","last_peered":"2024-04-26T20:25:17.015976+0000","last_clean":"2024-04-26T20:25:17.015976+0000","last_became_active":"2024-04-26T20:25:15.888249+0000","last_became_peered":"2024-04-26T20:25:15.888249+0000","last_unstale":"2024-04-26T20:25:17.015976+0000","last_undegraded":"2024-04-26T20:25:17.015976+0000","last_fullsized":"2024-04-26T20:25:17.015976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:29.352406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.998149+0000","last_change":"2024-04-26T20:25:15.010139+0000","last_active":"2024-04-26T20:25:17.998149+0000","last_peered":"2024-04-26T20:25:17.998149+0000","last_clean":"2024-04-26T20:25:17.998149+0000","last_became_active":"2024-04-26T20:25:15.009826+0000","last_became_peered":"2024-04-26T20:25:15.009826+0000","last_unstale":"2024-04-26T20:25:17.998149+0000","last_undegraded":"2024-04-26T20:25:17.998149+0000","last_fullsized":"2024-04-26T20:25:17.998149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:31.801205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016424+0000","last_change":"2024-04-26T20:25:15.886316+0000","last_active":"2024-04-26T20:25:17.016424+0000","last_peered":"2024-04-26T20:25:17.016424+0000","last_clean":"2024-04-26T20:25:17.016424+0000","last_became_active":"2024-04-26T20:25:15.885983+0000","last_became_peered":"2024-04-26T20:25:15.885983+0000","last_unstale":"2024-04-26T20:25:17.016424+0000","last_undegraded":"2024-04-26T20:25:17.016424+0000","last_fullsized":"2024-04-26T20:25:17.016424+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:51.018655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.880527+0000","last_change":"2024-04-26T20:25:15.009046+0000","last_active":"2024-04-26T20:25:16.880527+0000","last_peered":"2024-04-26T20:25:16.880527+0000","last_clean":"2024-04-26T20:25:16.880527+0000","last_became_active":"2024-04-26T20:25:15.006321+0000","last_became_peered":"2024-04-26T20:25:15.006321+0000","last_unstale":"2024-04-26T20:25:16.880527+0000","last_undegraded":"2024-04-26T20:25:16.880527+0000","last_fullsized":"2024-04-26T20:25:16.880527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:30.993709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015924+0000","last_change":"2024-04-26T20:25:15.896722+0000","last_active":"2024-04-26T20:25:17.015924+0000","last_peered":"2024-04-26T20:25:17.015924+0000","last_clean":"2024-04-26T20:25:17.015924+0000","last_became_active":"2024-04-26T20:25:15.896377+0000","last_became_peered":"2024-04-26T20:25:15.896377+0000","last_unstale":"2024-04-26T20:25:17.015924+0000","last_undegraded":"2024-04-26T20:25:17.015924+0000","last_fullsized":"2024-04-26T20:25:17.015924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:39.899679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'16","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:19.018273+0000","last_change":"2024-04-26T20:25:15.016262+0000","last_active":"2024-04-26T20:25:19.018273+0000","last_peered":"2024-04-26T20:25:19.018273+0000","last_clean":"2024-04-26T20:25:19.018273+0000","last_became_active":"2024-04-26T20:25:15.015744+0000","last_became_peered":"2024-04-26T20:25:15.015744+0000","last_unstale":"2024-04-26T20:25:19.018273+0000","last_undegraded":"2024-04-26T20:25:19.018273+0000","last_fullsized":"2024-04-26T20:25:19.018273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:50.231250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.881943+0000","last_change":"2024-04-26T20:25:15.894702+0000","last_active":"2024-04-26T20:25:16.881943+0000","last_peered":"2024-04-26T20:25:16.881943+0000","last_clean":"2024-04-26T20:25:16.881943+0000","last_became_active":"2024-04-26T20:25:15.894338+0000","last_became_peered":"2024-04-26T20:25:15.894338+0000","last_unstale":"2024-04-26T20:25:16.881943+0000","last_undegraded":"2024-04-26T20:25:16.881943+0000","last_fullsized":"2024-04-26T20:25:16.881943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:01.515041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.006419+0000","last_change":"2024-04-26T20:25:15.011207+0000","last_active":"2024-04-26T20:25:17.006419+0000","last_peered":"2024-04-26T20:25:17.006419+0000","last_clean":"2024-04-26T20:25:17.006419+0000","last_became_active":"2024-04-26T20:25:15.010733+0000","last_became_peered":"2024-04-26T20:25:15.010733+0000","last_unstale":"2024-04-26T20:25:17.006419+0000","last_undegraded":"2024-04-26T20:25:17.006419+0000","last_fullsized":"2024-04-26T20:25:17.006419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:35.584041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016300+0000","last_change":"2024-04-26T20:25:15.896061+0000","last_active":"2024-04-26T20:25:17.016300+0000","last_peered":"2024-04-26T20:25:17.016300+0000","last_clean":"2024-04-26T20:25:17.016300+0000","last_became_active":"2024-04-26T20:25:15.895712+0000","last_became_peered":"2024-04-26T20:25:15.895712+0000","last_unstale":"2024-04-26T20:25:17.016300+0000","last_undegraded":"2024-04-26T20:25:17.016300+0000","last_fullsized":"2024-04-26T20:25:17.016300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.663831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.004025+0000","last_change":"2024-04-26T20:25:15.010300+0000","last_active":"2024-04-26T20:25:17.004025+0000","last_peered":"2024-04-26T20:25:17.004025+0000","last_clean":"2024-04-26T20:25:17.004025+0000","last_became_active":"2024-04-26T20:25:15.009999+0000","last_became_peered":"2024-04-26T20:25:15.009999+0000","last_unstale":"2024-04-26T20:25:17.004025+0000","last_undegraded":"2024-04-26T20:25:17.004025+0000","last_fullsized":"2024-04-26T20:25:17.004025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:07.394664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.889053+0000","last_change":"2024-04-26T20:25:15.888356+0000","last_active":"2024-04-26T20:25:15.889053+0000","last_peered":"2024-04-26T20:25:15.889053+0000","last_clean":"2024-04-26T20:25:15.889053+0000","last_became_active":"2024-04-26T20:25:15.888056+0000","last_became_peered":"2024-04-26T20:25:15.888056+0000","last_unstale":"2024-04-26T20:25:15.889053+0000","last_undegraded":"2024-04-26T20:25:15.889053+0000","last_fullsized":"2024-04-26T20:25:15.889053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:37.514179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016438+0000","last_change":"2024-04-26T20:25:15.008552+0000","last_active":"2024-04-26T20:25:17.016438+0000","last_peered":"2024-04-26T20:25:17.016438+0000","last_clean":"2024-04-26T20:25:17.016438+0000","last_became_active":"2024-04-26T20:25:15.008217+0000","last_became_peered":"2024-04-26T20:25:15.008217+0000","last_unstale":"2024-04-26T20:25:17.016438+0000","last_undegraded":"2024-04-26T20:25:17.016438+0000","last_fullsized":"2024-04-26T20:25:17.016438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:23.803674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.899097+0000","last_change":"2024-04-26T20:25:15.896655+0000","last_active":"2024-04-26T20:25:15.899097+0000","last_peered":"2024-04-26T20:25:15.899097+0000","last_clean":"2024-04-26T20:25:15.899097+0000","last_became_active":"2024-04-26T20:25:15.896335+0000","last_became_peered":"2024-04-26T20:25:15.896335+0000","last_unstale":"2024-04-26T20:25:15.899097+0000","last_undegraded":"2024-04-26T20:25:15.899097+0000","last_fullsized":"2024-04-26T20:25:15.899097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:34.198534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.882015+0000","last_change":"2024-04-26T20:25:15.901665+0000","last_active":"2024-04-26T20:25:16.882015+0000","last_peered":"2024-04-26T20:25:16.882015+0000","last_clean":"2024-04-26T20:25:16.882015+0000","last_became_active":"2024-04-26T20:25:15.901335+0000","last_became_peered":"2024-04-26T20:25:15.901335+0000","last_unstale":"2024-04-26T20:25:16.882015+0000","last_undegraded":"2024-04-26T20:25:16.882015+0000","last_fullsized":"2024-04-26T20:25:16.882015+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:11.909473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015290+0000","last_change":"2024-04-26T20:25:15.012015+0000","last_active":"2024-04-26T20:25:17.015290+0000","last_peered":"2024-04-26T20:25:17.015290+0000","last_clean":"2024-04-26T20:25:17.015290+0000","last_became_active":"2024-04-26T20:25:15.011705+0000","last_became_peered":"2024-04-26T20:25:15.011705+0000","last_unstale":"2024-04-26T20:25:17.015290+0000","last_undegraded":"2024-04-26T20:25:17.015290+0000","last_fullsized":"2024-04-26T20:25:17.015290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:10.213375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.885810+0000","last_change":"2024-04-26T20:25:15.885294+0000","last_active":"2024-04-26T20:25:15.885810+0000","last_peered":"2024-04-26T20:25:15.885810+0000","last_clean":"2024-04-26T20:25:15.885810+0000","last_became_active":"2024-04-26T20:25:15.884963+0000","last_became_peered":"2024-04-26T20:25:15.884963+0000","last_unstale":"2024-04-26T20:25:15.885810+0000","last_undegraded":"2024-04-26T20:25:15.885810+0000","last_fullsized":"2024-04-26T20:25:15.885810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:17.919770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.880741+0000","last_change":"2024-04-26T20:25:15.006101+0000","last_active":"2024-04-26T20:25:16.880741+0000","last_peered":"2024-04-26T20:25:16.880741+0000","last_clean":"2024-04-26T20:25:16.880741+0000","last_became_active":"2024-04-26T20:25:15.005566+0000","last_became_peered":"2024-04-26T20:25:15.005566+0000","last_unstale":"2024-04-26T20:25:16.880741+0000","last_undegraded":"2024-04-26T20:25:16.880741+0000","last_fullsized":"2024-04-26T20:25:16.880741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:15.392418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":350,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015902+0000","last_change":"2024-04-26T20:23:58.975689+0000","last_active":"2024-04-26T20:25:17.015902+0000","last_peered":"2024-04-26T20:25:17.015902+0000","last_clean":"2024-04-26T20:25:17.015902+0000","last_became_active":"2024-04-26T20:23:58.975250+0000","last_became_peered":"2024-04-26T20:23:58.975250+0000","last_unstale":"2024-04-26T20:25:17.015902+0000","last_undegraded":"2024-04-26T20:25:17.015902+0000","last_fullsized":"2024-04-26T20:25:17.015902+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:20:34.477920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:20:34.477920+0000","last_clean_scrub_stamp":"2024-04-26T20:20:34.477920+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:51.870155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015342+0000","last_change":"2024-04-26T20:25:15.895244+0000","last_active":"2024-04-26T20:25:17.015342+0000","last_peered":"2024-04-26T20:25:17.015342+0000","last_clean":"2024-04-26T20:25:17.015342+0000","last_became_active":"2024-04-26T20:25:15.894943+0000","last_became_peered":"2024-04-26T20:25:15.894943+0000","last_unstale":"2024-04-26T20:25:17.015342+0000","last_undegraded":"2024-04-26T20:25:17.015342+0000","last_fullsized":"2024-04-26T20:25:17.015342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:03.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016047+0000","last_change":"2024-04-26T20:25:15.013105+0000","last_active":"2024-04-26T20:25:17.016047+0000","last_peered":"2024-04-26T20:25:17.016047+0000","last_clean":"2024-04-26T20:25:17.016047+0000","last_became_active":"2024-04-26T20:25:15.012815+0000","last_became_peered":"2024-04-26T20:25:15.012815+0000","last_unstale":"2024-04-26T20:25:17.016047+0000","last_undegraded":"2024-04-26T20:25:17.016047+0000","last_fullsized":"2024-04-26T20:25:17.016047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:15.941868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:20.025226+0000","last_change":"2024-04-26T20:25:15.016081+0000","last_active":"2024-04-26T20:25:20.025226+0000","last_peered":"2024-04-26T20:25:20.025226+0000","last_clean":"2024-04-26T20:25:20.025226+0000","last_became_active":"2024-04-26T20:25:15.015766+0000","last_became_peered":"2024-04-26T20:25:15.015766+0000","last_unstale":"2024-04-26T20:25:20.025226+0000","last_undegraded":"2024-04-26T20:25:20.025226+0000","last_fullsized":"2024-04-26T20:25:20.025226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:21:56.377141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015890+0000","last_change":"2024-04-26T20:25:15.881988+0000","last_active":"2024-04-26T20:25:17.015890+0000","last_peered":"2024-04-26T20:25:17.015890+0000","last_clean":"2024-04-26T20:25:17.015890+0000","last_became_active":"2024-04-26T20:25:15.881615+0000","last_became_peered":"2024-04-26T20:25:15.881615+0000","last_unstale":"2024-04-26T20:25:17.015890+0000","last_undegraded":"2024-04-26T20:25:17.015890+0000","last_fullsized":"2024-04-26T20:25:17.015890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:24.511442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:20.024891+0000","last_change":"2024-04-26T20:25:15.005468+0000","last_active":"2024-04-26T20:25:20.024891+0000","last_peered":"2024-04-26T20:25:20.024891+0000","last_clean":"2024-04-26T20:25:20.024891+0000","last_became_active":"2024-04-26T20:25:15.005164+0000","last_became_peered":"2024-04-26T20:25:15.005164+0000","last_unstale":"2024-04-26T20:25:20.024891+0000","last_undegraded":"2024-04-26T20:25:20.024891+0000","last_fullsized":"2024-04-26T20:25:20.024891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:58.964128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.894138+0000","last_change":"2024-04-26T20:25:15.893298+0000","last_active":"2024-04-26T20:25:15.894138+0000","last_peered":"2024-04-26T20:25:15.894138+0000","last_clean":"2024-04-26T20:25:15.894138+0000","last_became_active":"2024-04-26T20:25:15.892981+0000","last_became_peered":"2024-04-26T20:25:15.892981+0000","last_unstale":"2024-04-26T20:25:15.894138+0000","last_undegraded":"2024-04-26T20:25:15.894138+0000","last_fullsized":"2024-04-26T20:25:15.894138+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:25.665985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.880918+0000","last_change":"2024-04-26T20:25:15.007962+0000","last_active":"2024-04-26T20:25:16.880918+0000","last_peered":"2024-04-26T20:25:16.880918+0000","last_clean":"2024-04-26T20:25:16.880918+0000","last_became_active":"2024-04-26T20:25:15.007592+0000","last_became_peered":"2024-04-26T20:25:15.007592+0000","last_unstale":"2024-04-26T20:25:16.880918+0000","last_undegraded":"2024-04-26T20:25:16.880918+0000","last_fullsized":"2024-04-26T20:25:16.880918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:26.364350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015954+0000","last_change":"2024-04-26T20:25:15.895272+0000","last_active":"2024-04-26T20:25:17.015954+0000","last_peered":"2024-04-26T20:25:17.015954+0000","last_clean":"2024-04-26T20:25:17.015954+0000","last_became_active":"2024-04-26T20:25:15.894962+0000","last_became_peered":"2024-04-26T20:25:15.894962+0000","last_unstale":"2024-04-26T20:25:17.015954+0000","last_undegraded":"2024-04-26T20:25:17.015954+0000","last_fullsized":"2024-04-26T20:25:17.015954+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:13.714365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.999014+0000","last_change":"2024-04-26T20:25:15.014580+0000","last_active":"2024-04-26T20:25:17.999014+0000","last_peered":"2024-04-26T20:25:17.999014+0000","last_clean":"2024-04-26T20:25:17.999014+0000","last_became_active":"2024-04-26T20:25:15.014320+0000","last_became_peered":"2024-04-26T20:25:15.014320+0000","last_unstale":"2024-04-26T20:25:17.999014+0000","last_undegraded":"2024-04-26T20:25:17.999014+0000","last_fullsized":"2024-04-26T20:25:17.999014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:43.689597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.005988+0000","last_change":"2024-04-26T20:25:15.891833+0000","last_active":"2024-04-26T20:25:17.005988+0000","last_peered":"2024-04-26T20:25:17.005988+0000","last_clean":"2024-04-26T20:25:17.005988+0000","last_became_active":"2024-04-26T20:25:15.891514+0000","last_became_peered":"2024-04-26T20:25:15.891514+0000","last_unstale":"2024-04-26T20:25:17.005988+0000","last_undegraded":"2024-04-26T20:25:17.005988+0000","last_fullsized":"2024-04-26T20:25:17.005988+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:16.673434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.878523+0000","last_change":"2024-04-26T20:25:15.006756+0000","last_active":"2024-04-26T20:25:15.878523+0000","last_peered":"2024-04-26T20:25:15.878523+0000","last_clean":"2024-04-26T20:25:15.878523+0000","last_became_active":"2024-04-26T20:25:15.006297+0000","last_became_peered":"2024-04-26T20:25:15.006297+0000","last_unstale":"2024-04-26T20:25:15.878523+0000","last_undegraded":"2024-04-26T20:25:15.878523+0000","last_fullsized":"2024-04-26T20:25:15.878523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:28.797708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015976+0000","last_change":"2024-04-26T20:25:15.891105+0000","last_active":"2024-04-26T20:25:17.015976+0000","last_peered":"2024-04-26T20:25:17.015976+0000","last_clean":"2024-04-26T20:25:17.015976+0000","last_became_active":"2024-04-26T20:25:15.890761+0000","last_became_peered":"2024-04-26T20:25:15.890761+0000","last_unstale":"2024-04-26T20:25:17.015976+0000","last_undegraded":"2024-04-26T20:25:17.015976+0000","last_fullsized":"2024-04-26T20:25:17.015976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:48.010351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015955+0000","last_change":"2024-04-26T20:25:15.009981+0000","last_active":"2024-04-26T20:25:17.015955+0000","last_peered":"2024-04-26T20:25:17.015955+0000","last_clean":"2024-04-26T20:25:17.015955+0000","last_became_active":"2024-04-26T20:25:15.009662+0000","last_became_peered":"2024-04-26T20:25:15.009662+0000","last_unstale":"2024-04-26T20:25:17.015955+0000","last_undegraded":"2024-04-26T20:25:17.015955+0000","last_fullsized":"2024-04-26T20:25:17.015955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:53.199823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.891401+0000","last_change":"2024-04-26T20:25:15.889831+0000","last_active":"2024-04-26T20:25:15.891401+0000","last_peered":"2024-04-26T20:25:15.891401+0000","last_clean":"2024-04-26T20:25:15.891401+0000","last_became_active":"2024-04-26T20:25:15.887421+0000","last_became_peered":"2024-04-26T20:25:15.887421+0000","last_unstale":"2024-04-26T20:25:15.891401+0000","last_undegraded":"2024-04-26T20:25:15.891401+0000","last_fullsized":"2024-04-26T20:25:15.891401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:42.899000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.998806+0000","last_change":"2024-04-26T20:25:15.007963+0000","last_active":"2024-04-26T20:25:17.998806+0000","last_peered":"2024-04-26T20:25:17.998806+0000","last_clean":"2024-04-26T20:25:17.998806+0000","last_became_active":"2024-04-26T20:25:15.007598+0000","last_became_peered":"2024-04-26T20:25:15.007598+0000","last_unstale":"2024-04-26T20:25:17.998806+0000","last_undegraded":"2024-04-26T20:25:17.998806+0000","last_fullsized":"2024-04-26T20:25:17.998806+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:31.490912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016611+0000","last_change":"2024-04-26T20:25:15.890349+0000","last_active":"2024-04-26T20:25:17.016611+0000","last_peered":"2024-04-26T20:25:17.016611+0000","last_clean":"2024-04-26T20:25:17.016611+0000","last_became_active":"2024-04-26T20:25:15.890022+0000","last_became_peered":"2024-04-26T20:25:15.890022+0000","last_unstale":"2024-04-26T20:25:17.016611+0000","last_undegraded":"2024-04-26T20:25:17.016611+0000","last_fullsized":"2024-04-26T20:25:17.016611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:41.283095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016122+0000","last_change":"2024-04-26T20:25:15.012522+0000","last_active":"2024-04-26T20:25:17.016122+0000","last_peered":"2024-04-26T20:25:17.016122+0000","last_clean":"2024-04-26T20:25:17.016122+0000","last_became_active":"2024-04-26T20:25:15.012157+0000","last_became_peered":"2024-04-26T20:25:15.012157+0000","last_unstale":"2024-04-26T20:25:17.016122+0000","last_undegraded":"2024-04-26T20:25:17.016122+0000","last_fullsized":"2024-04-26T20:25:17.016122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:54.598330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016842+0000","last_change":"2024-04-26T20:25:15.896016+0000","last_active":"2024-04-26T20:25:17.016842+0000","last_peered":"2024-04-26T20:25:17.016842+0000","last_clean":"2024-04-26T20:25:17.016842+0000","last_became_active":"2024-04-26T20:25:15.895467+0000","last_became_peered":"2024-04-26T20:25:15.895467+0000","last_unstale":"2024-04-26T20:25:17.016842+0000","last_undegraded":"2024-04-26T20:25:17.016842+0000","last_fullsized":"2024-04-26T20:25:17.016842+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:28.368634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.882057+0000","last_change":"2024-04-26T20:25:15.010645+0000","last_active":"2024-04-26T20:25:16.882057+0000","last_peered":"2024-04-26T20:25:16.882057+0000","last_clean":"2024-04-26T20:25:16.882057+0000","last_became_active":"2024-04-26T20:25:15.010337+0000","last_became_peered":"2024-04-26T20:25:15.010337+0000","last_unstale":"2024-04-26T20:25:16.882057+0000","last_undegraded":"2024-04-26T20:25:16.882057+0000","last_fullsized":"2024-04-26T20:25:16.882057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:40.081464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016699+0000","last_change":"2024-04-26T20:25:15.896806+0000","last_active":"2024-04-26T20:25:17.016699+0000","last_peered":"2024-04-26T20:25:17.016699+0000","last_clean":"2024-04-26T20:25:17.016699+0000","last_became_active":"2024-04-26T20:25:15.896459+0000","last_became_peered":"2024-04-26T20:25:15.896459+0000","last_unstale":"2024-04-26T20:25:17.016699+0000","last_undegraded":"2024-04-26T20:25:17.016699+0000","last_fullsized":"2024-04-26T20:25:17.016699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:25.407874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015629+0000","last_change":"2024-04-26T20:25:15.013291+0000","last_active":"2024-04-26T20:25:17.015629+0000","last_peered":"2024-04-26T20:25:17.015629+0000","last_clean":"2024-04-26T20:25:17.015629+0000","last_became_active":"2024-04-26T20:25:15.012442+0000","last_became_peered":"2024-04-26T20:25:15.012442+0000","last_unstale":"2024-04-26T20:25:17.015629+0000","last_undegraded":"2024-04-26T20:25:17.015629+0000","last_fullsized":"2024-04-26T20:25:17.015629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:56.913314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.017146+0000","last_change":"2024-04-26T20:25:15.897364+0000","last_active":"2024-04-26T20:25:17.017146+0000","last_peered":"2024-04-26T20:25:17.017146+0000","last_clean":"2024-04-26T20:25:17.017146+0000","last_became_active":"2024-04-26T20:25:15.895699+0000","last_became_peered":"2024-04-26T20:25:15.895699+0000","last_unstale":"2024-04-26T20:25:17.017146+0000","last_undegraded":"2024-04-26T20:25:17.017146+0000","last_fullsized":"2024-04-26T20:25:17.017146+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:49.507200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016162+0000","last_change":"2024-04-26T20:25:15.895932+0000","last_active":"2024-04-26T20:25:17.016162+0000","last_peered":"2024-04-26T20:25:17.016162+0000","last_clean":"2024-04-26T20:25:17.016162+0000","last_became_active":"2024-04-26T20:25:15.895583+0000","last_became_peered":"2024-04-26T20:25:15.895583+0000","last_unstale":"2024-04-26T20:25:17.016162+0000","last_undegraded":"2024-04-26T20:25:17.016162+0000","last_fullsized":"2024-04-26T20:25:17.016162+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:24.865728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015974+0000","last_change":"2024-04-26T20:25:15.899267+0000","last_active":"2024-04-26T20:25:17.015974+0000","last_peered":"2024-04-26T20:25:17.015974+0000","last_clean":"2024-04-26T20:25:17.015974+0000","last_became_active":"2024-04-26T20:25:15.898841+0000","last_became_peered":"2024-04-26T20:25:15.898841+0000","last_unstale":"2024-04-26T20:25:17.015974+0000","last_undegraded":"2024-04-26T20:25:17.015974+0000","last_fullsized":"2024-04-26T20:25:17.015974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:28.448452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015843+0000","last_change":"2024-04-26T20:25:15.886667+0000","last_active":"2024-04-26T20:25:17.015843+0000","last_peered":"2024-04-26T20:25:17.015843+0000","last_clean":"2024-04-26T20:25:17.015843+0000","last_became_active":"2024-04-26T20:25:15.886338+0000","last_became_peered":"2024-04-26T20:25:15.886338+0000","last_unstale":"2024-04-26T20:25:17.015843+0000","last_undegraded":"2024-04-26T20:25:17.015843+0000","last_fullsized":"2024-04-26T20:25:17.015843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:20.666594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015726+0000","last_change":"2024-04-26T20:25:15.895551+0000","last_active":"2024-04-26T20:25:17.015726+0000","last_peered":"2024-04-26T20:25:17.015726+0000","last_clean":"2024-04-26T20:25:17.015726+0000","last_became_active":"2024-04-26T20:25:15.895129+0000","last_became_peered":"2024-04-26T20:25:15.895129+0000","last_unstale":"2024-04-26T20:25:17.015726+0000","last_undegraded":"2024-04-26T20:25:17.015726+0000","last_fullsized":"2024-04-26T20:25:17.015726+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.959022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016022+0000","last_change":"2024-04-26T20:25:15.895286+0000","last_active":"2024-04-26T20:25:17.016022+0000","last_peered":"2024-04-26T20:25:17.016022+0000","last_clean":"2024-04-26T20:25:17.016022+0000","last_became_active":"2024-04-26T20:25:15.894954+0000","last_became_peered":"2024-04-26T20:25:15.894954+0000","last_unstale":"2024-04-26T20:25:17.016022+0000","last_undegraded":"2024-04-26T20:25:17.016022+0000","last_fullsized":"2024-04-26T20:25:17.016022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:02.805037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016496+0000","last_change":"2024-04-26T20:25:15.896824+0000","last_active":"2024-04-26T20:25:17.016496+0000","last_peered":"2024-04-26T20:25:17.016496+0000","last_clean":"2024-04-26T20:25:17.016496+0000","last_became_active":"2024-04-26T20:25:15.896337+0000","last_became_peered":"2024-04-26T20:25:15.896337+0000","last_unstale":"2024-04-26T20:25:17.016496+0000","last_undegraded":"2024-04-26T20:25:17.016496+0000","last_fullsized":"2024-04-26T20:25:17.016496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:31.105915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016385+0000","last_change":"2024-04-26T20:25:15.890207+0000","last_active":"2024-04-26T20:25:17.016385+0000","last_peered":"2024-04-26T20:25:17.016385+0000","last_clean":"2024-04-26T20:25:17.016385+0000","last_became_active":"2024-04-26T20:25:15.889890+0000","last_became_peered":"2024-04-26T20:25:15.889890+0000","last_unstale":"2024-04-26T20:25:17.016385+0000","last_undegraded":"2024-04-26T20:25:17.016385+0000","last_fullsized":"2024-04-26T20:25:17.016385+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:44.562779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.898009+0000","last_change":"2024-04-26T20:25:15.897407+0000","last_active":"2024-04-26T20:25:15.898009+0000","last_peered":"2024-04-26T20:25:15.898009+0000","last_clean":"2024-04-26T20:25:15.898009+0000","last_became_active":"2024-04-26T20:25:15.897076+0000","last_became_peered":"2024-04-26T20:25:15.897076+0000","last_unstale":"2024-04-26T20:25:15.898009+0000","last_undegraded":"2024-04-26T20:25:15.898009+0000","last_fullsized":"2024-04-26T20:25:15.898009+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:48.063282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:16.881900+0000","last_change":"2024-04-26T20:25:15.895097+0000","last_active":"2024-04-26T20:25:16.881900+0000","last_peered":"2024-04-26T20:25:16.881900+0000","last_clean":"2024-04-26T20:25:16.881900+0000","last_became_active":"2024-04-26T20:25:15.894647+0000","last_became_peered":"2024-04-26T20:25:15.894647+0000","last_unstale":"2024-04-26T20:25:16.881900+0000","last_undegraded":"2024-04-26T20:25:16.881900+0000","last_fullsized":"2024-04-26T20:25:16.881900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:48.651323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T20:25:15.886575+0000","last_change":"2024-04-26T20:25:15.886174+0000","last_active":"2024-04-26T20:25:15.886575+0000","last_peered":"2024-04-26T20:25:15.886575+0000","last_clean":"2024-04-26T20:25:15.886575+0000","last_became_active":"2024-04-26T20:25:15.885869+0000","last_became_peered":"2024-04-26T20:25:15.885869+0000","last_unstale":"2024-04-26T20:25:15.886575+0000","last_undegraded":"2024-04-26T20:25:15.886575+0000","last_fullsized":"2024-04-26T20:25:15.886575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:31.393136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.016422+0000","last_change":"2024-04-26T20:25:15.888377+0000","last_active":"2024-04-26T20:25:17.016422+0000","last_peered":"2024-04-26T20:25:17.016422+0000","last_clean":"2024-04-26T20:25:17.016422+0000","last_became_active":"2024-04-26T20:25:15.888042+0000","last_became_peered":"2024-04-26T20:25:15.888042+0000","last_unstale":"2024-04-26T20:25:17.016422+0000","last_undegraded":"2024-04-26T20:25:17.016422+0000","last_fullsized":"2024-04-26T20:25:17.016422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.922321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015830+0000","last_change":"2024-04-26T20:25:15.887255+0000","last_active":"2024-04-26T20:25:17.015830+0000","last_peered":"2024-04-26T20:25:17.015830+0000","last_clean":"2024-04-26T20:25:17.015830+0000","last_became_active":"2024-04-26T20:25:15.886936+0000","last_became_peered":"2024-04-26T20:25:15.886936+0000","last_unstale":"2024-04-26T20:25:17.015830+0000","last_undegraded":"2024-04-26T20:25:17.015830+0000","last_fullsized":"2024-04-26T20:25:17.015830+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:54.135181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T20:25:17.015998+0000","last_change":"2024-04-26T20:25:15.893371+0000","last_active":"2024-04-26T20:25:17.015998+0000","last_peered":"2024-04-26T20:25:17.015998+0000","last_clean":"2024-04-26T20:25:17.015998+0000","last_became_active":"2024-04-26T20:25:15.892490+0000","last_became_peered":"2024-04-26T20:25:15.892490+0000","last_unstale":"2024-04-26T20:25:17.015998+0000","last_undegraded":"2024-04-26T20:25:17.015998+0000","last_fullsized":"2024-04-26T20:25:17.015998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:39.337577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":211446,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3748,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":10372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":441572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":983040,"data_stored":1025176,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776153,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":442480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037790,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":442310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299426,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":1032522,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462952,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":909312,"data_stored":433002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":443184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":442266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":937984,"data_stored":443218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149750,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":433106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888114,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":441594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724589,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":1032122,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:25:23.778 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T20:25:23.779 INFO:tasks.cephadm:Setting up client nodes... 2024-04-26T20:25:23.779 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-26T20:25:24.058 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:24.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:24 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2681478887' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:24.289 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:24 smithi070 ceph-mon[29124]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:25:24.289 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:24 smithi070 ceph-mon[29124]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:25:24.289 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:24 smithi070 ceph-mon[29124]: pgmap v294: 97 pgs: 97 active+clean; 603 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 10 KiB/s wr, 28 op/s 2024-04-26T20:25:24.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:24 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2681478887' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:24.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:24 smithi098 ceph-mon[32591]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:25:24.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:24 smithi098 ceph-mon[32591]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:25:24.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:24 smithi098 ceph-mon[32591]: pgmap v294: 97 pgs: 97 active+clean; 603 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 10 KiB/s wr, 28 op/s 2024-04-26T20:25:24.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:24 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2681478887' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:24.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:24 smithi080 ceph-mon[32278]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:25:24.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:24 smithi080 ceph-mon[32278]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:25:24.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:24 smithi080 ceph-mon[32278]: pgmap v294: 97 pgs: 97 active+clean; 603 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 10 KiB/s wr, 28 op/s 2024-04-26T20:25:25.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.758+0000 7fc586cdb700 1 -- 172.21.15.70:0/1220581804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5801034d0 msgr2=0x7fc5801038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:25.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.758+0000 7fc586cdb700 1 --2- 172.21.15.70:0/1220581804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5801034d0 0x7fc5801038f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc5740099c0 tx=0x7fc574009cd0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.758+0000 7fc586cdb700 1 -- 172.21.15.70:0/1220581804 shutdown_connections 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.758+0000 7fc586cdb700 1 --2- 172.21.15.70:0/1220581804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc580105070 0x7fc58010b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.758+0000 7fc586cdb700 1 --2- 172.21.15.70:0/1220581804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5801034d0 0x7fc5801038f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.758+0000 7fc586cdb700 1 --2- 172.21.15.70:0/1220581804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5801046d0 0x7fc580104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.758+0000 7fc586cdb700 1 -- 172.21.15.70:0/1220581804 >> 172.21.15.70:0/1220581804 conn(0x7fc5800fea70 msgr2=0x7fc580100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.758+0000 7fc586cdb700 1 -- 172.21.15.70:0/1220581804 shutdown_connections 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.758+0000 7fc586cdb700 1 -- 172.21.15.70:0/1220581804 wait complete. 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc586cdb700 1 Processor -- start 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc586cdb700 1 -- start start 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc586cdb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5801034d0 0x7fc5800771c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc586cdb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5801046d0 0x7fc580075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc586cdb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc580105070 0x7fc580075d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc586cdb700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc58010f100 con 0x7fc580105070 2024-04-26T20:25:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc586cdb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc58010ef80 con 0x7fc5801034d0 2024-04-26T20:25:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc586cdb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc58010f280 con 0x7fc5801046d0 2024-04-26T20:25:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc585278700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc580105070 0x7fc580075d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc585278700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc580105070 0x7fc580075d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58380/0 (socket says 172.21.15.70:58380) 2024-04-26T20:25:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc585278700 1 -- 172.21.15.70:0/1194083327 learned_addr learned my addr 172.21.15.70:0/1194083327 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc57ffff700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5801046d0 0x7fc580075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc584a77700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5801034d0 0x7fc5800771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc585278700 1 -- 172.21.15.70:0/1194083327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5801046d0 msgr2=0x7fc580075810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc585278700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5801046d0 0x7fc580075810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc585278700 1 -- 172.21.15.70:0/1194083327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5801034d0 msgr2=0x7fc5800771c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:25.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc585278700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5801034d0 0x7fc5800771c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.759+0000 7fc585278700 1 -- 172.21.15.70:0/1194083327 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc580076600 con 0x7fc580105070 2024-04-26T20:25:25.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.760+0000 7fc57ffff700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5801046d0 0x7fc580075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:25.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.760+0000 7fc585278700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc580105070 0x7fc580075d50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc57800ada0 tx=0x7fc57800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:25.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.760+0000 7fc57dffb700 1 -- 172.21.15.70:0/1194083327 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578017020 con 0x7fc580105070 2024-04-26T20:25:25.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.760+0000 7fc57dffb700 1 -- 172.21.15.70:0/1194083327 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc57800ce50 con 0x7fc580105070 2024-04-26T20:25:25.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.760+0000 7fc57dffb700 1 -- 172.21.15.70:0/1194083327 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578005560 con 0x7fc580105070 2024-04-26T20:25:25.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.760+0000 7fc586cdb700 1 -- 172.21.15.70:0/1194083327 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5801a37e0 con 0x7fc580105070 2024-04-26T20:25:25.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.760+0000 7fc586cdb700 1 -- 172.21.15.70:0/1194083327 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5801a3ca0 con 0x7fc580105070 2024-04-26T20:25:25.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.761+0000 7fc586cdb700 1 -- 172.21.15.70:0/1194083327 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc580051960 con 0x7fc580105070 2024-04-26T20:25:25.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.762+0000 7fc57dffb700 1 -- 172.21.15.70:0/1194083327 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc578004ad0 con 0x7fc580105070 2024-04-26T20:25:25.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.763+0000 7fc57dffb700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc5700a3d80 0x7fc5700a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:25.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.763+0000 7fc584a77700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc5700a3d80 0x7fc5700a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:25.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.763+0000 7fc57dffb700 1 -- 172.21.15.70:0/1194083327 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fc5780cfbd0 con 0x7fc580105070 2024-04-26T20:25:25.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.763+0000 7fc584a77700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc5700a3d80 0x7fc5700a6240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc574006010 tx=0x7fc574000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:25.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:25.767+0000 7fc57dffb700 1 -- 172.21.15.70:0/1194083327 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc578021020 con 0x7fc580105070 2024-04-26T20:25:26.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.053+0000 7fc586cdb700 1 -- 172.21.15.70:0/1194083327 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc580064030 con 0x7fc580105070 2024-04-26T20:25:26.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.055+0000 7fc57dffb700 1 -- 172.21.15.70:0/1194083327 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fc57809c690 con 0x7fc580105070 2024-04-26T20:25:26.056 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-04-26T20:25:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC2DSxmpgNIAxAATt47/oxNKZ1CsjjHFnF1PA== 2024-04-26T20:25:26.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 -- 172.21.15.70:0/1194083327 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc5700a3d80 msgr2=0x7fc5700a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:26.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc5700a3d80 0x7fc5700a6240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc574006010 tx=0x7fc574000bc0 comp rx=0 tx=0).stop 2024-04-26T20:25:26.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 -- 172.21.15.70:0/1194083327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc580105070 msgr2=0x7fc580075d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:26.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc580105070 0x7fc580075d50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc57800ada0 tx=0x7fc57800c330 comp rx=0 tx=0).stop 2024-04-26T20:25:26.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 -- 172.21.15.70:0/1194083327 shutdown_connections 2024-04-26T20:25:26.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc5700a3d80 0x7fc5700a6240 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:26.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc580105070 0x7fc580075d50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:26.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5801034d0 0x7fc5800771c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:26.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 --2- 172.21.15.70:0/1194083327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5801046d0 0x7fc580075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:26.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 -- 172.21.15.70:0/1194083327 >> 172.21.15.70:0/1194083327 conn(0x7fc5800fea70 msgr2=0x7fc580107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:26.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 -- 172.21.15.70:0/1194083327 shutdown_connections 2024-04-26T20:25:26.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:26.058+0000 7fc586cdb700 1 -- 172.21.15.70:0/1194083327 wait complete. 2024-04-26T20:25:26.219 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:25:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b[62209]: 2024-04-26T20:25:25.842+0000 7fc27ecb9700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-26T20:25:26.870 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:25:26.870 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-26T20:25:26.870 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T20:25:26.909 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T20:25:26.909 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-26T20:25:26.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-26T20:25:27.193 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:26 smithi098 ceph-mon[32591]: pgmap v295: 97 pgs: 97 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2024-04-26T20:25:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:26 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1194083327' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T20:25:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:26 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1194083327' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T20:25:27.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:26 smithi080 ceph-mon[32278]: pgmap v295: 97 pgs: 97 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2024-04-26T20:25:27.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:26 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1194083327' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T20:25:27.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:26 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1194083327' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T20:25:27.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:26 smithi070 ceph-mon[29124]: pgmap v295: 97 pgs: 97 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2024-04-26T20:25:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:26 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1194083327' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T20:25:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:26 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1194083327' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T20:25:28.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.917+0000 7f2448399700 1 -- 172.21.15.70:0/4204214018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2440102320 msgr2=0x7f24401027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:28.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.917+0000 7f2448399700 1 --2- 172.21.15.70:0/4204214018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2440102320 0x7f24401027a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2430009990 tx=0x7f2430009ca0 comp rx=0 tx=0).stop 2024-04-26T20:25:28.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.917+0000 7f2448399700 1 -- 172.21.15.70:0/4204214018 shutdown_connections 2024-04-26T20:25:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.917+0000 7f2448399700 1 --2- 172.21.15.70:0/4204214018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440102ce0 0x7f244010f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.917+0000 7f2448399700 1 --2- 172.21.15.70:0/4204214018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2440108390 0x7f2440108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.917+0000 7f2448399700 1 --2- 172.21.15.70:0/4204214018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2440102320 0x7f24401027a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.917+0000 7f2448399700 1 -- 172.21.15.70:0/4204214018 >> 172.21.15.70:0/4204214018 conn(0x7f24400792d0 msgr2=0x7f24400796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.917+0000 7f2448399700 1 -- 172.21.15.70:0/4204214018 shutdown_connections 2024-04-26T20:25:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.917+0000 7f2448399700 1 -- 172.21.15.70:0/4204214018 wait complete. 2024-04-26T20:25:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2448399700 1 Processor -- start 2024-04-26T20:25:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2448399700 1 -- start start 2024-04-26T20:25:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2448399700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2440102320 0x7f244019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2448399700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2440102ce0 0x7f244019b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2448399700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440108390 0x7f24401a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2448399700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24401126f0 con 0x7f2440102320 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2448399700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2440112570 con 0x7f2440102ce0 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2448399700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2440112870 con 0x7f2440108390 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2446135700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2440102320 0x7f244019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2446135700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2440102320 0x7f244019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58392/0 (socket says 172.21.15.70:58392) 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2446135700 1 -- 172.21.15.70:0/1294766529 learned_addr learned my addr 172.21.15.70:0/1294766529 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2446936700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440108390 0x7f24401a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2445934700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2440102ce0 0x7f244019b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2446135700 1 -- 172.21.15.70:0/1294766529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440108390 msgr2=0x7f24401a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2446135700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440108390 0x7f24401a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2446135700 1 -- 172.21.15.70:0/1294766529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2440102ce0 msgr2=0x7f244019b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2446135700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2440102ce0 0x7f244019b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2446135700 1 -- 172.21.15.70:0/1294766529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24401a6130 con 0x7f2440102320 2024-04-26T20:25:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.918+0000 7f2445934700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2440102ce0 0x7f244019b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.919+0000 7f2446135700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2440102320 0x7f244019ab70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f243c00b530 tx=0x7f243c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.919+0000 7f24377fe700 1 -- 172.21.15.70:0/1294766529 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c015020 con 0x7f2440102320 2024-04-26T20:25:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.919+0000 7f2448399700 1 -- 172.21.15.70:0/1294766529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24401a6360 con 0x7f2440102320 2024-04-26T20:25:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.919+0000 7f24377fe700 1 -- 172.21.15.70:0/1294766529 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f243c011d00 con 0x7f2440102320 2024-04-26T20:25:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.919+0000 7f24377fe700 1 -- 172.21.15.70:0/1294766529 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c00f2e0 con 0x7f2440102320 2024-04-26T20:25:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.919+0000 7f2448399700 1 -- 172.21.15.70:0/1294766529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24401a6870 con 0x7f2440102320 2024-04-26T20:25:28.923 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:28 smithi070 ceph-mon[29124]: pgmap v296: 97 pgs: 97 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 KiB/s wr, 26 op/s 2024-04-26T20:25:28.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.920+0000 7f2448399700 1 -- 172.21.15.70:0/1294766529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f244010a900 con 0x7f2440102320 2024-04-26T20:25:28.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.921+0000 7f24377fe700 1 -- 172.21.15.70:0/1294766529 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f243c018020 con 0x7f2440102320 2024-04-26T20:25:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.921+0000 7f24377fe700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f242c0a3cd0 0x7f242c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.922+0000 7f2445934700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f242c0a3cd0 0x7f242c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.922+0000 7f24377fe700 1 -- 172.21.15.70:0/1294766529 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f243c0cfb00 con 0x7f2440102320 2024-04-26T20:25:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.922+0000 7f2445934700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f242c0a3cd0 0x7f242c0a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2430006010 tx=0x7f243000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:28.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:28.926+0000 7f24377fe700 1 -- 172.21.15.70:0/1294766529 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f243c01f020 con 0x7f2440102320 2024-04-26T20:25:29.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.182+0000 7f2448399700 1 -- 172.21.15.70:0/1294766529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2440103a40 con 0x7f2440102320 2024-04-26T20:25:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.187+0000 7f24377fe700 1 -- 172.21.15.70:0/1294766529 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264994 (secure 0 0 0) 0x7f243c09c640 con 0x7f2440102320 2024-04-26T20:25:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:29.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 -- 172.21.15.70:0/1294766529 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f242c0a3cd0 msgr2=0x7f242c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f242c0a3cd0 0x7f242c0a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2430006010 tx=0x7f243000b540 comp rx=0 tx=0).stop 2024-04-26T20:25:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 -- 172.21.15.70:0/1294766529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2440102320 msgr2=0x7f244019ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2440102320 0x7f244019ab70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f243c00b530 tx=0x7f243c00b840 comp rx=0 tx=0).stop 2024-04-26T20:25:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 -- 172.21.15.70:0/1294766529 shutdown_connections 2024-04-26T20:25:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f242c0a3cd0 0x7f242c0a6190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440108390 0x7f24401a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2440102320 0x7f244019ab70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 --2- 172.21.15.70:0/1294766529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2440102ce0 0x7f244019b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 -- 172.21.15.70:0/1294766529 >> 172.21.15.70:0/1294766529 conn(0x7f24400792d0 msgr2=0x7f2440100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 -- 172.21.15.70:0/1294766529 shutdown_connections 2024-04-26T20:25:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:29.191+0000 7f2448399700 1 -- 172.21.15.70:0/1294766529 wait complete. 2024-04-26T20:25:29.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:28 smithi098 ceph-mon[32591]: pgmap v296: 97 pgs: 97 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 KiB/s wr, 26 op/s 2024-04-26T20:25:29.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:28 smithi080 ceph-mon[32278]: pgmap v296: 97 pgs: 97 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 KiB/s wr, 26 op/s 2024-04-26T20:25:30.060 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":828657527},{"type":"v1","addr":"172.21.15.70:6801","nonce":828657527}]},"active_addr":"172.21.15.70:6801/828657527","active_change":"2024-04-26T20:18:07.694287+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.70:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1996137110}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3579803061}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":358585512}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1870744030}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3045016659}]}]} 2024-04-26T20:25:30.066 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-26T20:25:30.066 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-26T20:25:30.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T20:25:30.091 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:29 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1294766529' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T20:25:30.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:29 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1294766529' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T20:25:30.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:29 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1294766529' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T20:25:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:31.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:30 smithi070 ceph-mon[29124]: pgmap v297: 97 pgs: 97 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.5 KiB/s wr, 25 op/s 2024-04-26T20:25:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:30 smithi098 ceph-mon[32591]: pgmap v297: 97 pgs: 97 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.5 KiB/s wr, 25 op/s 2024-04-26T20:25:31.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:30 smithi080 ceph-mon[32278]: pgmap v297: 97 pgs: 97 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.5 KiB/s wr, 25 op/s 2024-04-26T20:25:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.069+0000 7f0443954700 1 -- 172.21.15.70:0/3053470225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f043c102320 msgr2=0x7f043c1027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.069+0000 7f0443954700 1 --2- 172.21.15.70:0/3053470225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f043c102320 0x7f043c1027a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f042c009990 tx=0x7f042c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:25:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.069+0000 7f0443954700 1 -- 172.21.15.70:0/3053470225 shutdown_connections 2024-04-26T20:25:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.069+0000 7f0443954700 1 --2- 172.21.15.70:0/3053470225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f043c102ce0 0x7f043c10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.069+0000 7f0443954700 1 --2- 172.21.15.70:0/3053470225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f043c108390 0x7f043c108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.069+0000 7f0443954700 1 --2- 172.21.15.70:0/3053470225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f043c102320 0x7f043c1027a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.069+0000 7f0443954700 1 -- 172.21.15.70:0/3053470225 >> 172.21.15.70:0/3053470225 conn(0x7f043c0792d0 msgr2=0x7f043c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:32.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.069+0000 7f0443954700 1 -- 172.21.15.70:0/3053470225 shutdown_connections 2024-04-26T20:25:32.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.069+0000 7f0443954700 1 -- 172.21.15.70:0/3053470225 wait complete. 2024-04-26T20:25:32.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0443954700 1 Processor -- start 2024-04-26T20:25:32.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0443954700 1 -- start start 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0443954700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f043c102320 0x7f043c19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0443954700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f043c102ce0 0x7f043c19ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0443954700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f043c108390 0x7f043c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0443954700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f043c1126f0 con 0x7f043c108390 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0443954700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f043c112570 con 0x7f043c102320 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0443954700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f043c112870 con 0x7f043c102ce0 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0441ef1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f043c108390 0x7f043c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0441ef1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f043c108390 0x7f043c199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50626/0 (socket says 172.21.15.70:50626) 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0441ef1700 1 -- 172.21.15.70:0/1327171494 learned_addr learned my addr 172.21.15.70:0/1327171494 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0440eef700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f043c102ce0 0x7f043c19ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f04416f0700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f043c102320 0x7f043c19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0441ef1700 1 -- 172.21.15.70:0/1327171494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f043c102ce0 msgr2=0x7f043c19ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0441ef1700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f043c102ce0 0x7f043c19ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0441ef1700 1 -- 172.21.15.70:0/1327171494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f043c102320 msgr2=0x7f043c19fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0441ef1700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f043c102320 0x7f043c19fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.070+0000 7f0441ef1700 1 -- 172.21.15.70:0/1327171494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c19a3f0 con 0x7f043c108390 2024-04-26T20:25:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.071+0000 7f0441ef1700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f043c108390 0x7f043c199b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f043800b550 tx=0x7f043800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.071+0000 7f04327fc700 1 -- 172.21.15.70:0/1327171494 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438015020 con 0x7f043c108390 2024-04-26T20:25:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.071+0000 7f04327fc700 1 -- 172.21.15.70:0/1327171494 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0438011d00 con 0x7f043c108390 2024-04-26T20:25:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.071+0000 7f0443954700 1 -- 172.21.15.70:0/1327171494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043c19a6e0 con 0x7f043c108390 2024-04-26T20:25:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.071+0000 7f04327fc700 1 -- 172.21.15.70:0/1327171494 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438010d40 con 0x7f043c108390 2024-04-26T20:25:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.071+0000 7f0443954700 1 -- 172.21.15.70:0/1327171494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043c1a69c0 con 0x7f043c108390 2024-04-26T20:25:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.072+0000 7f0443954700 1 -- 172.21.15.70:0/1327171494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f043c103a40 con 0x7f043c108390 2024-04-26T20:25:32.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.074+0000 7f04327fc700 1 -- 172.21.15.70:0/1327171494 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0438018020 con 0x7f043c108390 2024-04-26T20:25:32.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.074+0000 7f04327fc700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f04280a3d50 0x7f04280a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:32.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.074+0000 7f04416f0700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f04280a3d50 0x7f04280a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:32.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.074+0000 7f04327fc700 1 -- 172.21.15.70:0/1327171494 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f04380cfe70 con 0x7f043c108390 2024-04-26T20:25:32.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.075+0000 7f04416f0700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f04280a3d50 0x7f04280a6210 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f043400a400 tx=0x7f043400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:32.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.078+0000 7f04327fc700 1 -- 172.21.15.70:0/1327171494 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f043801f020 con 0x7f043c108390 2024-04-26T20:25:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.274+0000 7f0443954700 1 -- 172.21.15.70:0/1327171494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f043c1a6b90 con 0x7f043c108390 2024-04-26T20:25:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.276+0000 7f04327fc700 1 -- 172.21.15.70:0/1327171494 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22148 (secure 0 0 0) 0x7f0438096e20 con 0x7f043c108390 2024-04-26T20:25:32.277 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:32.277 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:25:16.872684+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:25:32.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 -- 172.21.15.70:0/1327171494 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f04280a3d50 msgr2=0x7f04280a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:32.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f04280a3d50 0x7f04280a6210 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f043400a400 tx=0x7f043400d040 comp rx=0 tx=0).stop 2024-04-26T20:25:32.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 -- 172.21.15.70:0/1327171494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f043c108390 msgr2=0x7f043c199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:32.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f043c108390 0x7f043c199b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f043800b550 tx=0x7f043800b860 comp rx=0 tx=0).stop 2024-04-26T20:25:32.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 -- 172.21.15.70:0/1327171494 shutdown_connections 2024-04-26T20:25:32.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f04280a3d50 0x7f04280a6210 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:32.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f043c108390 0x7f043c199b10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:32.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f043c102320 0x7f043c19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:32.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 --2- 172.21.15.70:0/1327171494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f043c102ce0 0x7f043c19ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:32.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 -- 172.21.15.70:0/1327171494 >> 172.21.15.70:0/1327171494 conn(0x7f043c0792d0 msgr2=0x7f043c101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:32.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 -- 172.21.15.70:0/1327171494 shutdown_connections 2024-04-26T20:25:32.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:32.278+0000 7f0443954700 1 -- 172.21.15.70:0/1327171494 wait complete. 2024-04-26T20:25:33.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:32 smithi070 ceph-mon[29124]: pgmap v298: 97 pgs: 97 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2024-04-26T20:25:33.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:32 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1327171494' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:33.106 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-26T20:25:33.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T20:25:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:32 smithi098 ceph-mon[32591]: pgmap v298: 97 pgs: 97 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2024-04-26T20:25:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:32 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1327171494' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:33.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:32 smithi080 ceph-mon[32278]: pgmap v298: 97 pgs: 97 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2024-04-26T20:25:33.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:32 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1327171494' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:33.391 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:34 smithi098 ceph-mon[32591]: pgmap v299: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 23 op/s 2024-04-26T20:25:34.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:34 smithi070 ceph-mon[29124]: pgmap v299: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 23 op/s 2024-04-26T20:25:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.095+0000 7fdf51b32700 1 -- 172.21.15.70:0/626645494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf4c108390 msgr2=0x7fdf4c108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.095+0000 7fdf51b32700 1 --2- 172.21.15.70:0/626645494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf4c108390 0x7fdf4c108770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009990 tx=0x7fdf3c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:25:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.095+0000 7fdf51b32700 1 -- 172.21.15.70:0/626645494 shutdown_connections 2024-04-26T20:25:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.095+0000 7fdf51b32700 1 --2- 172.21.15.70:0/626645494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf4c102ce0 0x7fdf4c10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.095+0000 7fdf51b32700 1 --2- 172.21.15.70:0/626645494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf4c108390 0x7fdf4c108770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.095+0000 7fdf51b32700 1 --2- 172.21.15.70:0/626645494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf4c102320 0x7fdf4c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.095+0000 7fdf51b32700 1 -- 172.21.15.70:0/626645494 >> 172.21.15.70:0/626645494 conn(0x7fdf4c0792d0 msgr2=0x7fdf4c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.095+0000 7fdf51b32700 1 -- 172.21.15.70:0/626645494 shutdown_connections 2024-04-26T20:25:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.095+0000 7fdf51b32700 1 -- 172.21.15.70:0/626645494 wait complete. 2024-04-26T20:25:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf51b32700 1 Processor -- start 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf51b32700 1 -- start start 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf51b32700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf4c102320 0x7fdf4c19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf51b32700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf4c102ce0 0x7fdf4c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf51b32700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf4c108390 0x7fdf4c1999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf51b32700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c06bdb0 con 0x7fdf4c102ce0 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf51b32700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c06bc30 con 0x7fdf4c102320 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf51b32700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c06bf30 con 0x7fdf4c108390 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf4affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf4c102ce0 0x7fdf4c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf4affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf4c102ce0 0x7fdf4c19fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50642/0 (socket says 172.21.15.70:50642) 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf4affd700 1 -- 172.21.15.70:0/1851783372 learned_addr learned my addr 172.21.15.70:0/1851783372 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf4bfff700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf4c108390 0x7fdf4c1999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf4b7fe700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf4c102320 0x7fdf4c19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf4affd700 1 -- 172.21.15.70:0/1851783372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf4c108390 msgr2=0x7fdf4c1999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf4affd700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf4c108390 0x7fdf4c1999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:35.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf4affd700 1 -- 172.21.15.70:0/1851783372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf4c102320 msgr2=0x7fdf4c19f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:35.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf4affd700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf4c102320 0x7fdf4c19f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:35.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.096+0000 7fdf4affd700 1 -- 172.21.15.70:0/1851783372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4c19a150 con 0x7fdf4c102ce0 2024-04-26T20:25:35.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.097+0000 7fdf4affd700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf4c102ce0 0x7fdf4c19fd70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400d980 tx=0x7fdf3400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:35.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.097+0000 7fdf48ff9700 1 -- 172.21.15.70:0/1851783372 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34017070 con 0x7fdf4c102ce0 2024-04-26T20:25:35.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.097+0000 7fdf51b32700 1 -- 172.21.15.70:0/1851783372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4c19a440 con 0x7fdf4c102ce0 2024-04-26T20:25:35.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.097+0000 7fdf48ff9700 1 -- 172.21.15.70:0/1851783372 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdf34005020 con 0x7fdf4c102ce0 2024-04-26T20:25:35.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.097+0000 7fdf48ff9700 1 -- 172.21.15.70:0/1851783372 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34009bf0 con 0x7fdf4c102ce0 2024-04-26T20:25:35.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.097+0000 7fdf51b32700 1 -- 172.21.15.70:0/1851783372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf4c1a6700 con 0x7fdf4c102ce0 2024-04-26T20:25:35.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.098+0000 7fdf51b32700 1 -- 172.21.15.70:0/1851783372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf4c06a110 con 0x7fdf4c102ce0 2024-04-26T20:25:35.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.099+0000 7fdf48ff9700 1 -- 172.21.15.70:0/1851783372 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fdf340051d0 con 0x7fdf4c102ce0 2024-04-26T20:25:35.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.100+0000 7fdf48ff9700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdf380a3cd0 0x7fdf380a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:35.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.100+0000 7fdf4b7fe700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdf380a3cd0 0x7fdf380a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:35.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.100+0000 7fdf48ff9700 1 -- 172.21.15.70:0/1851783372 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fdf340d0290 con 0x7fdf4c102ce0 2024-04-26T20:25:35.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.100+0000 7fdf4b7fe700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdf380a3cd0 0x7fdf380a6190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c006010 tx=0x7fdf3c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.105+0000 7fdf48ff9700 1 -- 172.21.15.70:0/1851783372 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fdf34020020 con 0x7fdf4c102ce0 2024-04-26T20:25:35.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:34 smithi080 ceph-mon[32278]: pgmap v299: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 23 op/s 2024-04-26T20:25:35.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.307+0000 7fdf51b32700 1 -- 172.21.15.70:0/1851783372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf4c02e490 con 0x7fdf4c102ce0 2024-04-26T20:25:35.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.308+0000 7fdf48ff9700 1 -- 172.21.15.70:0/1851783372 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22148 (secure 0 0 0) 0x7fdf3409ccc0 con 0x7fdf4c102ce0 2024-04-26T20:25:35.309 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:25:35.309 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:25:16.872684+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:25:35.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 -- 172.21.15.70:0/1851783372 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdf380a3cd0 msgr2=0x7fdf380a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:35.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdf380a3cd0 0x7fdf380a6190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c006010 tx=0x7fdf3c00b540 comp rx=0 tx=0).stop 2024-04-26T20:25:35.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 -- 172.21.15.70:0/1851783372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf4c102ce0 msgr2=0x7fdf4c19fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:35.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf4c102ce0 0x7fdf4c19fd70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400d980 tx=0x7fdf3400dc90 comp rx=0 tx=0).stop 2024-04-26T20:25:35.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 -- 172.21.15.70:0/1851783372 shutdown_connections 2024-04-26T20:25:35.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdf380a3cd0 0x7fdf380a6190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:35.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf4c108390 0x7fdf4c1999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:35.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf4c102320 0x7fdf4c19f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:35.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 --2- 172.21.15.70:0/1851783372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf4c102ce0 0x7fdf4c19fd70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:35.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 -- 172.21.15.70:0/1851783372 >> 172.21.15.70:0/1851783372 conn(0x7fdf4c0792d0 msgr2=0x7fdf4c100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:35.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 -- 172.21.15.70:0/1851783372 shutdown_connections 2024-04-26T20:25:35.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:35.310+0000 7fdf51b32700 1 -- 172.21.15.70:0/1851783372 wait complete. 2024-04-26T20:25:36.110 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:35 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1851783372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:36.112 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-26T20:25:36.113 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-26T20:25:36.113 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-26T20:25:36.113 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-26T20:25:36.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-26T20:25:36.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-26T20:25:36.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-26T20:25:36.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-26T20:25:36.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-26T20:25:36.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-26T20:25:36.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-26T20:25:36.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-26T20:25:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:35 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1851783372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:36.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:35 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1851783372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:25:36.840 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:36.844 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:37.174 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:36 smithi070 ceph-mon[29124]: pgmap v300: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-04-26T20:25:37.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:36 smithi098 ceph-mon[32591]: pgmap v300: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-04-26T20:25:37.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:36 smithi080 ceph-mon[32278]: pgmap v300: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-04-26T20:25:37.912 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:37.913 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:37.913 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:37.917 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:38.980 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:38 smithi070 ceph-mon[29124]: pgmap v301: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-04-26T20:25:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:38 smithi098 ceph-mon[32591]: pgmap v301: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-04-26T20:25:39.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:38 smithi080 ceph-mon[32278]: pgmap v301: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-04-26T20:25:41.150 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:40 smithi070 ceph-mon[29124]: pgmap v302: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-26T20:25:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:40 smithi098 ceph-mon[32591]: pgmap v302: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-26T20:25:41.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:40 smithi080 ceph-mon[32278]: pgmap v302: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-26T20:25:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:42 smithi098 ceph-mon[32591]: pgmap v303: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-04-26T20:25:43.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:42 smithi080 ceph-mon[32278]: pgmap v303: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-04-26T20:25:43.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:42 smithi070 ceph-mon[29124]: pgmap v303: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-04-26T20:25:43.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.545+0000 7fed12462700 1 -- 172.21.15.70:0/3706086122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed0c102ce0 msgr2=0x7fed0c10f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:43.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.545+0000 7fed12462700 1 --2- 172.21.15.70:0/3706086122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed0c102ce0 0x7fed0c10f1d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fed0400b0a0 tx=0x7fed0400b3b0 comp rx=0 tx=0).stop 2024-04-26T20:25:43.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.545+0000 7fed12462700 1 -- 172.21.15.70:0/3706086122 shutdown_connections 2024-04-26T20:25:43.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.545+0000 7fed12462700 1 --2- 172.21.15.70:0/3706086122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed0c102ce0 0x7fed0c10f1d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:43.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.545+0000 7fed12462700 1 --2- 172.21.15.70:0/3706086122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0c108390 0x7fed0c108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:43.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.545+0000 7fed12462700 1 --2- 172.21.15.70:0/3706086122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed0c102320 0x7fed0c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:43.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.545+0000 7fed12462700 1 -- 172.21.15.70:0/3706086122 >> 172.21.15.70:0/3706086122 conn(0x7fed0c0792d0 msgr2=0x7fed0c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:43.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.545+0000 7fed12462700 1 -- 172.21.15.70:0/3706086122 shutdown_connections 2024-04-26T20:25:43.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.546+0000 7fed12462700 1 -- 172.21.15.70:0/3706086122 wait complete. 2024-04-26T20:25:43.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.546+0000 7fed12462700 1 Processor -- start 2024-04-26T20:25:43.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.546+0000 7fed12462700 1 -- start start 2024-04-26T20:25:43.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed12462700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed0c102320 0x7fed0c19f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:43.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed12462700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed0c102ce0 0x7fed0c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:43.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed12462700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0c108390 0x7fed0c199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:43.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed12462700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c112670 con 0x7fed0c102320 2024-04-26T20:25:43.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed12462700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c1124f0 con 0x7fed0c108390 2024-04-26T20:25:43.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed12462700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c1127f0 con 0x7fed0c102ce0 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed0bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed0c102320 0x7fed0c19f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed0bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed0c102320 0x7fed0c19f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60368/0 (socket says 172.21.15.70:60368) 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed0bfff700 1 -- 172.21.15.70:0/63426488 learned_addr learned my addr 172.21.15.70:0/63426488 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed0b7fe700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed0c102ce0 0x7fed0c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed109ff700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0c108390 0x7fed0c199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed0bfff700 1 -- 172.21.15.70:0/63426488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed0c102ce0 msgr2=0x7fed0c19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed0bfff700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed0c102ce0 0x7fed0c19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed0bfff700 1 -- 172.21.15.70:0/63426488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0c108390 msgr2=0x7fed0c199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed0bfff700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0c108390 0x7fed0c199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.547+0000 7fed0bfff700 1 -- 172.21.15.70:0/63426488 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c19a1c0 con 0x7fed0c102320 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.548+0000 7fed0bfff700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed0c102320 0x7fed0c19f8a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00c920 tx=0x7fecfc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.548+0000 7fed097fa700 1 -- 172.21.15.70:0/63426488 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc004a30 con 0x7fed0c102320 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.548+0000 7fed12462700 1 -- 172.21.15.70:0/63426488 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0c19a4b0 con 0x7fed0c102320 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.548+0000 7fed097fa700 1 -- 172.21.15.70:0/63426488 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fecfc0054f0 con 0x7fed0c102320 2024-04-26T20:25:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.548+0000 7fed12462700 1 -- 172.21.15.70:0/63426488 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed0c1a6770 con 0x7fed0c102320 2024-04-26T20:25:43.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.548+0000 7fed097fa700 1 -- 172.21.15.70:0/63426488 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc007cd0 con 0x7fed0c102320 2024-04-26T20:25:43.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.549+0000 7fed12462700 1 -- 172.21.15.70:0/63426488 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed0c106410 con 0x7fed0c102320 2024-04-26T20:25:43.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.550+0000 7fed097fa700 1 -- 172.21.15.70:0/63426488 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fecfc004eb0 con 0x7fed0c102320 2024-04-26T20:25:43.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.551+0000 7fed097fa700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fecf40a3d50 0x7fecf40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:43.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.551+0000 7fed0b7fe700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fecf40a3d50 0x7fecf40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:43.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.551+0000 7fed097fa700 1 -- 172.21.15.70:0/63426488 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fecfc0d0390 con 0x7fed0c102320 2024-04-26T20:25:43.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.551+0000 7fed097fa700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474] conn(0x7fecf40ad530 0x7fecf40af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:43.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.551+0000 7fed097fa700 1 -- 172.21.15.70:0/63426488 --> [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecfc012ec0 con 0x7fecf40ad530 2024-04-26T20:25:43.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.551+0000 7fed097fa700 1 -- 172.21.15.70:0/63426488 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fecfc0d0870 con 0x7fed0c102320 2024-04-26T20:25:43.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.551+0000 7fed109ff700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474] conn(0x7fecf40ad530 0x7fecf40af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:43.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.551+0000 7fed0b7fe700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fecf40a3d50 0x7fecf40a6210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fed0c079860 tx=0x7fed00009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:43.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.552+0000 7fed109ff700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474] conn(0x7fecf40ad530 0x7fecf40af950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:43.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.552+0000 7fed097fa700 1 -- 172.21.15.70:0/63426488 <== osd.3 v2:172.21.15.70:6810/2247334474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fecfc012ec0 con 0x7fecf40ad530 2024-04-26T20:25:43.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.568+0000 7fed12462700 1 -- 172.21.15.70:0/63426488 --> [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed0c106620 con 0x7fecf40ad530 2024-04-26T20:25:43.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed097fa700 1 -- 172.21.15.70:0/63426488 <== osd.3 v2:172.21.15.70:6810/2247334474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fed0c106620 con 0x7fecf40ad530 2024-04-26T20:25:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed12462700 1 -- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474] conn(0x7fecf40ad530 msgr2=0x7fecf40af950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed12462700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474] conn(0x7fecf40ad530 0x7fecf40af950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed12462700 1 -- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fecf40a3d50 msgr2=0x7fecf40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed12462700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fecf40a3d50 0x7fecf40a6210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fed0c079860 tx=0x7fed00009190 comp rx=0 tx=0).stop 2024-04-26T20:25:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed12462700 1 -- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed0c102320 msgr2=0x7fed0c19f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed12462700 1 --2- 172.21.15.70:0/63426488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed0c102320 0x7fed0c19f8a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00c920 tx=0x7fecfc00cc30 comp rx=0 tx=0).stop 2024-04-26T20:25:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed109ff700 1 -- 172.21.15.70:0/63426488 reap_dead start 2024-04-26T20:25:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed12462700 1 -- 172.21.15.70:0/63426488 shutdown_connections 2024-04-26T20:25:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed12462700 1 -- 172.21.15.70:0/63426488 >> 172.21.15.70:0/63426488 conn(0x7fed0c0792d0 msgr2=0x7fed0c101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed12462700 1 -- 172.21.15.70:0/63426488 shutdown_connections 2024-04-26T20:25:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:43.569+0000 7fed12462700 1 -- 172.21.15.70:0/63426488 wait complete. 2024-04-26T20:25:44.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.727+0000 7f11caec1700 1 -- 172.21.15.70:0/1524573487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11c41094c0 msgr2=0x7f11c41098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:44.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.727+0000 7f11caec1700 1 --2- 172.21.15.70:0/1524573487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11c41094c0 0x7f11c41098a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009990 tx=0x7f11b8009ca0 comp rx=0 tx=0).stop 2024-04-26T20:25:44.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.727+0000 7f11caec1700 1 -- 172.21.15.70:0/1524573487 shutdown_connections 2024-04-26T20:25:44.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.727+0000 7f11caec1700 1 --2- 172.21.15.70:0/1524573487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11c4103e30 0x7f11c4110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:44.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.727+0000 7f11caec1700 1 --2- 172.21.15.70:0/1524573487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11c41094c0 0x7f11c41098a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:44.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.727+0000 7f11caec1700 1 --2- 172.21.15.70:0/1524573487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11c4103470 0x7f11c41038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:44.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.727+0000 7f11caec1700 1 -- 172.21.15.70:0/1524573487 >> 172.21.15.70:0/1524573487 conn(0x7f11c407a580 msgr2=0x7f11c407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:44.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.727+0000 7f11caec1700 1 -- 172.21.15.70:0/1524573487 shutdown_connections 2024-04-26T20:25:44.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.727+0000 7f11caec1700 1 -- 172.21.15.70:0/1524573487 wait complete. 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11caec1700 1 Processor -- start 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11caec1700 1 -- start start 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11caec1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11c4103470 0x7f11c419f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11caec1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11c4103e30 0x7f11c419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11caec1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11c41094c0 0x7f11c4199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11caec1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f11c4113780 con 0x7f11c4103e30 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11caec1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f11c4113600 con 0x7f11c4103470 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11caec1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f11c4113900 con 0x7f11c41094c0 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11c3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11c4103e30 0x7f11c419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11c3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11c4103e30 0x7f11c419fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60386/0 (socket says 172.21.15.70:60386) 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11c3fff700 1 -- 172.21.15.70:0/3659793745 learned_addr learned my addr 172.21.15.70:0/3659793745 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11c8c5d700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11c4103470 0x7f11c419f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11c945e700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11c41094c0 0x7f11c4199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11c3fff700 1 -- 172.21.15.70:0/3659793745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11c41094c0 msgr2=0x7f11c4199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11c3fff700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11c41094c0 0x7f11c4199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11c3fff700 1 -- 172.21.15.70:0/3659793745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11c4103470 msgr2=0x7f11c419f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11c3fff700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11c4103470 0x7f11c419f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11c3fff700 1 -- 172.21.15.70:0/3659793745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c419a240 con 0x7f11c4103e30 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.728+0000 7f11c945e700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11c41094c0 0x7f11c4199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.729+0000 7f11c3fff700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11c4103e30 0x7f11c419fe60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f11b000b530 tx=0x7f11b000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.729+0000 7f11c1ffb700 1 -- 172.21.15.70:0/3659793745 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0015020 con 0x7f11c4103e30 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.729+0000 7f11c1ffb700 1 -- 172.21.15.70:0/3659793745 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11b0011d00 con 0x7f11c4103e30 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.729+0000 7f11caec1700 1 -- 172.21.15.70:0/3659793745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c419a530 con 0x7f11c4103e30 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.729+0000 7f11c1ffb700 1 -- 172.21.15.70:0/3659793745 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b000f2e0 con 0x7f11c4103e30 2024-04-26T20:25:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.729+0000 7f11caec1700 1 -- 172.21.15.70:0/3659793745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c41a67f0 con 0x7f11c4103e30 2024-04-26T20:25:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.730+0000 7f11caec1700 1 -- 172.21.15.70:0/3659793745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11c4063b30 con 0x7f11c4103e30 2024-04-26T20:25:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.731+0000 7f11c1ffb700 1 -- 172.21.15.70:0/3659793745 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f11b0018020 con 0x7f11c4103e30 2024-04-26T20:25:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.731+0000 7f11c1ffb700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11b40a3d50 0x7f11b40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.732+0000 7f11c8c5d700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11b40a3d50 0x7f11b40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.732+0000 7f11c1ffb700 1 -- 172.21.15.70:0/3659793745 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f11b00d0210 con 0x7f11c4103e30 2024-04-26T20:25:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.732+0000 7f11c1ffb700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895] conn(0x7f11b40ad530 0x7f11b40af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.732+0000 7f11c1ffb700 1 -- 172.21.15.70:0/3659793745 --> [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11b001ce70 con 0x7f11b40ad530 2024-04-26T20:25:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.732+0000 7f11c1ffb700 1 -- 172.21.15.70:0/3659793745 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f11b00d06f0 con 0x7f11c4103e30 2024-04-26T20:25:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.732+0000 7f11c8c5d700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11b40a3d50 0x7f11b40a6210 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f11b800b5c0 tx=0x7f11b8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.732+0000 7f11c945e700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895] conn(0x7f11b40ad530 0x7f11b40af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.733+0000 7f11c945e700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895] conn(0x7f11b40ad530 0x7f11b40af950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.734+0000 7f11c1ffb700 1 -- 172.21.15.70:0/3659793745 <== osd.7 v2:172.21.15.80:6816/1066348895 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11b001ce70 con 0x7f11b40ad530 2024-04-26T20:25:44.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.750+0000 7f11caec1700 1 -- 172.21.15.70:0/3659793745 --> [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f11c4063f30 con 0x7f11b40ad530 2024-04-26T20:25:44.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.750+0000 7f11c1ffb700 1 -- 172.21.15.70:0/3659793745 <== osd.7 v2:172.21.15.80:6816/1066348895 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f11c4063f30 con 0x7f11b40ad530 2024-04-26T20:25:44.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.750+0000 7f11caec1700 1 -- 172.21.15.70:0/3659793745 >> [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895] conn(0x7f11b40ad530 msgr2=0x7f11b40af950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:44.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.751+0000 7f11caec1700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895] conn(0x7f11b40ad530 0x7f11b40af950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:44.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.751+0000 7f11caec1700 1 -- 172.21.15.70:0/3659793745 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11b40a3d50 msgr2=0x7f11b40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:44.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.751+0000 7f11caec1700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11b40a3d50 0x7f11b40a6210 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f11b800b5c0 tx=0x7f11b8005960 comp rx=0 tx=0).stop 2024-04-26T20:25:44.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.751+0000 7f11caec1700 1 -- 172.21.15.70:0/3659793745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11c4103e30 msgr2=0x7f11c419fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:44.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.751+0000 7f11caec1700 1 --2- 172.21.15.70:0/3659793745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11c4103e30 0x7f11c419fe60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f11b000b530 tx=0x7f11b000b840 comp rx=0 tx=0).stop 2024-04-26T20:25:44.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.751+0000 7f11c945e700 1 -- 172.21.15.70:0/3659793745 reap_dead start 2024-04-26T20:25:44.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.751+0000 7f11caec1700 1 -- 172.21.15.70:0/3659793745 shutdown_connections 2024-04-26T20:25:44.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.751+0000 7f11caec1700 1 -- 172.21.15.70:0/3659793745 >> 172.21.15.70:0/3659793745 conn(0x7f11c407a580 msgr2=0x7f11c4102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:44.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.751+0000 7f11caec1700 1 -- 172.21.15.70:0/3659793745 shutdown_connections 2024-04-26T20:25:44.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.751+0000 7f11caec1700 1 -- 172.21.15.70:0/3659793745 wait complete. 2024-04-26T20:25:44.952 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:44 smithi070 ceph-mon[29124]: pgmap v304: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-26T20:25:45.001 INFO:teuthology.orchestra.run.smithi070.stdout:111669149756 2024-04-26T20:25:45.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-26T20:25:45.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.951+0000 7fcb450fa700 1 -- 172.21.15.70:0/1147548252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb40103230 msgr2=0x7fcb40107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.951+0000 7fcb450fa700 1 --2- 172.21.15.70:0/1147548252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb40103230 0x7fcb40107000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcb340099c0 tx=0x7fcb34009cd0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.951+0000 7fcb450fa700 1 -- 172.21.15.70:0/1147548252 shutdown_connections 2024-04-26T20:25:45.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.951+0000 7fcb450fa700 1 --2- 172.21.15.70:0/1147548252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb401076e0 0x7fcb4010f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.951+0000 7fcb450fa700 1 --2- 172.21.15.70:0/1147548252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb40102880 0x7fcb40102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.951+0000 7fcb450fa700 1 --2- 172.21.15.70:0/1147548252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb40103230 0x7fcb40107000 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.951+0000 7fcb450fa700 1 -- 172.21.15.70:0/1147548252 >> 172.21.15.70:0/1147548252 conn(0x7fcb40079120 msgr2=0x7fcb40079530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.951+0000 7fcb450fa700 1 -- 172.21.15.70:0/1147548252 shutdown_connections 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.951+0000 7fcb450fa700 1 -- 172.21.15.70:0/1147548252 wait complete. 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.951+0000 7fcb450fa700 1 Processor -- start 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb450fa700 1 -- start start 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb450fa700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb40102880 0x7fcb4019f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb450fa700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb40103230 0x7fcb4019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb450fa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb401076e0 0x7fcb40199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb450fa700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcb40112710 con 0x7fcb40103230 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb450fa700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcb40112590 con 0x7fcb40102880 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb450fa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcb40112890 con 0x7fcb401076e0 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb3e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb40103230 0x7fcb4019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb3e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb40103230 0x7fcb4019fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60390/0 (socket says 172.21.15.70:60390) 2024-04-26T20:25:45.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb3e59c700 1 -- 172.21.15.70:0/1476462489 learned_addr learned my addr 172.21.15.70:0/1476462489 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:45.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb3ed9d700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb40102880 0x7fcb4019f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb3f59e700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb401076e0 0x7fcb40199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb3e59c700 1 -- 172.21.15.70:0/1476462489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb401076e0 msgr2=0x7fcb40199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb3e59c700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb401076e0 0x7fcb40199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb3e59c700 1 -- 172.21.15.70:0/1476462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb40102880 msgr2=0x7fcb4019f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb3e59c700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb40102880 0x7fcb4019f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.952+0000 7fcb3e59c700 1 -- 172.21.15.70:0/1476462489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4019a1c0 con 0x7fcb40103230 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.953+0000 7fcb3e59c700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb40103230 0x7fcb4019fde0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcb340098e0 tx=0x7fcb34005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.953+0000 7fcb27fff700 1 -- 172.21.15.70:0/1476462489 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34027070 con 0x7fcb40103230 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.953+0000 7fcb450fa700 1 -- 172.21.15.70:0/1476462489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4019a450 con 0x7fcb40103230 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.953+0000 7fcb450fa700 1 -- 172.21.15.70:0/1476462489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb401a6770 con 0x7fcb40103230 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.953+0000 7fcb27fff700 1 -- 172.21.15.70:0/1476462489 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcb340040b0 con 0x7fcb40103230 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.953+0000 7fcb27fff700 1 -- 172.21.15.70:0/1476462489 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400f460 con 0x7fcb40103230 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.954+0000 7fcb450fa700 1 -- 172.21.15.70:0/1476462489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcb40063af0 con 0x7fcb40103230 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.955+0000 7fcb27fff700 1 -- 172.21.15.70:0/1476462489 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fcb3402a070 con 0x7fcb40103230 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.955+0000 7fcb27fff700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcb280a3cd0 0x7fcb280a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.956+0000 7fcb3ed9d700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcb280a3cd0 0x7fcb280a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.956+0000 7fcb27fff700 1 -- 172.21.15.70:0/1476462489 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fcb340d1d30 con 0x7fcb40103230 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.956+0000 7fcb27fff700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845] conn(0x7fcb280ad4b0 0x7fcb280af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.956+0000 7fcb27fff700 1 -- 172.21.15.70:0/1476462489 --> [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb34001d30 con 0x7fcb280ad4b0 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.956+0000 7fcb27fff700 1 -- 172.21.15.70:0/1476462489 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fcb340d2210 con 0x7fcb40103230 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.956+0000 7fcb3f59e700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845] conn(0x7fcb280ad4b0 0x7fcb280af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.956+0000 7fcb3ed9d700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcb280a3cd0 0x7fcb280a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcb30006fd0 tx=0x7fcb30008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.956+0000 7fcb3f59e700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845] conn(0x7fcb280ad4b0 0x7fcb280af8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.957+0000 7fcb27fff700 1 -- 172.21.15.70:0/1476462489 <== osd.0 v2:172.21.15.70:6802/1173414845 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb34001d30 con 0x7fcb280ad4b0 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.974+0000 7fcb450fa700 1 -- 172.21.15.70:0/1476462489 --> [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcb40063f20 con 0x7fcb280ad4b0 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb27fff700 1 -- 172.21.15.70:0/1476462489 <== osd.0 v2:172.21.15.70:6802/1173414845 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcb40063f20 con 0x7fcb280ad4b0 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb450fa700 1 -- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845] conn(0x7fcb280ad4b0 msgr2=0x7fcb280af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb450fa700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845] conn(0x7fcb280ad4b0 0x7fcb280af8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb450fa700 1 -- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcb280a3cd0 msgr2=0x7fcb280a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb450fa700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcb280a3cd0 0x7fcb280a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcb30006fd0 tx=0x7fcb30008040 comp rx=0 tx=0).stop 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb450fa700 1 -- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb40103230 msgr2=0x7fcb4019fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb450fa700 1 --2- 172.21.15.70:0/1476462489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb40103230 0x7fcb4019fde0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcb340098e0 tx=0x7fcb34005640 comp rx=0 tx=0).stop 2024-04-26T20:25:45.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb3f59e700 1 -- 172.21.15.70:0/1476462489 reap_dead start 2024-04-26T20:25:45.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb450fa700 1 -- 172.21.15.70:0/1476462489 shutdown_connections 2024-04-26T20:25:45.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb450fa700 1 -- 172.21.15.70:0/1476462489 >> 172.21.15.70:0/1476462489 conn(0x7fcb40079120 msgr2=0x7fcb40106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:45.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb450fa700 1 -- 172.21.15.70:0/1476462489 shutdown_connections 2024-04-26T20:25:45.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:44.975+0000 7fcb450fa700 1 -- 172.21.15.70:0/1476462489 wait complete. 2024-04-26T20:25:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:44 smithi098 ceph-mon[32591]: pgmap v304: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-26T20:25:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:44 smithi080 ceph-mon[32278]: pgmap v304: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-26T20:25:45.853 INFO:teuthology.orchestra.run.smithi070.stdout:34359738443 2024-04-26T20:25:45.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-26T20:25:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:47.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:46 smithi098 ceph-mon[32591]: pgmap v305: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:25:47.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:46 smithi080 ceph-mon[32278]: pgmap v305: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:25:47.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:46 smithi070 ceph-mon[29124]: pgmap v305: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:25:47.310 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:25:49.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:48 smithi098 ceph-mon[32591]: pgmap v306: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:25:49.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:48 smithi080 ceph-mon[32278]: pgmap v306: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:25:49.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:48 smithi070 ceph-mon[29124]: pgmap v306: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:25:49.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.870+0000 7f6991d6a700 1 -- 172.21.15.70:0/757209434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f698c1094a0 msgr2=0x7f698c109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:49.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.870+0000 7f6991d6a700 1 --2- 172.21.15.70:0/757209434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f698c1094a0 0x7f698c109880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f697c009990 tx=0x7f697c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:25:49.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.870+0000 7f6991d6a700 1 -- 172.21.15.70:0/757209434 shutdown_connections 2024-04-26T20:25:49.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.870+0000 7f6991d6a700 1 --2- 172.21.15.70:0/757209434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f698c06bad0 0x7f698c1102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:49.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.870+0000 7f6991d6a700 1 --2- 172.21.15.70:0/757209434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f698c1094a0 0x7f698c109880 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:49.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.870+0000 7f6991d6a700 1 --2- 172.21.15.70:0/757209434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f698c06b130 0x7f698c06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:49.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.870+0000 7f6991d6a700 1 -- 172.21.15.70:0/757209434 >> 172.21.15.70:0/757209434 conn(0x7f698c0792d0 msgr2=0x7f698c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:49.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.870+0000 7f6991d6a700 1 -- 172.21.15.70:0/757209434 shutdown_connections 2024-04-26T20:25:49.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.870+0000 7f6991d6a700 1 -- 172.21.15.70:0/757209434 wait complete. 2024-04-26T20:25:49.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.870+0000 7f6991d6a700 1 Processor -- start 2024-04-26T20:25:49.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f6991d6a700 1 -- start start 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f6991d6a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f698c06b130 0x7f698c199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f6991d6a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f698c06bad0 0x7f698c19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f6991d6a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f698c1094a0 0x7f698c19e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f6991d6a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f698c1137d0 con 0x7f698c1094a0 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f6991d6a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f698c113650 con 0x7f698c06b130 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f6991d6a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f698c113950 con 0x7f698c06bad0 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f698bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f698c1094a0 0x7f698c19e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f698bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f698c1094a0 0x7f698c19e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52676/0 (socket says 172.21.15.70:52676) 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f698bfff700 1 -- 172.21.15.70:0/2222710442 learned_addr learned my addr 172.21.15.70:0/2222710442 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f698affd700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f698c06bad0 0x7f698c19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f698b7fe700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f698c06b130 0x7f698c199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:49.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f698bfff700 1 -- 172.21.15.70:0/2222710442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f698c06bad0 msgr2=0x7f698c19a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:49.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f698bfff700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f698c06bad0 0x7f698c19a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:49.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f698bfff700 1 -- 172.21.15.70:0/2222710442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f698c06b130 msgr2=0x7f698c199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:49.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f698bfff700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f698c06b130 0x7f698c199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:49.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f698bfff700 1 -- 172.21.15.70:0/2222710442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c19ed70 con 0x7f698c1094a0 2024-04-26T20:25:49.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.871+0000 7f698bfff700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f698c1094a0 0x7f698c19e630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f698400b970 tx=0x7f698400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:49.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.872+0000 7f6988ff9700 1 -- 172.21.15.70:0/2222710442 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984019070 con 0x7f698c1094a0 2024-04-26T20:25:49.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.872+0000 7f6991d6a700 1 -- 172.21.15.70:0/2222710442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c19f060 con 0x7f698c1094a0 2024-04-26T20:25:49.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.872+0000 7f6988ff9700 1 -- 172.21.15.70:0/2222710442 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f698400ce00 con 0x7f698c1094a0 2024-04-26T20:25:49.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.872+0000 7f6988ff9700 1 -- 172.21.15.70:0/2222710442 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984007370 con 0x7f698c1094a0 2024-04-26T20:25:49.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.872+0000 7f6991d6a700 1 -- 172.21.15.70:0/2222710442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c1a68e0 con 0x7f698c1094a0 2024-04-26T20:25:49.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.873+0000 7f6991d6a700 1 -- 172.21.15.70:0/2222710442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f698c063b70 con 0x7f698c1094a0 2024-04-26T20:25:49.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.874+0000 7f6988ff9700 1 -- 172.21.15.70:0/2222710442 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f698401c070 con 0x7f698c1094a0 2024-04-26T20:25:49.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.874+0000 7f6988ff9700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f69740a3d50 0x7f69740a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:49.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.874+0000 7f698b7fe700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f69740a3d50 0x7f69740a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:49.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.875+0000 7f6988ff9700 1 -- 172.21.15.70:0/2222710442 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f69840cf770 con 0x7f698c1094a0 2024-04-26T20:25:49.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.875+0000 7f6988ff9700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535] conn(0x7f69740ad530 0x7f69740af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:49.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.875+0000 7f6988ff9700 1 -- 172.21.15.70:0/2222710442 --> [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69740b0000 con 0x7f69740ad530 2024-04-26T20:25:49.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.875+0000 7f6988ff9700 1 -- 172.21.15.70:0/2222710442 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f69840d42c0 con 0x7f698c1094a0 2024-04-26T20:25:49.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.875+0000 7f698b7fe700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f69740a3d50 0x7f69740a6210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f697c009750 tx=0x7f697c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:49.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.875+0000 7f698affd700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535] conn(0x7f69740ad530 0x7f69740af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:49.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.875+0000 7f698affd700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535] conn(0x7f69740ad530 0x7f69740af950 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:49.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.876+0000 7f6988ff9700 1 -- 172.21.15.70:0/2222710442 <== osd.5 v2:172.21.15.98:6808/2247181535 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f69740b0000 con 0x7f69740ad530 2024-04-26T20:25:49.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.893+0000 7f6991d6a700 1 -- 172.21.15.70:0/2222710442 --> [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f698c063fa0 con 0x7f69740ad530 2024-04-26T20:25:49.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.893+0000 7f6988ff9700 1 -- 172.21.15.70:0/2222710442 <== osd.5 v2:172.21.15.98:6808/2247181535 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f698c063fa0 con 0x7f69740ad530 2024-04-26T20:25:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.893+0000 7f6991d6a700 1 -- 172.21.15.70:0/2222710442 >> [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535] conn(0x7f69740ad530 msgr2=0x7f69740af950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.893+0000 7f6991d6a700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535] conn(0x7f69740ad530 0x7f69740af950 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.893+0000 7f6991d6a700 1 -- 172.21.15.70:0/2222710442 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f69740a3d50 msgr2=0x7f69740a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.893+0000 7f6991d6a700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f69740a3d50 0x7f69740a6210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f697c009750 tx=0x7f697c00b540 comp rx=0 tx=0).stop 2024-04-26T20:25:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.893+0000 7f6991d6a700 1 -- 172.21.15.70:0/2222710442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f698c1094a0 msgr2=0x7f698c19e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.893+0000 7f6991d6a700 1 --2- 172.21.15.70:0/2222710442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f698c1094a0 0x7f698c19e630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f698400b970 tx=0x7f698400bc80 comp rx=0 tx=0).stop 2024-04-26T20:25:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.893+0000 7f698bfff700 1 -- 172.21.15.70:0/2222710442 reap_dead start 2024-04-26T20:25:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.894+0000 7f6991d6a700 1 -- 172.21.15.70:0/2222710442 shutdown_connections 2024-04-26T20:25:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.894+0000 7f6991d6a700 1 -- 172.21.15.70:0/2222710442 >> 172.21.15.70:0/2222710442 conn(0x7f698c0792d0 msgr2=0x7f698c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.894+0000 7f6991d6a700 1 -- 172.21.15.70:0/2222710442 shutdown_connections 2024-04-26T20:25:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:49.894+0000 7f6991d6a700 1 -- 172.21.15.70:0/2222710442 wait complete. 2024-04-26T20:25:51.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:50 smithi098 ceph-mon[32591]: pgmap v307: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:25:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:50 smithi080 ceph-mon[32278]: pgmap v307: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:25:51.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:50 smithi070 ceph-mon[29124]: pgmap v307: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:25:53.015 INFO:teuthology.orchestra.run.smithi070.stdout:223338299432 2024-04-26T20:25:53.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-26T20:25:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:52 smithi098 ceph-mon[32591]: pgmap v308: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:25:53.210 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:52 smithi070 ceph-mon[29124]: pgmap v308: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:25:53.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:52 smithi080 ceph-mon[32278]: pgmap v308: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:25:54.120 INFO:teuthology.orchestra.run.smithi070.stdout:167503724596 2024-04-26T20:25:54.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-26T20:25:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.419+0000 7fa9fde34700 1 -- 172.21.15.70:0/2900576963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f806c510 msgr2=0x7fa9f81102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.419+0000 7fa9fde34700 1 --2- 172.21.15.70:0/2900576963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f806c510 0x7fa9f81102e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000b0a0 tx=0x7fa9f000b3b0 comp rx=0 tx=0).stop 2024-04-26T20:25:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.419+0000 7fa9fde34700 1 -- 172.21.15.70:0/2900576963 shutdown_connections 2024-04-26T20:25:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.419+0000 7fa9fde34700 1 --2- 172.21.15.70:0/2900576963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f806c510 0x7fa9f81102e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.419+0000 7fa9fde34700 1 --2- 172.21.15.70:0/2900576963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f81094a0 0x7fa9f8109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.419+0000 7fa9fde34700 1 --2- 172.21.15.70:0/2900576963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f806bb70 0x7fa9f806bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.419+0000 7fa9fde34700 1 -- 172.21.15.70:0/2900576963 >> 172.21.15.70:0/2900576963 conn(0x7fa9f80792f0 msgr2=0x7fa9f8079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.419+0000 7fa9fde34700 1 -- 172.21.15.70:0/2900576963 shutdown_connections 2024-04-26T20:25:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.419+0000 7fa9fde34700 1 -- 172.21.15.70:0/2900576963 wait complete. 2024-04-26T20:25:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.420+0000 7fa9fde34700 1 Processor -- start 2024-04-26T20:25:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.420+0000 7fa9fde34700 1 -- start start 2024-04-26T20:25:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.420+0000 7fa9fde34700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f806bb70 0x7fa9f819f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.420+0000 7fa9fde34700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f806c510 0x7fa9f819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.420+0000 7fa9fde34700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f81094a0 0x7fa9f81998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.420+0000 7fa9fde34700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f81136e0 con 0x7fa9f806c510 2024-04-26T20:25:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.420+0000 7fa9fde34700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8113560 con 0x7fa9f806bb70 2024-04-26T20:25:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.420+0000 7fa9fde34700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8113860 con 0x7fa9f81094a0 2024-04-26T20:25:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.420+0000 7fa9f6ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f806c510 0x7fa9f819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.420+0000 7fa9f77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f806bb70 0x7fa9f819f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f6ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f806c510 0x7fa9f819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52694/0 (socket says 172.21.15.70:52694) 2024-04-26T20:25:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f806bb70 0x7fa9f819f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.70:55628/0 (socket says 172.21.15.70:55628) 2024-04-26T20:25:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f81094a0 0x7fa9f81998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f6ffd700 1 -- 172.21.15.70:0/2888421640 learned_addr learned my addr 172.21.15.70:0/2888421640 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f6ffd700 1 -- 172.21.15.70:0/2888421640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f81094a0 msgr2=0x7fa9f81998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f6ffd700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9f81094a0 0x7fa9f81998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f6ffd700 1 -- 172.21.15.70:0/2888421640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f806bb70 msgr2=0x7fa9f819f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f6ffd700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f806bb70 0x7fa9f819f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f6ffd700 1 -- 172.21.15.70:0/2888421640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f819a020 con 0x7fa9f806c510 2024-04-26T20:25:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f77fe700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f806bb70 0x7fa9f819f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f6ffd700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f806c510 0x7fa9f819fc40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00d950 tx=0x7fa9ec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f4ff9700 1 -- 172.21.15.70:0/2888421640 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec016070 con 0x7fa9f806c510 2024-04-26T20:25:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f4ff9700 1 -- 172.21.15.70:0/2888421640 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9ec00fd60 con 0x7fa9f806c510 2024-04-26T20:25:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9fde34700 1 -- 172.21.15.70:0/2888421640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f819a310 con 0x7fa9f806c510 2024-04-26T20:25:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9f4ff9700 1 -- 172.21.15.70:0/2888421640 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec00e610 con 0x7fa9f806c510 2024-04-26T20:25:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.421+0000 7fa9fde34700 1 -- 172.21.15.70:0/2888421640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f81a65d0 con 0x7fa9f806c510 2024-04-26T20:25:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.422+0000 7fa9fde34700 1 -- 172.21.15.70:0/2888421640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa9f8100c80 con 0x7fa9f806c510 2024-04-26T20:25:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.423+0000 7fa9f4ff9700 1 -- 172.21.15.70:0/2888421640 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa9ec019070 con 0x7fa9f806c510 2024-04-26T20:25:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.424+0000 7fa9f4ff9700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa9e00a3cd0 0x7fa9e00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.424+0000 7fa9f77fe700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa9e00a3cd0 0x7fa9e00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.424+0000 7fa9f4ff9700 1 -- 172.21.15.70:0/2888421640 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fa9ec0d03c0 con 0x7fa9f806c510 2024-04-26T20:25:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.424+0000 7fa9f4ff9700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700] conn(0x7fa9e00ad4b0 0x7fa9e00af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.424+0000 7fa9f4ff9700 1 -- 172.21.15.70:0/2888421640 --> [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9ec013ec0 con 0x7fa9e00ad4b0 2024-04-26T20:25:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.424+0000 7fa9f4ff9700 1 -- 172.21.15.70:0/2888421640 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fa9ec0d08a0 con 0x7fa9f806c510 2024-04-26T20:25:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.424+0000 7fa9f77fe700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa9e00a3cd0 0x7fa9e00a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa9f819aa00 tx=0x7fa9e800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.424+0000 7fa9f7fff700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700] conn(0x7fa9e00ad4b0 0x7fa9e00af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.425+0000 7fa9f7fff700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700] conn(0x7fa9e00ad4b0 0x7fa9e00af8d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.426+0000 7fa9f4ff9700 1 -- 172.21.15.70:0/2888421640 <== osd.8 v2:172.21.15.98:6816/588538700 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa9ec013ec0 con 0x7fa9e00ad4b0 2024-04-26T20:25:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.445+0000 7fa9fde34700 1 -- 172.21.15.70:0/2888421640 --> [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa9f8104b50 con 0x7fa9e00ad4b0 2024-04-26T20:25:54.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.446+0000 7fa9f4ff9700 1 -- 172.21.15.70:0/2888421640 <== osd.8 v2:172.21.15.98:6816/588538700 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa9f8104b50 con 0x7fa9e00ad4b0 2024-04-26T20:25:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.446+0000 7fa9fde34700 1 -- 172.21.15.70:0/2888421640 >> [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700] conn(0x7fa9e00ad4b0 msgr2=0x7fa9e00af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.446+0000 7fa9fde34700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700] conn(0x7fa9e00ad4b0 0x7fa9e00af8d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.446+0000 7fa9fde34700 1 -- 172.21.15.70:0/2888421640 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa9e00a3cd0 msgr2=0x7fa9e00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.446+0000 7fa9fde34700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa9e00a3cd0 0x7fa9e00a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa9f819aa00 tx=0x7fa9e800a380 comp rx=0 tx=0).stop 2024-04-26T20:25:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.446+0000 7fa9fde34700 1 -- 172.21.15.70:0/2888421640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f806c510 msgr2=0x7fa9f819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.446+0000 7fa9fde34700 1 --2- 172.21.15.70:0/2888421640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f806c510 0x7fa9f819fc40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00d950 tx=0x7fa9ec00dc60 comp rx=0 tx=0).stop 2024-04-26T20:25:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.446+0000 7fa9f7fff700 1 -- 172.21.15.70:0/2888421640 reap_dead start 2024-04-26T20:25:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.446+0000 7fa9fde34700 1 -- 172.21.15.70:0/2888421640 shutdown_connections 2024-04-26T20:25:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.446+0000 7fa9fde34700 1 -- 172.21.15.70:0/2888421640 >> 172.21.15.70:0/2888421640 conn(0x7fa9f80792f0 msgr2=0x7fa9f8100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.447+0000 7fa9fde34700 1 -- 172.21.15.70:0/2888421640 shutdown_connections 2024-04-26T20:25:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:54.447+0000 7fa9fde34700 1 -- 172.21.15.70:0/2888421640 wait complete. 2024-04-26T20:25:55.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:54 smithi098 ceph-mon[32591]: pgmap v309: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T20:25:55.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:54 smithi080 ceph-mon[32278]: pgmap v309: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T20:25:55.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:54 smithi070 ceph-mon[29124]: pgmap v309: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T20:25:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.773+0000 7fe324e4d700 1 -- 172.21.15.70:0/311781649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe320103e80 msgr2=0x7fe320110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.773+0000 7fe324e4d700 1 --2- 172.21.15.70:0/311781649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe320103e80 0x7fe320110330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe31800b0d0 tx=0x7fe31800b3e0 comp rx=0 tx=0).stop 2024-04-26T20:25:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.773+0000 7fe324e4d700 1 -- 172.21.15.70:0/311781649 shutdown_connections 2024-04-26T20:25:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.773+0000 7fe324e4d700 1 --2- 172.21.15.70:0/311781649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe320103e80 0x7fe320110330 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.773+0000 7fe324e4d700 1 --2- 172.21.15.70:0/311781649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe320109560 0x7fe320109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.773+0000 7fe324e4d700 1 --2- 172.21.15.70:0/311781649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3201034c0 0x7fe320103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.773+0000 7fe324e4d700 1 -- 172.21.15.70:0/311781649 >> 172.21.15.70:0/311781649 conn(0x7fe32007a5d0 msgr2=0x7fe32007a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.773+0000 7fe324e4d700 1 -- 172.21.15.70:0/311781649 shutdown_connections 2024-04-26T20:25:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.773+0000 7fe324e4d700 1 -- 172.21.15.70:0/311781649 wait complete. 2024-04-26T20:25:56.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe324e4d700 1 Processor -- start 2024-04-26T20:25:56.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe324e4d700 1 -- start start 2024-04-26T20:25:56.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe324e4d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3201034c0 0x7fe320199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe324e4d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320103e80 0x7fe32019a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe324e4d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe320109560 0x7fe32019e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe324e4d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe320113880 con 0x7fe320109560 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe324e4d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe320113700 con 0x7fe3201034c0 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe324e4d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe320113a00 con 0x7fe320103e80 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe31ed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe320109560 0x7fe32019e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe31ed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe320109560 0x7fe32019e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52706/0 (socket says 172.21.15.70:52706) 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe31ed9d700 1 -- 172.21.15.70:0/1125871078 learned_addr learned my addr 172.21.15.70:0/1125871078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe315d9b700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320103e80 0x7fe32019a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe31e59c700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3201034c0 0x7fe320199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe31ed9d700 1 -- 172.21.15.70:0/1125871078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320103e80 msgr2=0x7fe32019a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe31ed9d700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320103e80 0x7fe32019a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe31ed9d700 1 -- 172.21.15.70:0/1125871078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3201034c0 msgr2=0x7fe320199d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:56.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe31ed9d700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3201034c0 0x7fe320199d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:56.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.774+0000 7fe31ed9d700 1 -- 172.21.15.70:0/1125871078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32019ed30 con 0x7fe320109560 2024-04-26T20:25:56.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.775+0000 7fe31ed9d700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe320109560 0x7fe32019e5f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe318007a20 tx=0x7fe318007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:56.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.775+0000 7fe317fff700 1 -- 172.21.15.70:0/1125871078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318021070 con 0x7fe320109560 2024-04-26T20:25:56.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.775+0000 7fe324e4d700 1 -- 172.21.15.70:0/1125871078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32019efc0 con 0x7fe320109560 2024-04-26T20:25:56.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.775+0000 7fe317fff700 1 -- 172.21.15.70:0/1125871078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe318007e10 con 0x7fe320109560 2024-04-26T20:25:56.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.775+0000 7fe317fff700 1 -- 172.21.15.70:0/1125871078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31801bd30 con 0x7fe320109560 2024-04-26T20:25:56.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.775+0000 7fe324e4d700 1 -- 172.21.15.70:0/1125871078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3201a68a0 con 0x7fe320109560 2024-04-26T20:25:56.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.776+0000 7fe324e4d700 1 -- 172.21.15.70:0/1125871078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe320063b30 con 0x7fe320109560 2024-04-26T20:25:56.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.777+0000 7fe317fff700 1 -- 172.21.15.70:0/1125871078 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe318024070 con 0x7fe320109560 2024-04-26T20:25:56.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.777+0000 7fe317fff700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe30c0a3cd0 0x7fe30c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.777+0000 7fe31e59c700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe30c0a3cd0 0x7fe30c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.778+0000 7fe317fff700 1 -- 172.21.15.70:0/1125871078 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fe31800f020 con 0x7fe320109560 2024-04-26T20:25:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.778+0000 7fe317fff700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547] conn(0x7fe30c0ad4b0 0x7fe30c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.778+0000 7fe317fff700 1 -- 172.21.15.70:0/1125871078 --> [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe31801b5f0 con 0x7fe30c0ad4b0 2024-04-26T20:25:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.778+0000 7fe317fff700 1 -- 172.21.15.70:0/1125871078 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fe3180d2400 con 0x7fe320109560 2024-04-26T20:25:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.778+0000 7fe31e59c700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe30c0a3cd0 0x7fe30c0a6190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe310006fd0 tx=0x7fe310008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.778+0000 7fe315d9b700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547] conn(0x7fe30c0ad4b0 0x7fe30c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.778+0000 7fe315d9b700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547] conn(0x7fe30c0ad4b0 0x7fe30c0af8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.779+0000 7fe317fff700 1 -- 172.21.15.70:0/1125871078 <== osd.10 v2:172.21.15.80:6824/3717005547 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe31801b5f0 con 0x7fe30c0ad4b0 2024-04-26T20:25:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.796+0000 7fe324e4d700 1 -- 172.21.15.70:0/1125871078 --> [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe320063f60 con 0x7fe30c0ad4b0 2024-04-26T20:25:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.796+0000 7fe317fff700 1 -- 172.21.15.70:0/1125871078 <== osd.10 v2:172.21.15.80:6824/3717005547 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe320063f60 con 0x7fe30c0ad4b0 2024-04-26T20:25:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.797+0000 7fe324e4d700 1 -- 172.21.15.70:0/1125871078 >> [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547] conn(0x7fe30c0ad4b0 msgr2=0x7fe30c0af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.797+0000 7fe324e4d700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547] conn(0x7fe30c0ad4b0 0x7fe30c0af8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.797+0000 7fe324e4d700 1 -- 172.21.15.70:0/1125871078 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe30c0a3cd0 msgr2=0x7fe30c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.797+0000 7fe324e4d700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe30c0a3cd0 0x7fe30c0a6190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe310006fd0 tx=0x7fe310008040 comp rx=0 tx=0).stop 2024-04-26T20:25:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.797+0000 7fe324e4d700 1 -- 172.21.15.70:0/1125871078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe320109560 msgr2=0x7fe32019e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.797+0000 7fe324e4d700 1 --2- 172.21.15.70:0/1125871078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe320109560 0x7fe32019e5f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe318007a20 tx=0x7fe318007b00 comp rx=0 tx=0).stop 2024-04-26T20:25:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.797+0000 7fe31ed9d700 1 -- 172.21.15.70:0/1125871078 reap_dead start 2024-04-26T20:25:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.797+0000 7fe324e4d700 1 -- 172.21.15.70:0/1125871078 shutdown_connections 2024-04-26T20:25:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.797+0000 7fe324e4d700 1 -- 172.21.15.70:0/1125871078 >> 172.21.15.70:0/1125871078 conn(0x7fe32007a5d0 msgr2=0x7fe320102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.797+0000 7fe324e4d700 1 -- 172.21.15.70:0/1125871078 shutdown_connections 2024-04-26T20:25:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:56.797+0000 7fe324e4d700 1 -- 172.21.15.70:0/1125871078 wait complete. 2024-04-26T20:25:57.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:56 smithi070 ceph-mon[29124]: pgmap v310: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:25:57.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:56 smithi098 ceph-mon[32591]: pgmap v310: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:25:57.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:56 smithi080 ceph-mon[32278]: pgmap v310: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:25:58.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.334+0000 7f949c902700 1 -- 172.21.15.70:0/561160335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94981094a0 msgr2=0x7f9498109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:58.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.334+0000 7f949c902700 1 --2- 172.21.15.70:0/561160335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94981094a0 0x7f9498109880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9488009990 tx=0x7f9488009ca0 comp rx=0 tx=0).stop 2024-04-26T20:25:58.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.334+0000 7f949c902700 1 -- 172.21.15.70:0/561160335 shutdown_connections 2024-04-26T20:25:58.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.334+0000 7f949c902700 1 --2- 172.21.15.70:0/561160335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f949806bad0 0x7f94981102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.334+0000 7f949c902700 1 --2- 172.21.15.70:0/561160335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94981094a0 0x7f9498109880 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.334+0000 7f949c902700 1 --2- 172.21.15.70:0/561160335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f949806b130 0x7f949806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.334+0000 7f949c902700 1 -- 172.21.15.70:0/561160335 >> 172.21.15.70:0/561160335 conn(0x7f94980792d0 msgr2=0x7f94980796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.334+0000 7f949c902700 1 -- 172.21.15.70:0/561160335 shutdown_connections 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.334+0000 7f949c902700 1 -- 172.21.15.70:0/561160335 wait complete. 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f949c902700 1 Processor -- start 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f949c902700 1 -- start start 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f949c902700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f949806b130 0x7f94981023f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f949c902700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f949806bad0 0x7f9498102930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f949c902700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94981094a0 0x7f9498102e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f949c902700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94981137a0 con 0x7f94981094a0 2024-04-26T20:25:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f949c902700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9498113620 con 0x7f949806b130 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f949c902700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9498113920 con 0x7f949806bad0 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f9496d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94981094a0 0x7f9498102e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f9496d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94981094a0 0x7f9498102e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52724/0 (socket says 172.21.15.70:52724) 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f9496d9d700 1 -- 172.21.15.70:0/2915644871 learned_addr learned my addr 172.21.15.70:0/2915644871 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f949659c700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f949806b130 0x7f94981023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f9495d9b700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f949806bad0 0x7f9498102930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f9496d9d700 1 -- 172.21.15.70:0/2915644871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f949806bad0 msgr2=0x7f9498102930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f9496d9d700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f949806bad0 0x7f9498102930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f9496d9d700 1 -- 172.21.15.70:0/2915644871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f949806b130 msgr2=0x7f94981023f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f9496d9d700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f949806b130 0x7f94981023f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f9496d9d700 1 -- 172.21.15.70:0/2915644871 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94981a8140 con 0x7f94981094a0 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f9495d9b700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f949806bad0 0x7f9498102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f949659c700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f949806b130 0x7f94981023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f9496d9d700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94981094a0 0x7f9498102e70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f949000b970 tx=0x7f949000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f94877fe700 1 -- 172.21.15.70:0/2915644871 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9490019070 con 0x7f94981094a0 2024-04-26T20:25:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f949c902700 1 -- 172.21.15.70:0/2915644871 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94981a8430 con 0x7f94981094a0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.335+0000 7f94877fe700 1 -- 172.21.15.70:0/2915644871 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9490014440 con 0x7f94981094a0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.336+0000 7f94877fe700 1 -- 172.21.15.70:0/2915644871 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94900075d0 con 0x7f94981094a0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.336+0000 7f949c902700 1 -- 172.21.15.70:0/2915644871 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94981a8970 con 0x7f94981094a0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.336+0000 7f949c902700 1 -- 172.21.15.70:0/2915644871 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9498063b30 con 0x7f94981094a0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.337+0000 7f94877fe700 1 -- 172.21.15.70:0/2915644871 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f949001c070 con 0x7f94981094a0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.338+0000 7f94877fe700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f94800a3d50 0x7f94800a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.338+0000 7f949659c700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f94800a3d50 0x7f94800a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.338+0000 7f94877fe700 1 -- 172.21.15.70:0/2915644871 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f94900cfee0 con 0x7f94981094a0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.338+0000 7f94877fe700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539] conn(0x7f94800ad530 0x7f94800af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.338+0000 7f94877fe700 1 -- 172.21.15.70:0/2915644871 --> [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f949001ce50 con 0x7f94800ad530 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.338+0000 7f94877fe700 1 -- 172.21.15.70:0/2915644871 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f94900d03c0 con 0x7f94981094a0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.338+0000 7f949659c700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f94800a3d50 0x7f94800a6210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9488006010 tx=0x7f948800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.339+0000 7f9495d9b700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539] conn(0x7f94800ad530 0x7f94800af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.339+0000 7f9495d9b700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539] conn(0x7f94800ad530 0x7f94800af950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.340+0000 7f94877fe700 1 -- 172.21.15.70:0/2915644871 <== osd.11 v2:172.21.15.98:6824/1253190539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f949001ce50 con 0x7f94800ad530 2024-04-26T20:25:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.356+0000 7f949c902700 1 -- 172.21.15.70:0/2915644871 --> [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9498063f30 con 0x7f94800ad530 2024-04-26T20:25:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f94877fe700 1 -- 172.21.15.70:0/2915644871 <== osd.11 v2:172.21.15.98:6824/1253190539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9498063f30 con 0x7f94800ad530 2024-04-26T20:25:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f949c902700 1 -- 172.21.15.70:0/2915644871 >> [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539] conn(0x7f94800ad530 msgr2=0x7f94800af950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f949c902700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539] conn(0x7f94800ad530 0x7f94800af950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f949c902700 1 -- 172.21.15.70:0/2915644871 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f94800a3d50 msgr2=0x7f94800a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f949c902700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f94800a3d50 0x7f94800a6210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9488006010 tx=0x7f948800b540 comp rx=0 tx=0).stop 2024-04-26T20:25:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f949c902700 1 -- 172.21.15.70:0/2915644871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94981094a0 msgr2=0x7f9498102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f949c902700 1 --2- 172.21.15.70:0/2915644871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94981094a0 0x7f9498102e70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f949000b970 tx=0x7f949000bd30 comp rx=0 tx=0).stop 2024-04-26T20:25:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f9496d9d700 1 -- 172.21.15.70:0/2915644871 reap_dead start 2024-04-26T20:25:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f949c902700 1 -- 172.21.15.70:0/2915644871 shutdown_connections 2024-04-26T20:25:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f949c902700 1 -- 172.21.15.70:0/2915644871 >> 172.21.15.70:0/2915644871 conn(0x7f94980792d0 msgr2=0x7f9498100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f949c902700 1 -- 172.21.15.70:0/2915644871 shutdown_connections 2024-04-26T20:25:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:25:58.357+0000 7f949c902700 1 -- 172.21.15.70:0/2915644871 wait complete. 2024-04-26T20:25:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:25:58 smithi098 ceph-mon[32591]: pgmap v311: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:25:59.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:25:58 smithi080 ceph-mon[32278]: pgmap v311: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:25:59.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:25:58 smithi070 ceph-mon[29124]: pgmap v311: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:25:59.369 INFO:teuthology.orchestra.run.smithi070.stdout:347892350999 2024-04-26T20:25:59.369 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.052+0000 7f5b98c46700 1 -- 172.21.15.70:0/38152805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b94102780 msgr2=0x7f5b9410e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.052+0000 7f5b98c46700 1 --2- 172.21.15.70:0/38152805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b94102780 0x7f5b9410e990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00b0a0 tx=0x7f5b8c00b3b0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.052+0000 7f5b98c46700 1 -- 172.21.15.70:0/38152805 shutdown_connections 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.052+0000 7f5b98c46700 1 --2- 172.21.15.70:0/38152805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b94102780 0x7f5b9410e990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.052+0000 7f5b98c46700 1 --2- 172.21.15.70:0/38152805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b94107b70 0x7f5b94107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.052+0000 7f5b98c46700 1 --2- 172.21.15.70:0/38152805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b94101dc0 0x7f5b94102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.052+0000 7f5b98c46700 1 -- 172.21.15.70:0/38152805 >> 172.21.15.70:0/38152805 conn(0x7f5b94077640 msgr2=0x7f5b94077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.052+0000 7f5b98c46700 1 -- 172.21.15.70:0/38152805 shutdown_connections 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.052+0000 7f5b98c46700 1 -- 172.21.15.70:0/38152805 wait complete. 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b98c46700 1 Processor -- start 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b98c46700 1 -- start start 2024-04-26T20:26:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b98c46700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b94101dc0 0x7f5b9419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b98c46700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b94102780 0x7f5b9419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b98c46700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b94107b70 0x7f5b94199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b98c46700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5b94112720 con 0x7f5b94101dc0 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b98c46700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5b941125a0 con 0x7f5b94102780 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b98c46700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b941128a0 con 0x7f5b94107b70 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b9259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b94101dc0 0x7f5b9419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b9259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b94101dc0 0x7f5b9419f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58914/0 (socket says 172.21.15.70:58914) 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b9259c700 1 -- 172.21.15.70:0/1533778738 learned_addr learned my addr 172.21.15.70:0/1533778738 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b92d9d700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b94107b70 0x7f5b94199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b91d9b700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b94102780 0x7f5b9419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b9259c700 1 -- 172.21.15.70:0/1533778738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b94107b70 msgr2=0x7f5b94199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b9259c700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b94107b70 0x7f5b94199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b9259c700 1 -- 172.21.15.70:0/1533778738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b94102780 msgr2=0x7f5b9419fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b9259c700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b94102780 0x7f5b9419fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b9259c700 1 -- 172.21.15.70:0/1533778738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9419a1e0 con 0x7f5b94101dc0 2024-04-26T20:26:00.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b91d9b700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b94102780 0x7f5b9419fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:00.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.053+0000 7f5b9259c700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b94101dc0 0x7f5b9419f8c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400b530 tx=0x7f5b8400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:00.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.054+0000 7f5b837fe700 1 -- 172.21.15.70:0/1533778738 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84015020 con 0x7f5b94101dc0 2024-04-26T20:26:00.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.054+0000 7f5b837fe700 1 -- 172.21.15.70:0/1533778738 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5b84011d00 con 0x7f5b94101dc0 2024-04-26T20:26:00.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.054+0000 7f5b98c46700 1 -- 172.21.15.70:0/1533778738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9419a4d0 con 0x7f5b94101dc0 2024-04-26T20:26:00.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.054+0000 7f5b837fe700 1 -- 172.21.15.70:0/1533778738 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8400f2e0 con 0x7f5b94101dc0 2024-04-26T20:26:00.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.054+0000 7f5b98c46700 1 -- 172.21.15.70:0/1533778738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b941a6810 con 0x7f5b94101dc0 2024-04-26T20:26:00.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.054+0000 7f5b98c46700 1 -- 172.21.15.70:0/1533778738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b9410f660 con 0x7f5b94101dc0 2024-04-26T20:26:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.056+0000 7f5b837fe700 1 -- 172.21.15.70:0/1533778738 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5b84018020 con 0x7f5b94101dc0 2024-04-26T20:26:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.056+0000 7f5b837fe700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f5b7c0a3d50 0x7f5b7c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.056+0000 7f5b91d9b700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f5b7c0a3d50 0x7f5b7c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.056+0000 7f5b837fe700 1 -- 172.21.15.70:0/1533778738 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f5b840d0200 con 0x7f5b94101dc0 2024-04-26T20:26:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.057+0000 7f5b837fe700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691] conn(0x7f5b7c0ad530 0x7f5b7c0af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.057+0000 7f5b837fe700 1 -- 172.21.15.70:0/1533778738 --> [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b840044e0 con 0x7f5b7c0ad530 2024-04-26T20:26:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.057+0000 7f5b837fe700 1 -- 172.21.15.70:0/1533778738 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f5b840d06e0 con 0x7f5b94101dc0 2024-04-26T20:26:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.057+0000 7f5b92d9d700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691] conn(0x7f5b7c0ad530 0x7f5b7c0af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.057+0000 7f5b91d9b700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f5b7c0a3d50 0x7f5b7c0a6210 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5b94110430 tx=0x7f5b88008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.057+0000 7f5b92d9d700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691] conn(0x7f5b7c0ad530 0x7f5b7c0af950 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.058+0000 7f5b837fe700 1 -- 172.21.15.70:0/1533778738 <== osd.6 v2:172.21.15.70:6818/1060533691 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b840044e0 con 0x7f5b7c0ad530 2024-04-26T20:26:00.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b98c46700 1 -- 172.21.15.70:0/1533778738 --> [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b94103200 con 0x7f5b7c0ad530 2024-04-26T20:26:00.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b837fe700 1 -- 172.21.15.70:0/1533778738 <== osd.6 v2:172.21.15.70:6818/1060533691 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5b94103200 con 0x7f5b7c0ad530 2024-04-26T20:26:00.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b98c46700 1 -- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691] conn(0x7f5b7c0ad530 msgr2=0x7f5b7c0af950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b98c46700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691] conn(0x7f5b7c0ad530 0x7f5b7c0af950 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b98c46700 1 -- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f5b7c0a3d50 msgr2=0x7f5b7c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b98c46700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f5b7c0a3d50 0x7f5b7c0a6210 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5b94110430 tx=0x7f5b88008040 comp rx=0 tx=0).stop 2024-04-26T20:26:00.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b98c46700 1 -- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b94101dc0 msgr2=0x7f5b9419f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b98c46700 1 --2- 172.21.15.70:0/1533778738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b94101dc0 0x7f5b9419f8c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400b530 tx=0x7f5b8400b840 comp rx=0 tx=0).stop 2024-04-26T20:26:00.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b92d9d700 1 -- 172.21.15.70:0/1533778738 reap_dead start 2024-04-26T20:26:00.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b98c46700 1 -- 172.21.15.70:0/1533778738 shutdown_connections 2024-04-26T20:26:00.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b98c46700 1 -- 172.21.15.70:0/1533778738 >> 172.21.15.70:0/1533778738 conn(0x7f5b94077640 msgr2=0x7f5b94105830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:00.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b98c46700 1 -- 172.21.15.70:0/1533778738 shutdown_connections 2024-04-26T20:26:00.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.074+0000 7f5b98c46700 1 -- 172.21.15.70:0/1533778738 wait complete. 2024-04-26T20:26:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.520+0000 7fb2918a6700 1 -- 172.21.15.70:0/2694345870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c102780 msgr2=0x7fb28c10e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.520+0000 7fb2918a6700 1 --2- 172.21.15.70:0/2694345870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c102780 0x7fb28c10e990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb28400b0a0 tx=0x7fb28400b3b0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.520+0000 7fb2918a6700 1 -- 172.21.15.70:0/2694345870 shutdown_connections 2024-04-26T20:26:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.520+0000 7fb2918a6700 1 --2- 172.21.15.70:0/2694345870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c102780 0x7fb28c10e990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.520+0000 7fb2918a6700 1 --2- 172.21.15.70:0/2694345870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb28c107b70 0x7fb28c107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.520+0000 7fb2918a6700 1 --2- 172.21.15.70:0/2694345870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb28c101dc0 0x7fb28c102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.520+0000 7fb2918a6700 1 -- 172.21.15.70:0/2694345870 >> 172.21.15.70:0/2694345870 conn(0x7fb28c077640 msgr2=0x7fb28c077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.520+0000 7fb2918a6700 1 -- 172.21.15.70:0/2694345870 shutdown_connections 2024-04-26T20:26:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.520+0000 7fb2918a6700 1 -- 172.21.15.70:0/2694345870 wait complete. 2024-04-26T20:26:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.521+0000 7fb2918a6700 1 Processor -- start 2024-04-26T20:26:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.521+0000 7fb2918a6700 1 -- start start 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.521+0000 7fb2918a6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb28c101dc0 0x7fb28c19f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.521+0000 7fb2918a6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb28c102780 0x7fb28c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.521+0000 7fb2918a6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c107b70 0x7fb28c199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.521+0000 7fb2918a6700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c112660 con 0x7fb28c107b70 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.521+0000 7fb2918a6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c1124e0 con 0x7fb28c101dc0 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.521+0000 7fb2918a6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c1127e0 con 0x7fb28c102780 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c107b70 0x7fb28c199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c107b70 0x7fb28c199a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58934/0 (socket says 172.21.15.70:58934) 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28b7fe700 1 -- 172.21.15.70:0/4116661422 learned_addr learned my addr 172.21.15.70:0/4116661422 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28affd700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb28c101dc0 0x7fb28c19f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28a7fc700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb28c102780 0x7fb28c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28b7fe700 1 -- 172.21.15.70:0/4116661422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb28c102780 msgr2=0x7fb28c19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28b7fe700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb28c102780 0x7fb28c19fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28b7fe700 1 -- 172.21.15.70:0/4116661422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb28c101dc0 msgr2=0x7fb28c19f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28b7fe700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb28c101dc0 0x7fb28c19f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28b7fe700 1 -- 172.21.15.70:0/4116661422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c19a1b0 con 0x7fb28c107b70 2024-04-26T20:26:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28a7fc700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb28c102780 0x7fb28c19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28affd700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb28c101dc0 0x7fb28c19f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb28b7fe700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c107b70 0x7fb28c199a50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb28400b070 tx=0x7fb284007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb2908a4700 1 -- 172.21.15.70:0/4116661422 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284021070 con 0x7fb28c107b70 2024-04-26T20:26:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb2908a4700 1 -- 172.21.15.70:0/4116661422 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb28401db20 con 0x7fb28c107b70 2024-04-26T20:26:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb2918a6700 1 -- 172.21.15.70:0/4116661422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28c19a440 con 0x7fb28c107b70 2024-04-26T20:26:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb2908a4700 1 -- 172.21.15.70:0/4116661422 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28401bc50 con 0x7fb28c107b70 2024-04-26T20:26:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.522+0000 7fb2918a6700 1 -- 172.21.15.70:0/4116661422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28c1a6760 con 0x7fb28c107b70 2024-04-26T20:26:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.523+0000 7fb2918a6700 1 -- 172.21.15.70:0/4116661422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb28c063af0 con 0x7fb28c107b70 2024-04-26T20:26:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.524+0000 7fb2908a4700 1 -- 172.21.15.70:0/4116661422 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb284024070 con 0x7fb28c107b70 2024-04-26T20:26:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.525+0000 7fb2908a4700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2740a3cd0 0x7fb2740a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.525+0000 7fb28affd700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2740a3cd0 0x7fb2740a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.525+0000 7fb2908a4700 1 -- 172.21.15.70:0/4116661422 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fb2840d1af0 con 0x7fb28c107b70 2024-04-26T20:26:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.525+0000 7fb2908a4700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241] conn(0x7fb2740ad4b0 0x7fb2740af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.525+0000 7fb2908a4700 1 -- 172.21.15.70:0/4116661422 --> [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2740aff80 con 0x7fb2740ad4b0 2024-04-26T20:26:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.525+0000 7fb2908a4700 1 -- 172.21.15.70:0/4116661422 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fb2840d1fd0 con 0x7fb28c107b70 2024-04-26T20:26:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.525+0000 7fb28affd700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2740a3cd0 0x7fb2740a6190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb27c005e20 tx=0x7fb27c005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.525+0000 7fb28a7fc700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241] conn(0x7fb2740ad4b0 0x7fb2740af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.526+0000 7fb28a7fc700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241] conn(0x7fb2740ad4b0 0x7fb2740af8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.527+0000 7fb2908a4700 1 -- 172.21.15.70:0/4116661422 <== osd.2 v2:172.21.15.98:6800/3805036241 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb2740aff80 con 0x7fb2740ad4b0 2024-04-26T20:26:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.543+0000 7fb2918a6700 1 -- 172.21.15.70:0/4116661422 --> [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb28c063f70 con 0x7fb2740ad4b0 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.543+0000 7fb2908a4700 1 -- 172.21.15.70:0/4116661422 <== osd.2 v2:172.21.15.98:6800/3805036241 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb28c063f70 con 0x7fb2740ad4b0 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.543+0000 7fb2918a6700 1 -- 172.21.15.70:0/4116661422 >> [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241] conn(0x7fb2740ad4b0 msgr2=0x7fb2740af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.543+0000 7fb2918a6700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241] conn(0x7fb2740ad4b0 0x7fb2740af8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.543+0000 7fb2918a6700 1 -- 172.21.15.70:0/4116661422 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2740a3cd0 msgr2=0x7fb2740a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.543+0000 7fb2918a6700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2740a3cd0 0x7fb2740a6190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb27c005e20 tx=0x7fb27c005db0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.543+0000 7fb2918a6700 1 -- 172.21.15.70:0/4116661422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c107b70 msgr2=0x7fb28c199a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.543+0000 7fb2918a6700 1 --2- 172.21.15.70:0/4116661422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c107b70 0x7fb28c199a50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb28400b070 tx=0x7fb284007ad0 comp rx=0 tx=0).stop 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.543+0000 7fb28b7fe700 1 -- 172.21.15.70:0/4116661422 reap_dead start 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.544+0000 7fb2918a6700 1 -- 172.21.15.70:0/4116661422 shutdown_connections 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.544+0000 7fb2918a6700 1 -- 172.21.15.70:0/4116661422 >> 172.21.15.70:0/4116661422 conn(0x7fb28c077640 msgr2=0x7fb28c10f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.544+0000 7fb2918a6700 1 -- 172.21.15.70:0/4116661422 shutdown_connections 2024-04-26T20:26:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:00.544+0000 7fb2918a6700 1 -- 172.21.15.70:0/4116661422 wait complete. 2024-04-26T20:26:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.099+0000 7fc77a5d7700 1 -- 172.21.15.70:0/2973049150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc774109480 msgr2=0x7fc774109860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.099+0000 7fc77a5d7700 1 --2- 172.21.15.70:0/2973049150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc774109480 0x7fc774109860 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc764009990 tx=0x7fc764009ca0 comp rx=0 tx=0).stop 2024-04-26T20:26:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.099+0000 7fc77a5d7700 1 -- 172.21.15.70:0/2973049150 shutdown_connections 2024-04-26T20:26:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.099+0000 7fc77a5d7700 1 --2- 172.21.15.70:0/2973049150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc774103ea0 0x7fc7741102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.099+0000 7fc77a5d7700 1 --2- 172.21.15.70:0/2973049150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc774109480 0x7fc774109860 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.099+0000 7fc77a5d7700 1 --2- 172.21.15.70:0/2973049150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7741034e0 0x7fc774103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.099+0000 7fc77a5d7700 1 -- 172.21.15.70:0/2973049150 >> 172.21.15.70:0/2973049150 conn(0x7fc77407a5e0 msgr2=0x7fc77407a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.099+0000 7fc77a5d7700 1 -- 172.21.15.70:0/2973049150 shutdown_connections 2024-04-26T20:26:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.099+0000 7fc77a5d7700 1 -- 172.21.15.70:0/2973049150 wait complete. 2024-04-26T20:26:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc77a5d7700 1 Processor -- start 2024-04-26T20:26:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc77a5d7700 1 -- start start 2024-04-26T20:26:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc77a5d7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7741034e0 0x7fc774075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc77a5d7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc774103ea0 0x7fc774075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc77a5d7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc774109480 0x7fc7740761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc77a5d7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc774113750 con 0x7fc7741034e0 2024-04-26T20:26:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc77a5d7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741135d0 con 0x7fc774109480 2024-04-26T20:26:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc77a5d7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741138d0 con 0x7fc774103ea0 2024-04-26T20:26:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc773fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7741034e0 0x7fc774075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc773fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7741034e0 0x7fc774075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58958/0 (socket says 172.21.15.70:58958) 2024-04-26T20:26:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc773fff700 1 -- 172.21.15.70:0/1713121837 learned_addr learned my addr 172.21.15.70:0/1713121837 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc7737fe700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc774103ea0 0x7fc774075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:01.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.100+0000 7fc778b74700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc774109480 0x7fc7740761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.101+0000 7fc773fff700 1 -- 172.21.15.70:0/1713121837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc774103ea0 msgr2=0x7fc774075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.101+0000 7fc773fff700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc774103ea0 0x7fc774075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.101+0000 7fc773fff700 1 -- 172.21.15.70:0/1713121837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc774109480 msgr2=0x7fc7740761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.101+0000 7fc773fff700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc774109480 0x7fc7740761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.101+0000 7fc773fff700 1 -- 172.21.15.70:0/1713121837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7741a8030 con 0x7fc7741034e0 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.101+0000 7fc773fff700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7741034e0 0x7fc774075720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc764005910 tx=0x7fc764004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.101+0000 7fc7717fa700 1 -- 172.21.15.70:0/1713121837 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc764027070 con 0x7fc7741034e0 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.101+0000 7fc7717fa700 1 -- 172.21.15.70:0/1713121837 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc764003fb0 con 0x7fc7741034e0 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.101+0000 7fc77a5d7700 1 -- 172.21.15.70:0/1713121837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7741a82c0 con 0x7fc7741034e0 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.101+0000 7fc7717fa700 1 -- 172.21.15.70:0/1713121837 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc764022e00 con 0x7fc7741034e0 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.101+0000 7fc77a5d7700 1 -- 172.21.15.70:0/1713121837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7741a8710 con 0x7fc7741034e0 2024-04-26T20:26:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.102+0000 7fc77a5d7700 1 -- 172.21.15.70:0/1713121837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc774104b30 con 0x7fc7741034e0 2024-04-26T20:26:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.103+0000 7fc7717fa700 1 -- 172.21.15.70:0/1713121837 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc76402a070 con 0x7fc7741034e0 2024-04-26T20:26:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.104+0000 7fc7717fa700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc75c0a3cd0 0x7fc75c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.104+0000 7fc7737fe700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc75c0a3cd0 0x7fc75c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.104+0000 7fc7717fa700 1 -- 172.21.15.70:0/1713121837 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fc7640d1270 con 0x7fc7741034e0 2024-04-26T20:26:01.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.105+0000 7fc7737fe700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc75c0a3cd0 0x7fc75c0a6190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc77407aa90 tx=0x7fc76800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:01.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.109+0000 7fc7717fa700 1 -- 172.21.15.70:0/1713121837 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc76405f060 con 0x7fc7741034e0 2024-04-26T20:26:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:00 smithi098 ceph-mon[32591]: pgmap v312: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:26:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:00 smithi080 ceph-mon[32278]: pgmap v312: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:26:01.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:00 smithi070 ceph-mon[29124]: pgmap v312: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:26:01.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.312+0000 7fc77a5d7700 1 -- 172.21.15.70:0/1713121837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc7741a8a70 con 0x7fc7741034e0 2024-04-26T20:26:01.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.312+0000 7fc7717fa700 1 -- 172.21.15.70:0/1713121837 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc764013070 con 0x7fc7741034e0 2024-04-26T20:26:01.313 INFO:teuthology.orchestra.run.smithi070.stdout:34359738446 2024-04-26T20:26:01.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 -- 172.21.15.70:0/1713121837 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc75c0a3cd0 msgr2=0x7fc75c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:01.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc75c0a3cd0 0x7fc75c0a6190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc77407aa90 tx=0x7fc76800a380 comp rx=0 tx=0).stop 2024-04-26T20:26:01.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 -- 172.21.15.70:0/1713121837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7741034e0 msgr2=0x7fc774075720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:01.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7741034e0 0x7fc774075720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc764005910 tx=0x7fc764004580 comp rx=0 tx=0).stop 2024-04-26T20:26:01.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 -- 172.21.15.70:0/1713121837 shutdown_connections 2024-04-26T20:26:01.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc75c0a3cd0 0x7fc75c0a6190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:01.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc774109480 0x7fc7740761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:01.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7741034e0 0x7fc774075720 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:01.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 --2- 172.21.15.70:0/1713121837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc774103ea0 0x7fc774075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:01.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 -- 172.21.15.70:0/1713121837 >> 172.21.15.70:0/1713121837 conn(0x7fc77407a5e0 msgr2=0x7fc774101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:01.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 -- 172.21.15.70:0/1713121837 shutdown_connections 2024-04-26T20:26:01.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:01.314+0000 7fc77a5d7700 1 -- 172.21.15.70:0/1713121837 wait complete. 2024-04-26T20:26:01.955 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:01 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1713121837' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T20:26:01.982 INFO:teuthology.orchestra.run.smithi070.stdout:313532612635 2024-04-26T20:26:01.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-26T20:26:02.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:01 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1713121837' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T20:26:02.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:01 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1713121837' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T20:26:02.395 INFO:teuthology.orchestra.run.smithi070.stdout:201863462961 2024-04-26T20:26:02.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-26T20:26:02.797 INFO:teuthology.orchestra.run.smithi070.stdout:77309411397 2024-04-26T20:26:02.797 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-26T20:26:03.022 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:02 smithi070 ceph-mon[29124]: pgmap v313: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-26T20:26:03.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:02 smithi098 ceph-mon[32591]: pgmap v313: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-26T20:26:03.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:02 smithi080 ceph-mon[32278]: pgmap v313: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-26T20:26:03.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.250+0000 7fd1c396a700 1 -- 172.21.15.70:0/2268283142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1bc1094c0 msgr2=0x7fd1bc1098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:03.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.250+0000 7fd1c396a700 1 --2- 172.21.15.70:0/2268283142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1bc1094c0 0x7fd1bc1098a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009990 tx=0x7fd1b8009ca0 comp rx=0 tx=0).stop 2024-04-26T20:26:03.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.250+0000 7fd1c396a700 1 -- 172.21.15.70:0/2268283142 shutdown_connections 2024-04-26T20:26:03.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.250+0000 7fd1c396a700 1 --2- 172.21.15.70:0/2268283142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1bc103e30 0x7fd1bc110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:03.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.250+0000 7fd1c396a700 1 --2- 172.21.15.70:0/2268283142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1bc1094c0 0x7fd1bc1098a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:03.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.250+0000 7fd1c396a700 1 --2- 172.21.15.70:0/2268283142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1bc103470 0x7fd1bc1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:03.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.250+0000 7fd1c396a700 1 -- 172.21.15.70:0/2268283142 >> 172.21.15.70:0/2268283142 conn(0x7fd1bc07a580 msgr2=0x7fd1bc07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:03.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.250+0000 7fd1c396a700 1 -- 172.21.15.70:0/2268283142 shutdown_connections 2024-04-26T20:26:03.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.250+0000 7fd1c396a700 1 -- 172.21.15.70:0/2268283142 wait complete. 2024-04-26T20:26:03.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.250+0000 7fd1c396a700 1 Processor -- start 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c396a700 1 -- start start 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c396a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1bc103470 0x7fd1bc19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c396a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1bc103e30 0x7fd1bc19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c396a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1bc1094c0 0x7fd1bc199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c396a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc113780 con 0x7fd1bc103470 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c396a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc113600 con 0x7fd1bc103e30 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c396a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc113900 con 0x7fd1bc1094c0 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c1706700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1bc103470 0x7fd1bc19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c1706700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1bc103470 0x7fd1bc19f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58974/0 (socket says 172.21.15.70:58974) 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c1706700 1 -- 172.21.15.70:0/3880160156 learned_addr learned my addr 172.21.15.70:0/3880160156 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c1f07700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1bc1094c0 0x7fd1bc199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:03.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c0f05700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1bc103e30 0x7fd1bc19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c1706700 1 -- 172.21.15.70:0/3880160156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1bc1094c0 msgr2=0x7fd1bc199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c1706700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1bc1094c0 0x7fd1bc199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c1706700 1 -- 172.21.15.70:0/3880160156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1bc103e30 msgr2=0x7fd1bc19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c1706700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1bc103e30 0x7fd1bc19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c1706700 1 -- 172.21.15.70:0/3880160156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1bc19a160 con 0x7fd1bc103470 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c0f05700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1bc103e30 0x7fd1bc19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.251+0000 7fd1c1706700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1bc103470 0x7fd1bc19f840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8000c00 tx=0x7fd1b80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.252+0000 7fd1b27fc700 1 -- 172.21.15.70:0/3880160156 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8027070 con 0x7fd1bc103470 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.252+0000 7fd1c396a700 1 -- 172.21.15.70:0/3880160156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1bc19a3f0 con 0x7fd1bc103470 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.252+0000 7fd1b27fc700 1 -- 172.21.15.70:0/3880160156 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd1b80040f0 con 0x7fd1bc103470 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.252+0000 7fd1b27fc700 1 -- 172.21.15.70:0/3880160156 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800f460 con 0x7fd1bc103470 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.252+0000 7fd1c396a700 1 -- 172.21.15.70:0/3880160156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1bc1a6710 con 0x7fd1bc103470 2024-04-26T20:26:03.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.252+0000 7fd1c396a700 1 -- 172.21.15.70:0/3880160156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd1bc063bb0 con 0x7fd1bc103470 2024-04-26T20:26:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.254+0000 7fd1b27fc700 1 -- 172.21.15.70:0/3880160156 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd1b802a070 con 0x7fd1bc103470 2024-04-26T20:26:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.254+0000 7fd1b27fc700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd1a80a3cd0 0x7fd1a80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.254+0000 7fd1c0f05700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd1a80a3cd0 0x7fd1a80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.254+0000 7fd1b27fc700 1 -- 172.21.15.70:0/3880160156 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fd1b80d1a00 con 0x7fd1bc103470 2024-04-26T20:26:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.255+0000 7fd1b27fc700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927] conn(0x7fd1a80ad4b0 0x7fd1a80af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.255+0000 7fd1b27fc700 1 -- 172.21.15.70:0/3880160156 --> [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1b8011ec0 con 0x7fd1a80ad4b0 2024-04-26T20:26:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.255+0000 7fd1b27fc700 1 -- 172.21.15.70:0/3880160156 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fd1b80d1ee0 con 0x7fd1bc103470 2024-04-26T20:26:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.255+0000 7fd1c1f07700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927] conn(0x7fd1a80ad4b0 0x7fd1a80af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.255+0000 7fd1c0f05700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd1a80a3cd0 0x7fd1a80a6190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc07ab60 tx=0x7fd1ac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.255+0000 7fd1c1f07700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927] conn(0x7fd1a80ad4b0 0x7fd1a80af8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.256+0000 7fd1b27fc700 1 -- 172.21.15.70:0/3880160156 <== osd.9 v2:172.21.15.70:6826/1559827927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1b8011ec0 con 0x7fd1a80ad4b0 2024-04-26T20:26:03.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c396a700 1 -- 172.21.15.70:0/3880160156 --> [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd1bc063fb0 con 0x7fd1a80ad4b0 2024-04-26T20:26:03.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1b27fc700 1 -- 172.21.15.70:0/3880160156 <== osd.9 v2:172.21.15.70:6826/1559827927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd1bc063fb0 con 0x7fd1a80ad4b0 2024-04-26T20:26:03.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c396a700 1 -- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927] conn(0x7fd1a80ad4b0 msgr2=0x7fd1a80af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:03.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c396a700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927] conn(0x7fd1a80ad4b0 0x7fd1a80af8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:03.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c396a700 1 -- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd1a80a3cd0 msgr2=0x7fd1a80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:03.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c396a700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd1a80a3cd0 0x7fd1a80a6190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc07ab60 tx=0x7fd1ac008040 comp rx=0 tx=0).stop 2024-04-26T20:26:03.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c396a700 1 -- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1bc103470 msgr2=0x7fd1bc19f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:03.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c396a700 1 --2- 172.21.15.70:0/3880160156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1bc103470 0x7fd1bc19f840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8000c00 tx=0x7fd1b80047b0 comp rx=0 tx=0).stop 2024-04-26T20:26:03.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c1f07700 1 -- 172.21.15.70:0/3880160156 reap_dead start 2024-04-26T20:26:03.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c396a700 1 -- 172.21.15.70:0/3880160156 shutdown_connections 2024-04-26T20:26:03.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c396a700 1 -- 172.21.15.70:0/3880160156 >> 172.21.15.70:0/3880160156 conn(0x7fd1bc07a580 msgr2=0x7fd1bc1020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:03.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c396a700 1 -- 172.21.15.70:0/3880160156 shutdown_connections 2024-04-26T20:26:03.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:03.272+0000 7fd1c396a700 1 -- 172.21.15.70:0/3880160156 wait complete. 2024-04-26T20:26:03.954 INFO:teuthology.orchestra.run.smithi070.stdout:292057776162 2024-04-26T20:26:03.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-26T20:26:04.619 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738443 got 34359738446 for osd.0 2024-04-26T20:26:04.619 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:04.804 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:05.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:04 smithi098 ceph-mon[32591]: pgmap v314: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-26T20:26:05.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:04 smithi080 ceph-mon[32278]: pgmap v314: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-26T20:26:05.223 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:04 smithi070 ceph-mon[29124]: pgmap v314: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-26T20:26:05.254 INFO:teuthology.orchestra.run.smithi070.stdout:257698037797 2024-04-26T20:26:05.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-26T20:26:05.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.455+0000 7ff958436700 1 -- 172.21.15.70:0/2953078803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff950102310 msgr2=0x7ff950102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:05.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.455+0000 7ff958436700 1 --2- 172.21.15.70:0/2953078803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff950102310 0x7ff950102790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff940009990 tx=0x7ff940009ca0 comp rx=0 tx=0).stop 2024-04-26T20:26:05.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.455+0000 7ff958436700 1 -- 172.21.15.70:0/2953078803 shutdown_connections 2024-04-26T20:26:05.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.455+0000 7ff958436700 1 --2- 172.21.15.70:0/2953078803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff950102cd0 0x7ff95010f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:05.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.455+0000 7ff958436700 1 --2- 172.21.15.70:0/2953078803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff950108380 0x7ff950108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:05.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.455+0000 7ff958436700 1 --2- 172.21.15.70:0/2953078803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff950102310 0x7ff950102790 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:05.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.455+0000 7ff958436700 1 -- 172.21.15.70:0/2953078803 >> 172.21.15.70:0/2953078803 conn(0x7ff950079290 msgr2=0x7ff9500796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:05.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.456+0000 7ff958436700 1 -- 172.21.15.70:0/2953078803 shutdown_connections 2024-04-26T20:26:05.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.456+0000 7ff958436700 1 -- 172.21.15.70:0/2953078803 wait complete. 2024-04-26T20:26:05.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.456+0000 7ff958436700 1 Processor -- start 2024-04-26T20:26:05.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.456+0000 7ff958436700 1 -- start start 2024-04-26T20:26:05.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff958436700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff950102310 0x7ff95019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:05.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff958436700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff950102cd0 0x7ff95019af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:05.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff958436700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff950108380 0x7ff9501a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:05.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff958436700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff950112660 con 0x7ff950102cd0 2024-04-26T20:26:05.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff958436700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff9501124e0 con 0x7ff950102310 2024-04-26T20:26:05.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff958436700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff9501127e0 con 0x7ff950108380 2024-04-26T20:26:05.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff9559d1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff950102cd0 0x7ff95019af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:05.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff9559d1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff950102cd0 0x7ff95019af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58990/0 (socket says 172.21.15.70:58990) 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff9559d1700 1 -- 172.21.15.70:0/3929172557 learned_addr learned my addr 172.21.15.70:0/3929172557 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff9569d3700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff950108380 0x7ff9501a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff9561d2700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff950102310 0x7ff95019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff9559d1700 1 -- 172.21.15.70:0/3929172557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff950108380 msgr2=0x7ff9501a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff9559d1700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff950108380 0x7ff9501a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff9559d1700 1 -- 172.21.15.70:0/3929172557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff950102310 msgr2=0x7ff95019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff9559d1700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff950102310 0x7ff95019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.457+0000 7ff9559d1700 1 -- 172.21.15.70:0/3929172557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9501a6000 con 0x7ff950102cd0 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.458+0000 7ff9559d1700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff950102cd0 0x7ff95019af80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff940005910 tx=0x7ff940005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.458+0000 7ff9477fe700 1 -- 172.21.15.70:0/3929172557 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940027070 con 0x7ff950102cd0 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.458+0000 7ff9477fe700 1 -- 172.21.15.70:0/3929172557 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff940004680 con 0x7ff950102cd0 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.458+0000 7ff958436700 1 -- 172.21.15.70:0/3929172557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff950198830 con 0x7ff950102cd0 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.458+0000 7ff9477fe700 1 -- 172.21.15.70:0/3929172557 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940022cb0 con 0x7ff950102cd0 2024-04-26T20:26:05.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.458+0000 7ff958436700 1 -- 172.21.15.70:0/3929172557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff950198ca0 con 0x7ff950102cd0 2024-04-26T20:26:05.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.459+0000 7ff958436700 1 -- 172.21.15.70:0/3929172557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff950063af0 con 0x7ff950102cd0 2024-04-26T20:26:05.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.461+0000 7ff9477fe700 1 -- 172.21.15.70:0/3929172557 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff94002a070 con 0x7ff950102cd0 2024-04-26T20:26:05.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.462+0000 7ff9477fe700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff93c0a3dd0 0x7ff93c0a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:05.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.463+0000 7ff9477fe700 1 -- 172.21.15.70:0/3929172557 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7ff9400d1f70 con 0x7ff950102cd0 2024-04-26T20:26:05.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.463+0000 7ff9477fe700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375] conn(0x7ff93c0ad5b0 0x7ff93c0af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:05.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.463+0000 7ff9477fe700 1 -- 172.21.15.70:0/3929172557 --> [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9400043d0 con 0x7ff93c0ad5b0 2024-04-26T20:26:05.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.463+0000 7ff9477fe700 1 -- 172.21.15.70:0/3929172557 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7ff9400d2360 con 0x7ff950102cd0 2024-04-26T20:26:05.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.463+0000 7ff9561d2700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff93c0a3dd0 0x7ff93c0a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:05.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.463+0000 7ff9561d2700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff93c0a3dd0 0x7ff93c0a6290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff94c005950 tx=0x7ff94c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:05.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.465+0000 7ff9569d3700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375] conn(0x7ff93c0ad5b0 0x7ff93c0af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:05.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.466+0000 7ff9569d3700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375] conn(0x7ff93c0ad5b0 0x7ff93c0af9d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:05.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.466+0000 7ff9477fe700 1 -- 172.21.15.70:0/3929172557 <== osd.1 v2:172.21.15.80:6800/2449011375 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9400043d0 con 0x7ff93c0ad5b0 2024-04-26T20:26:05.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.488+0000 7ff958436700 1 -- 172.21.15.70:0/3929172557 --> [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff950063f20 con 0x7ff93c0ad5b0 2024-04-26T20:26:05.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.489+0000 7ff9477fe700 1 -- 172.21.15.70:0/3929172557 <== osd.1 v2:172.21.15.80:6800/2449011375 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff950063f20 con 0x7ff93c0ad5b0 2024-04-26T20:26:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.489+0000 7ff958436700 1 -- 172.21.15.70:0/3929172557 >> [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375] conn(0x7ff93c0ad5b0 msgr2=0x7ff93c0af9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.489+0000 7ff958436700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375] conn(0x7ff93c0ad5b0 0x7ff93c0af9d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.489+0000 7ff958436700 1 -- 172.21.15.70:0/3929172557 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff93c0a3dd0 msgr2=0x7ff93c0a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.489+0000 7ff958436700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff93c0a3dd0 0x7ff93c0a6290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff94c005950 tx=0x7ff94c00a300 comp rx=0 tx=0).stop 2024-04-26T20:26:05.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.489+0000 7ff958436700 1 -- 172.21.15.70:0/3929172557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff950102cd0 msgr2=0x7ff95019af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:05.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.489+0000 7ff958436700 1 --2- 172.21.15.70:0/3929172557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff950102cd0 0x7ff95019af80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff940005910 tx=0x7ff940005ef0 comp rx=0 tx=0).stop 2024-04-26T20:26:05.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.489+0000 7ff9569d3700 1 -- 172.21.15.70:0/3929172557 reap_dead start 2024-04-26T20:26:05.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.489+0000 7ff958436700 1 -- 172.21.15.70:0/3929172557 shutdown_connections 2024-04-26T20:26:05.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.489+0000 7ff958436700 1 -- 172.21.15.70:0/3929172557 >> 172.21.15.70:0/3929172557 conn(0x7ff950079290 msgr2=0x7ff950100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:05.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.490+0000 7ff958436700 1 -- 172.21.15.70:0/3929172557 shutdown_connections 2024-04-26T20:26:05.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:05.490+0000 7ff958436700 1 -- 172.21.15.70:0/3929172557 wait complete. 2024-04-26T20:26:06.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:05 smithi070 ceph-mon[29124]: pgmap v315: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-26T20:26:06.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:05 smithi098 ceph-mon[32591]: pgmap v315: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-26T20:26:06.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:05 smithi080 ceph-mon[32278]: pgmap v315: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-26T20:26:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:06.424 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:06.442 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:08.009 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:08.009 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:08.010 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-04-26T20:26:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-04-26T20:26:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 6]}]: dispatch 2024-04-26T20:26:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4, 7, 11]}]: dispatch 2024-04-26T20:26:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-04-26T20:26:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-04-26T20:26:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-04-26T20:26:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-26T20:26:08.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:07 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-04-26T20:26:08.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-04-26T20:26:08.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-04-26T20:26:08.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 6]}]: dispatch 2024-04-26T20:26:08.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4, 7, 11]}]: dispatch 2024-04-26T20:26:08.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-04-26T20:26:08.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-04-26T20:26:08.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-04-26T20:26:08.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-26T20:26:08.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:07 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-04-26T20:26:08.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-04-26T20:26:08.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-04-26T20:26:08.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 6]}]: dispatch 2024-04-26T20:26:08.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4, 7, 11]}]: dispatch 2024-04-26T20:26:08.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-04-26T20:26:08.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-04-26T20:26:08.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-04-26T20:26:08.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-26T20:26:08.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:07 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-04-26T20:26:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:09.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-04-26T20:26:09.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-04-26T20:26:09.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 6]}]': finished 2024-04-26T20:26:09.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4, 7, 11]}]': finished 2024-04-26T20:26:09.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-04-26T20:26:09.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-04-26T20:26:09.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-04-26T20:26:09.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-26T20:26:09.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:08 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-04-26T20:26:09.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:08 smithi070 ceph-mon[29124]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T20:26:09.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:08 smithi070 ceph-mon[29124]: pgmap v317: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:26:09.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-04-26T20:26:09.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-04-26T20:26:09.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 6]}]': finished 2024-04-26T20:26:09.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4, 7, 11]}]': finished 2024-04-26T20:26:09.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-04-26T20:26:09.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-04-26T20:26:09.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-04-26T20:26:09.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-26T20:26:09.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:08 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-04-26T20:26:09.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:08 smithi098 ceph-mon[32591]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T20:26:09.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:08 smithi098 ceph-mon[32591]: pgmap v317: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:26:09.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-04-26T20:26:09.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-04-26T20:26:09.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 6]}]': finished 2024-04-26T20:26:09.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4, 7, 11]}]': finished 2024-04-26T20:26:09.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-04-26T20:26:09.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-04-26T20:26:09.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-04-26T20:26:09.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-26T20:26:09.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:08 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-04-26T20:26:09.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:08 smithi080 ceph-mon[32278]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T20:26:09.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:08 smithi080 ceph-mon[32278]: pgmap v317: 97 pgs: 97 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:26:09.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:09 smithi070 ceph-mon[29124]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T20:26:10.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:09 smithi098 ceph-mon[32591]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T20:26:10.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:09 smithi080 ceph-mon[32278]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T20:26:11.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:10 smithi070 ceph-mon[29124]: pgmap v319: 97 pgs: 6 peering, 91 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 op/s 2024-04-26T20:26:11.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:10 smithi098 ceph-mon[32591]: pgmap v319: 97 pgs: 6 peering, 91 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 op/s 2024-04-26T20:26:11.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:10 smithi080 ceph-mon[32278]: pgmap v319: 97 pgs: 6 peering, 91 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 op/s 2024-04-26T20:26:11.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.735+0000 7fd67d726700 1 -- 172.21.15.70:0/2494859207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6781025b0 msgr2=0x7fd678102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:11.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.735+0000 7fd67d726700 1 --2- 172.21.15.70:0/2494859207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6781025b0 0x7fd678102990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd6680099c0 tx=0x7fd668009cd0 comp rx=0 tx=0).stop 2024-04-26T20:26:11.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.735+0000 7fd67d726700 1 -- 172.21.15.70:0/2494859207 shutdown_connections 2024-04-26T20:26:11.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.735+0000 7fd67d726700 1 --2- 172.21.15.70:0/2494859207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678107640 0x7fd67810f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:11.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.735+0000 7fd67d726700 1 --2- 172.21.15.70:0/2494859207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6781025b0 0x7fd678102990 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:11.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.735+0000 7fd67d726700 1 --2- 172.21.15.70:0/2494859207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd678102f60 0x7fd678106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.735+0000 7fd67d726700 1 -- 172.21.15.70:0/2494859207 >> 172.21.15.70:0/2494859207 conn(0x7fd6780792f0 msgr2=0x7fd678079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.735+0000 7fd67d726700 1 -- 172.21.15.70:0/2494859207 shutdown_connections 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.735+0000 7fd67d726700 1 -- 172.21.15.70:0/2494859207 wait complete. 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd67d726700 1 Processor -- start 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd67d726700 1 -- start start 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd67d726700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6781025b0 0x7fd67819e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd67d726700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678102f60 0x7fd67819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd67d726700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd678107640 0x7fd678198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd67d726700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd678112690 con 0x7fd678107640 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd67d726700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd678112510 con 0x7fd6781025b0 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd67d726700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd678112810 con 0x7fd678102f60 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd6777fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd678107640 0x7fd678198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd6777fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd678107640 0x7fd678198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46294/0 (socket says 172.21.15.70:46294) 2024-04-26T20:26:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd6777fe700 1 -- 172.21.15.70:0/3060742852 learned_addr learned my addr 172.21.15.70:0/3060742852 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd676ffd700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6781025b0 0x7fd67819e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd6767fc700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678102f60 0x7fd67819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd6777fe700 1 -- 172.21.15.70:0/3060742852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678102f60 msgr2=0x7fd67819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd6777fe700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678102f60 0x7fd67819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd6777fe700 1 -- 172.21.15.70:0/3060742852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6781025b0 msgr2=0x7fd67819e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd6777fe700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6781025b0 0x7fd67819e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.736+0000 7fd6777fe700 1 -- 172.21.15.70:0/3060742852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6781990f0 con 0x7fd678107640 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.737+0000 7fd6777fe700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd678107640 0x7fd678198990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd67000b970 tx=0x7fd67000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.737+0000 7fd65ffff700 1 -- 172.21.15.70:0/3060742852 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67000d860 con 0x7fd678107640 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.737+0000 7fd67d726700 1 -- 172.21.15.70:0/3060742852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6781993e0 con 0x7fd678107640 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.737+0000 7fd65ffff700 1 -- 172.21.15.70:0/3060742852 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd67000e430 con 0x7fd678107640 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.737+0000 7fd65ffff700 1 -- 172.21.15.70:0/3060742852 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670017660 con 0x7fd678107640 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.737+0000 7fd67d726700 1 -- 172.21.15.70:0/3060742852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6781a56a0 con 0x7fd678107640 2024-04-26T20:26:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.738+0000 7fd67d726700 1 -- 172.21.15.70:0/3060742852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd678063bb0 con 0x7fd678107640 2024-04-26T20:26:11.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.739+0000 7fd65ffff700 1 -- 172.21.15.70:0/3060742852 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd67000e5e0 con 0x7fd678107640 2024-04-26T20:26:11.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.739+0000 7fd65ffff700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd6600a3cd0 0x7fd6600a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:11.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.739+0000 7fd676ffd700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd6600a3cd0 0x7fd6600a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:11.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.740+0000 7fd65ffff700 1 -- 172.21.15.70:0/3060742852 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fd6700d07e0 con 0x7fd678107640 2024-04-26T20:26:11.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.740+0000 7fd65ffff700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976] conn(0x7fd6600ad890 0x7fd6600afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:11.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.740+0000 7fd65ffff700 1 -- 172.21.15.70:0/3060742852 --> [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6600b0400 con 0x7fd6600ad890 2024-04-26T20:26:11.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.740+0000 7fd65ffff700 1 -- 172.21.15.70:0/3060742852 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fd6700d0c30 con 0x7fd678107640 2024-04-26T20:26:11.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.740+0000 7fd676ffd700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd6600a3cd0 0x7fd6600a6190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd678199ad0 tx=0x7fd668005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:11.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.740+0000 7fd6767fc700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976] conn(0x7fd6600ad890 0x7fd6600afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:11.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.740+0000 7fd6767fc700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976] conn(0x7fd6600ad890 0x7fd6600afd30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:11.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.741+0000 7fd65ffff700 1 -- 172.21.15.70:0/3060742852 <== osd.4 v2:172.21.15.80:6808/1371786976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6600b0400 con 0x7fd6600ad890 2024-04-26T20:26:11.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.763+0000 7fd67d726700 1 -- 172.21.15.70:0/3060742852 --> [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd678063fb0 con 0x7fd6600ad890 2024-04-26T20:26:11.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.764+0000 7fd65ffff700 1 -- 172.21.15.70:0/3060742852 <== osd.4 v2:172.21.15.80:6808/1371786976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd678063fb0 con 0x7fd6600ad890 2024-04-26T20:26:11.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.764+0000 7fd67d726700 1 -- 172.21.15.70:0/3060742852 >> [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976] conn(0x7fd6600ad890 msgr2=0x7fd6600afd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:11.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.764+0000 7fd67d726700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976] conn(0x7fd6600ad890 0x7fd6600afd30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:11.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.764+0000 7fd67d726700 1 -- 172.21.15.70:0/3060742852 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd6600a3cd0 msgr2=0x7fd6600a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:11.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.764+0000 7fd67d726700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd6600a3cd0 0x7fd6600a6190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd678199ad0 tx=0x7fd668005c40 comp rx=0 tx=0).stop 2024-04-26T20:26:11.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.764+0000 7fd67d726700 1 -- 172.21.15.70:0/3060742852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd678107640 msgr2=0x7fd678198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:11.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.764+0000 7fd67d726700 1 --2- 172.21.15.70:0/3060742852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd678107640 0x7fd678198990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd67000b970 tx=0x7fd67000bc80 comp rx=0 tx=0).stop 2024-04-26T20:26:11.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.764+0000 7fd6777fe700 1 -- 172.21.15.70:0/3060742852 reap_dead start 2024-04-26T20:26:11.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.764+0000 7fd67d726700 1 -- 172.21.15.70:0/3060742852 shutdown_connections 2024-04-26T20:26:11.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.764+0000 7fd67d726700 1 -- 172.21.15.70:0/3060742852 >> 172.21.15.70:0/3060742852 conn(0x7fd6780792f0 msgr2=0x7fd678101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:11.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.765+0000 7fd67d726700 1 -- 172.21.15.70:0/3060742852 shutdown_connections 2024-04-26T20:26:11.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:11.765+0000 7fd67d726700 1 -- 172.21.15.70:0/3060742852 wait complete. 2024-04-26T20:26:12.213 INFO:teuthology.orchestra.run.smithi070.stdout:55834574923 2024-04-26T20:26:12.214 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-26T20:26:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:12 smithi070 ceph-mon[29124]: pgmap v320: 97 pgs: 6 peering, 91 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T20:26:13.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:12 smithi098 ceph-mon[32591]: pgmap v320: 97 pgs: 6 peering, 91 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T20:26:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:12 smithi080 ceph-mon[32278]: pgmap v320: 97 pgs: 6 peering, 91 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T20:26:13.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.887+0000 7f4572b14700 1 -- 172.21.15.70:0/2140239138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f456c103470 msgr2=0x7f456c1038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:13.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.887+0000 7f4572b14700 1 --2- 172.21.15.70:0/2140239138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f456c103470 0x7f456c1038f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4558009990 tx=0x7f4558009ca0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.887+0000 7f4572b14700 1 -- 172.21.15.70:0/2140239138 shutdown_connections 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.887+0000 7f4572b14700 1 --2- 172.21.15.70:0/2140239138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f456c103e30 0x7f456c110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.887+0000 7f4572b14700 1 --2- 172.21.15.70:0/2140239138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f456c1094c0 0x7f456c1098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.887+0000 7f4572b14700 1 --2- 172.21.15.70:0/2140239138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f456c103470 0x7f456c1038f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.887+0000 7f4572b14700 1 -- 172.21.15.70:0/2140239138 >> 172.21.15.70:0/2140239138 conn(0x7f456c07a580 msgr2=0x7f456c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.887+0000 7f4572b14700 1 -- 172.21.15.70:0/2140239138 shutdown_connections 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.887+0000 7f4572b14700 1 -- 172.21.15.70:0/2140239138 wait complete. 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.888+0000 7f4572b14700 1 Processor -- start 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.888+0000 7f4572b14700 1 -- start start 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.888+0000 7f4572b14700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f456c103470 0x7f456c19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.888+0000 7f4572b14700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f456c103e30 0x7f456c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.888+0000 7f4572b14700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f456c1094c0 0x7f456c199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.888+0000 7f4572b14700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f456c113780 con 0x7f456c103470 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.888+0000 7f4572b14700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f456c113600 con 0x7f456c103e30 2024-04-26T20:26:13.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.888+0000 7f4572b14700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f456c113900 con 0x7f456c1094c0 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.888+0000 7f45708b0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f456c103470 0x7f456c19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.888+0000 7f45708b0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f456c103470 0x7f456c19f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46306/0 (socket says 172.21.15.70:46306) 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.888+0000 7f45708b0700 1 -- 172.21.15.70:0/4054723862 learned_addr learned my addr 172.21.15.70:0/4054723862 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f45710b1700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f456c1094c0 0x7f456c199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f456bfff700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f456c103e30 0x7f456c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f45708b0700 1 -- 172.21.15.70:0/4054723862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f456c1094c0 msgr2=0x7f456c199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f45708b0700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f456c1094c0 0x7f456c199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f45708b0700 1 -- 172.21.15.70:0/4054723862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f456c103e30 msgr2=0x7f456c19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f45708b0700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f456c103e30 0x7f456c19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f45708b0700 1 -- 172.21.15.70:0/4054723862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456c19a1a0 con 0x7f456c103470 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f456bfff700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f456c103e30 0x7f456c19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f45710b1700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f456c1094c0 0x7f456c199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f45708b0700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f456c103470 0x7f456c19f830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f456000d980 tx=0x7f456000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f4569ffb700 1 -- 172.21.15.70:0/4054723862 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560016070 con 0x7f456c103470 2024-04-26T20:26:13.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f4569ffb700 1 -- 172.21.15.70:0/4054723862 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f45600044f0 con 0x7f456c103470 2024-04-26T20:26:13.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f4569ffb700 1 -- 172.21.15.70:0/4054723862 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560004d00 con 0x7f456c103470 2024-04-26T20:26:13.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f4572b14700 1 -- 172.21.15.70:0/4054723862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456c19a490 con 0x7f456c103470 2024-04-26T20:26:13.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.889+0000 7f4572b14700 1 -- 172.21.15.70:0/4054723862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456c1a6700 con 0x7f456c103470 2024-04-26T20:26:13.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.890+0000 7f4572b14700 1 -- 172.21.15.70:0/4054723862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f456c06a110 con 0x7f456c103470 2024-04-26T20:26:13.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.891+0000 7f4569ffb700 1 -- 172.21.15.70:0/4054723862 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f456000bbf0 con 0x7f456c103470 2024-04-26T20:26:13.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.892+0000 7f4569ffb700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f455c0a3cd0 0x7f455c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:13.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.892+0000 7f456bfff700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f455c0a3cd0 0x7f455c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:13.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.892+0000 7f4569ffb700 1 -- 172.21.15.70:0/4054723862 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f45600d0450 con 0x7f456c103470 2024-04-26T20:26:13.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.892+0000 7f456bfff700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f455c0a3cd0 0x7f455c0a6190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4558000c00 tx=0x7f4558005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:13.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:13.896+0000 7f4569ffb700 1 -- 172.21.15.70:0/4054723862 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f456001f020 con 0x7f456c103470 2024-04-26T20:26:14.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.102+0000 7f4572b14700 1 -- 172.21.15.70:0/4054723862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f456c02e490 con 0x7f456c103470 2024-04-26T20:26:14.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.102+0000 7f4569ffb700 1 -- 172.21.15.70:0/4054723862 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f456000f3c0 con 0x7f456c103470 2024-04-26T20:26:14.103 INFO:teuthology.orchestra.run.smithi070.stdout:111669149762 2024-04-26T20:26:14.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 -- 172.21.15.70:0/4054723862 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f455c0a3cd0 msgr2=0x7f455c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:14.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f455c0a3cd0 0x7f455c0a6190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4558000c00 tx=0x7f4558005fb0 comp rx=0 tx=0).stop 2024-04-26T20:26:14.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 -- 172.21.15.70:0/4054723862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f456c103470 msgr2=0x7f456c19f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:14.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f456c103470 0x7f456c19f830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f456000d980 tx=0x7f456000dd40 comp rx=0 tx=0).stop 2024-04-26T20:26:14.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 -- 172.21.15.70:0/4054723862 shutdown_connections 2024-04-26T20:26:14.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f455c0a3cd0 0x7f455c0a6190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:14.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f456c1094c0 0x7f456c199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:14.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f456c103470 0x7f456c19f830 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:14.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 --2- 172.21.15.70:0/4054723862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f456c103e30 0x7f456c19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:14.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 -- 172.21.15.70:0/4054723862 >> 172.21.15.70:0/4054723862 conn(0x7f456c07a580 msgr2=0x7f456c1021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:14.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 -- 172.21.15.70:0/4054723862 shutdown_connections 2024-04-26T20:26:14.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.104+0000 7f4572b14700 1 -- 172.21.15.70:0/4054723862 wait complete. 2024-04-26T20:26:14.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:14 smithi070 ceph-mon[29124]: pgmap v321: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 6.3 KiB/s, 1 objects/s recovering 2024-04-26T20:26:14.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:14 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/4054723862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T20:26:15.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:14 smithi098 ceph-mon[32591]: pgmap v321: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 6.3 KiB/s, 1 objects/s recovering 2024-04-26T20:26:15.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:14 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/4054723862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T20:26:15.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:14 smithi080 ceph-mon[32278]: pgmap v321: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 6.3 KiB/s, 1 objects/s recovering 2024-04-26T20:26:15.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:14 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/4054723862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T20:26:16.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:15 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:16.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:15 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1704308219' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T20:26:16.066 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:15 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:16.066 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:15 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1704308219' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T20:26:16.076 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:15 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:16.076 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:15 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1704308219' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T20:26:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.755+0000 7fdd4dd95700 1 -- 172.21.15.70:0/2382706342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd48108380 msgr2=0x7fdd48108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.755+0000 7fdd4dd95700 1 --2- 172.21.15.70:0/2382706342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd48108380 0x7fdd48108760 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009990 tx=0x7fdd38009ca0 comp rx=0 tx=0).stop 2024-04-26T20:26:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.755+0000 7fdd4dd95700 1 -- 172.21.15.70:0/2382706342 shutdown_connections 2024-04-26T20:26:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.755+0000 7fdd4dd95700 1 --2- 172.21.15.70:0/2382706342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd48102cd0 0x7fdd4810f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.755+0000 7fdd4dd95700 1 --2- 172.21.15.70:0/2382706342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd48108380 0x7fdd48108760 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.755+0000 7fdd4dd95700 1 --2- 172.21.15.70:0/2382706342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd48102310 0x7fdd48102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.755+0000 7fdd4dd95700 1 -- 172.21.15.70:0/2382706342 >> 172.21.15.70:0/2382706342 conn(0x7fdd48079290 msgr2=0x7fdd480796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.755+0000 7fdd4dd95700 1 -- 172.21.15.70:0/2382706342 shutdown_connections 2024-04-26T20:26:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.756+0000 7fdd4dd95700 1 -- 172.21.15.70:0/2382706342 wait complete. 2024-04-26T20:26:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.756+0000 7fdd4dd95700 1 Processor -- start 2024-04-26T20:26:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.756+0000 7fdd4dd95700 1 -- start start 2024-04-26T20:26:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.756+0000 7fdd4dd95700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd48102310 0x7fdd4819bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.756+0000 7fdd4dd95700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd48102cd0 0x7fdd4819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd4dd95700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd48108380 0x7fdd481a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd4dd95700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdd481125e0 con 0x7fdd48102310 2024-04-26T20:26:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd4dd95700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdd48112460 con 0x7fdd48108380 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd4dd95700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdd48112760 con 0x7fdd48102cd0 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd477fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd48102310 0x7fdd4819bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd477fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd48102310 0x7fdd4819bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46356/0 (socket says 172.21.15.70:46356) 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd477fe700 1 -- 172.21.15.70:0/1704014450 learned_addr learned my addr 172.21.15.70:0/1704014450 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd46ffd700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd48102cd0 0x7fdd4819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd47fff700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd48108380 0x7fdd481a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd477fe700 1 -- 172.21.15.70:0/1704014450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd48102cd0 msgr2=0x7fdd4819c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd477fe700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd48102cd0 0x7fdd4819c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd477fe700 1 -- 172.21.15.70:0/1704014450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd48108380 msgr2=0x7fdd481a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd477fe700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd48108380 0x7fdd481a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd477fe700 1 -- 172.21.15.70:0/1704014450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd481a0dd0 con 0x7fdd48102310 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd46ffd700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd48102cd0 0x7fdd4819c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd47fff700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd48108380 0x7fdd481a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd477fe700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd48102310 0x7fdd4819bdc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdd38000c00 tx=0x7fdd380047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:16.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd44ff9700 1 -- 172.21.15.70:0/1704014450 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38027070 con 0x7fdd48102310 2024-04-26T20:26:16.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd4dd95700 1 -- 172.21.15.70:0/1704014450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd481a1060 con 0x7fdd48102310 2024-04-26T20:26:16.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd44ff9700 1 -- 172.21.15.70:0/1704014450 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd38022470 con 0x7fdd48102310 2024-04-26T20:26:16.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd44ff9700 1 -- 172.21.15.70:0/1704014450 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38017650 con 0x7fdd48102310 2024-04-26T20:26:16.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.757+0000 7fdd4dd95700 1 -- 172.21.15.70:0/1704014450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd481a8940 con 0x7fdd48102310 2024-04-26T20:26:16.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.758+0000 7fdd4dd95700 1 -- 172.21.15.70:0/1704014450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4806a110 con 0x7fdd48102310 2024-04-26T20:26:16.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.760+0000 7fdd44ff9700 1 -- 172.21.15.70:0/1704014450 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fdd3802a070 con 0x7fdd48102310 2024-04-26T20:26:16.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.761+0000 7fdd44ff9700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdd300a3cd0 0x7fdd300a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:16.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.761+0000 7fdd44ff9700 1 -- 172.21.15.70:0/1704014450 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fdd380d1740 con 0x7fdd48102310 2024-04-26T20:26:16.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.761+0000 7fdd46ffd700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdd300a3cd0 0x7fdd300a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:16.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.761+0000 7fdd46ffd700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdd300a3cd0 0x7fdd300a6190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdd481022b0 tx=0x7fdd3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:16.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.764+0000 7fdd44ff9700 1 -- 172.21.15.70:0/1704014450 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fdd38013070 con 0x7fdd48102310 2024-04-26T20:26:16.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.969+0000 7fdd4dd95700 1 -- 172.21.15.70:0/1704014450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdd481a8b10 con 0x7fdd48102310 2024-04-26T20:26:16.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:16 smithi070 ceph-mon[29124]: pgmap v322: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7 op/s; 6.3 KiB/s, 1 objects/s recovering 2024-04-26T20:26:16.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:16 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:16.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:16 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:16.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:16 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:16.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:16 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:16.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.970+0000 7fdd44ff9700 1 -- 172.21.15.70:0/1704014450 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdd3809e040 con 0x7fdd48102310 2024-04-26T20:26:16.972 INFO:teuthology.orchestra.run.smithi070.stdout:167503724601 2024-04-26T20:26:16.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 -- 172.21.15.70:0/1704014450 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdd300a3cd0 msgr2=0x7fdd300a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:16.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdd300a3cd0 0x7fdd300a6190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdd481022b0 tx=0x7fdd3c009260 comp rx=0 tx=0).stop 2024-04-26T20:26:16.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 -- 172.21.15.70:0/1704014450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd48102310 msgr2=0x7fdd4819bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:16.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd48102310 0x7fdd4819bdc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdd38000c00 tx=0x7fdd380047b0 comp rx=0 tx=0).stop 2024-04-26T20:26:16.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 -- 172.21.15.70:0/1704014450 shutdown_connections 2024-04-26T20:26:16.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fdd300a3cd0 0x7fdd300a6190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:16.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd48108380 0x7fdd481a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:16.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd48102310 0x7fdd4819bdc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:16.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 --2- 172.21.15.70:0/1704014450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd48102cd0 0x7fdd4819c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:16.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 -- 172.21.15.70:0/1704014450 >> 172.21.15.70:0/1704014450 conn(0x7fdd48079290 msgr2=0x7fdd4806b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:16.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 -- 172.21.15.70:0/1704014450 shutdown_connections 2024-04-26T20:26:16.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:16.972+0000 7fdd4dd95700 1 -- 172.21.15.70:0/1704014450 wait complete. 2024-04-26T20:26:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:16 smithi098 ceph-mon[32591]: pgmap v322: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7 op/s; 6.3 KiB/s, 1 objects/s recovering 2024-04-26T20:26:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:16 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:16 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:16 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:16 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:16 smithi080 ceph-mon[32278]: pgmap v322: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 7 op/s; 6.3 KiB/s, 1 objects/s recovering 2024-04-26T20:26:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:16 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:16 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:16 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:17.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:16 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:17.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.930+0000 7f5142b0f700 1 -- 172.21.15.70:0/3402160912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c102ce0 msgr2=0x7f513c10f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:17.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.930+0000 7f5142b0f700 1 --2- 172.21.15.70:0/3402160912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c102ce0 0x7f513c10f1d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f512c009990 tx=0x7f512c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:26:17.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.930+0000 7f5142b0f700 1 -- 172.21.15.70:0/3402160912 shutdown_connections 2024-04-26T20:26:17.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.930+0000 7f5142b0f700 1 --2- 172.21.15.70:0/3402160912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c102ce0 0x7f513c10f1d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:17.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.930+0000 7f5142b0f700 1 --2- 172.21.15.70:0/3402160912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f513c108390 0x7f513c108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:17.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.930+0000 7f5142b0f700 1 --2- 172.21.15.70:0/3402160912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f513c102320 0x7f513c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:17.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.930+0000 7f5142b0f700 1 -- 172.21.15.70:0/3402160912 >> 172.21.15.70:0/3402160912 conn(0x7f513c0792d0 msgr2=0x7f513c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:17.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.930+0000 7f5142b0f700 1 -- 172.21.15.70:0/3402160912 shutdown_connections 2024-04-26T20:26:17.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.930+0000 7f5142b0f700 1 -- 172.21.15.70:0/3402160912 wait complete. 2024-04-26T20:26:17.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.931+0000 7f5142b0f700 1 Processor -- start 2024-04-26T20:26:17.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.931+0000 7f5142b0f700 1 -- start start 2024-04-26T20:26:17.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.931+0000 7f5142b0f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f513c102320 0x7f513c1149b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:17.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.931+0000 7f5142b0f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c102ce0 0x7f513c112db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:17.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.931+0000 7f5142b0f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f513c108390 0x7f513c1133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:17.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.931+0000 7f5142b0f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f513c1125f0 con 0x7f513c102ce0 2024-04-26T20:26:17.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.931+0000 7f5142b0f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f513c112470 con 0x7f513c102320 2024-04-26T20:26:17.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.931+0000 7f5142b0f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f513c112770 con 0x7f513c108390 2024-04-26T20:26:17.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f513bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c102ce0 0x7f513c112db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:17.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f513bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c102ce0 0x7f513c112db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46332/0 (socket says 172.21.15.70:46332) 2024-04-26T20:26:17.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f513bfff700 1 -- 172.21.15.70:0/1704308219 learned_addr learned my addr 172.21.15.70:0/1704308219 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:17.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f51410ac700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f513c108390 0x7f513c1133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:17.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f51408ab700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f513c102320 0x7f513c1149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:17.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f513bfff700 1 -- 172.21.15.70:0/1704308219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f513c108390 msgr2=0x7f513c1133c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:17.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f513bfff700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f513c108390 0x7f513c1133c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:17.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f513bfff700 1 -- 172.21.15.70:0/1704308219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f513c102320 msgr2=0x7f513c1149b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:17.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f513bfff700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f513c102320 0x7f513c1149b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:17.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f513bfff700 1 -- 172.21.15.70:0/1704308219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c1a8150 con 0x7f513c102ce0 2024-04-26T20:26:17.253 INFO:teuthology.orchestra.run.smithi070.stdout:347892351002 2024-04-26T20:26:17.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f513bfff700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c102ce0 0x7f513c112db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f513000d950 tx=0x7f513000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:17.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f5139ffb700 1 -- 172.21.15.70:0/1704308219 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130016070 con 0x7f513c102ce0 2024-04-26T20:26:17.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f5142b0f700 1 -- 172.21.15.70:0/1704308219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513c1a8320 con 0x7f513c102ce0 2024-04-26T20:26:17.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f5139ffb700 1 -- 172.21.15.70:0/1704308219 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f513000fd60 con 0x7f513c102ce0 2024-04-26T20:26:17.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.932+0000 7f5139ffb700 1 -- 172.21.15.70:0/1704308219 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513000e610 con 0x7f513c102ce0 2024-04-26T20:26:17.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.933+0000 7f5142b0f700 1 -- 172.21.15.70:0/1704308219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513c1a8830 con 0x7f513c102ce0 2024-04-26T20:26:17.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.933+0000 7f5142b0f700 1 -- 172.21.15.70:0/1704308219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f513c06a110 con 0x7f513c102ce0 2024-04-26T20:26:17.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.935+0000 7f5139ffb700 1 -- 172.21.15.70:0/1704308219 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5130019070 con 0x7f513c102ce0 2024-04-26T20:26:17.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.935+0000 7f5139ffb700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f51240a3cd0 0x7f51240a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:17.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.936+0000 7f51408ab700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f51240a3cd0 0x7f51240a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:17.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.936+0000 7f5139ffb700 1 -- 172.21.15.70:0/1704308219 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f513009a280 con 0x7f513c102ce0 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.936+0000 7f51408ab700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f51240a3cd0 0x7f51240a6190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5134007fd0 tx=0x7f51340079e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:14.941+0000 7f5139ffb700 1 -- 172.21.15.70:0/1704308219 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f513009c8e0 con 0x7f513c102ce0 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.151+0000 7f5142b0f700 1 -- 172.21.15.70:0/1704308219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f513c1a8a90 con 0x7f513c102ce0 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.152+0000 7f5139ffb700 1 -- 172.21.15.70:0/1704308219 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f513009c1e0 con 0x7f513c102ce0 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 -- 172.21.15.70:0/1704308219 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f51240a3cd0 msgr2=0x7f51240a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f51240a3cd0 0x7f51240a6190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5134007fd0 tx=0x7f51340079e0 comp rx=0 tx=0).stop 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 -- 172.21.15.70:0/1704308219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c102ce0 msgr2=0x7f513c112db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c102ce0 0x7f513c112db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f513000d950 tx=0x7f513000dc60 comp rx=0 tx=0).stop 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 -- 172.21.15.70:0/1704308219 shutdown_connections 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f51240a3cd0 0x7f51240a6190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f513c108390 0x7f513c1133c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f513c102320 0x7f513c1149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 --2- 172.21.15.70:0/1704308219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c102ce0 0x7f513c112db0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:17.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 -- 172.21.15.70:0/1704308219 >> 172.21.15.70:0/1704308219 conn(0x7f513c0792d0 msgr2=0x7f513c0ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:17.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 -- 172.21.15.70:0/1704308219 shutdown_connections 2024-04-26T20:26:17.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:15.154+0000 7f5142b0f700 1 -- 172.21.15.70:0/1704308219 wait complete. 2024-04-26T20:26:17.851 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350999 got 347892351002 for osd.11 2024-04-26T20:26:17.851 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:18.095 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:17 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1704014450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T20:26:18.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:17 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1704014450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T20:26:18.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:17 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1704014450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T20:26:18.607 INFO:teuthology.orchestra.run.smithi070.stdout:146028888125 2024-04-26T20:26:18.607 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-26T20:26:18.833 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:18 smithi070 ceph-mon[29124]: pgmap v323: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 5.0 KiB/s, 1 objects/s recovering 2024-04-26T20:26:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:18 smithi098 ceph-mon[32591]: pgmap v323: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 5.0 KiB/s, 1 objects/s recovering 2024-04-26T20:26:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:18 smithi080 ceph-mon[32278]: pgmap v323: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 5.0 KiB/s, 1 objects/s recovering 2024-04-26T20:26:19.521 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724596 got 167503724601 for osd.5 2024-04-26T20:26:19.522 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.158+0000 7f7e4073a700 1 -- 172.21.15.70:0/3890569573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e381025b0 msgr2=0x7f7e38102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.158+0000 7f7e4073a700 1 --2- 172.21.15.70:0/3890569573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e381025b0 0x7f7e38102990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000b0d0 tx=0x7f7e3000b3e0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.158+0000 7f7e4073a700 1 -- 172.21.15.70:0/3890569573 shutdown_connections 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.158+0000 7f7e4073a700 1 --2- 172.21.15.70:0/3890569573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e38107640 0x7f7e3810f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.158+0000 7f7e4073a700 1 --2- 172.21.15.70:0/3890569573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e381025b0 0x7f7e38102990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.158+0000 7f7e4073a700 1 --2- 172.21.15.70:0/3890569573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e38102f60 0x7f7e38106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.158+0000 7f7e4073a700 1 -- 172.21.15.70:0/3890569573 >> 172.21.15.70:0/3890569573 conn(0x7f7e380792f0 msgr2=0x7f7e38079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.158+0000 7f7e4073a700 1 -- 172.21.15.70:0/3890569573 shutdown_connections 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.158+0000 7f7e4073a700 1 -- 172.21.15.70:0/3890569573 wait complete. 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e4073a700 1 Processor -- start 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e4073a700 1 -- start start 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e4073a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e381025b0 0x7f7e3819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e4073a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e38102f60 0x7f7e3819b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e4073a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e38107640 0x7f7e381a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e4073a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7e38112690 con 0x7f7e38107640 2024-04-26T20:26:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e4073a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7e38112510 con 0x7f7e38102f60 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e4073a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e38112810 con 0x7f7e381025b0 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e3ecd7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e38107640 0x7f7e381a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e3ecd7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e38107640 0x7f7e381a5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44542/0 (socket says 172.21.15.70:44542) 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e3ecd7700 1 -- 172.21.15.70:0/3043412331 learned_addr learned my addr 172.21.15.70:0/3043412331 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e3e4d6700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e381025b0 0x7f7e3819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e3dcd5700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e38102f60 0x7f7e3819b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e3ecd7700 1 -- 172.21.15.70:0/3043412331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e381025b0 msgr2=0x7f7e3819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e3ecd7700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e381025b0 0x7f7e3819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e3ecd7700 1 -- 172.21.15.70:0/3043412331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e38102f60 msgr2=0x7f7e3819b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e3ecd7700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e38102f60 0x7f7e3819b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e3ecd7700 1 -- 172.21.15.70:0/3043412331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e381a6090 con 0x7f7e38107640 2024-04-26T20:26:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.159+0000 7f7e3ecd7700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e38107640 0x7f7e381a5b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800d980 tx=0x7f7e2800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.160+0000 7f7e377fe700 1 -- 172.21.15.70:0/3043412331 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28017070 con 0x7f7e38107640 2024-04-26T20:26:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.160+0000 7f7e377fe700 1 -- 172.21.15.70:0/3043412331 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7e28005020 con 0x7f7e38107640 2024-04-26T20:26:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.160+0000 7f7e4073a700 1 -- 172.21.15.70:0/3043412331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e381a62c0 con 0x7f7e38107640 2024-04-26T20:26:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.160+0000 7f7e377fe700 1 -- 172.21.15.70:0/3043412331 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28009a90 con 0x7f7e38107640 2024-04-26T20:26:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.160+0000 7f7e4073a700 1 -- 172.21.15.70:0/3043412331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e381a67b0 con 0x7f7e38107640 2024-04-26T20:26:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.161+0000 7f7e4073a700 1 -- 172.21.15.70:0/3043412331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3806a110 con 0x7f7e38107640 2024-04-26T20:26:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.162+0000 7f7e377fe700 1 -- 172.21.15.70:0/3043412331 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7e280051d0 con 0x7f7e38107640 2024-04-26T20:26:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.162+0000 7f7e377fe700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7e200a3cd0 0x7f7e200a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.162+0000 7f7e3e4d6700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7e200a3cd0 0x7f7e200a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.162+0000 7f7e377fe700 1 -- 172.21.15.70:0/3043412331 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f7e280d03f0 con 0x7f7e38107640 2024-04-26T20:26:20.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.163+0000 7f7e3e4d6700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7e200a3cd0 0x7f7e200a6190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000bf40 tx=0x7f7e3000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.168+0000 7f7e377fe700 1 -- 172.21.15.70:0/3043412331 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7e28020020 con 0x7f7e38107640 2024-04-26T20:26:20.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.383+0000 7f7e4073a700 1 -- 172.21.15.70:0/3043412331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f7e3802e650 con 0x7f7e38107640 2024-04-26T20:26:20.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.383+0000 7f7e377fe700 1 -- 172.21.15.70:0/3043412331 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7e2809cc60 con 0x7f7e38107640 2024-04-26T20:26:20.384 INFO:teuthology.orchestra.run.smithi070.stdout:257698037802 2024-04-26T20:26:20.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.385+0000 7f7e4073a700 1 -- 172.21.15.70:0/3043412331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7e200a3cd0 msgr2=0x7f7e200a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:20.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.385+0000 7f7e4073a700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7e200a3cd0 0x7f7e200a6190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000bf40 tx=0x7f7e3000b040 comp rx=0 tx=0).stop 2024-04-26T20:26:20.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.385+0000 7f7e4073a700 1 -- 172.21.15.70:0/3043412331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e38107640 msgr2=0x7f7e381a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:20.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.385+0000 7f7e4073a700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e38107640 0x7f7e381a5b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800d980 tx=0x7f7e2800dc90 comp rx=0 tx=0).stop 2024-04-26T20:26:20.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.386+0000 7f7e4073a700 1 -- 172.21.15.70:0/3043412331 shutdown_connections 2024-04-26T20:26:20.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.386+0000 7f7e4073a700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f7e200a3cd0 0x7f7e200a6190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.386+0000 7f7e4073a700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e38107640 0x7f7e381a5b50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.386+0000 7f7e4073a700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e381025b0 0x7f7e3819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.386+0000 7f7e4073a700 1 --2- 172.21.15.70:0/3043412331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e38102f60 0x7f7e3819b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.386+0000 7f7e4073a700 1 -- 172.21.15.70:0/3043412331 >> 172.21.15.70:0/3043412331 conn(0x7f7e380792f0 msgr2=0x7f7e38106280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:20.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.386+0000 7f7e4073a700 1 -- 172.21.15.70:0/3043412331 shutdown_connections 2024-04-26T20:26:20.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.386+0000 7f7e4073a700 1 -- 172.21.15.70:0/3043412331 wait complete. 2024-04-26T20:26:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.495+0000 7faf15948700 1 -- 172.21.15.70:0/3583265803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf1006bad0 msgr2=0x7faf101102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.495+0000 7faf15948700 1 --2- 172.21.15.70:0/3583265803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf1006bad0 0x7faf101102e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faf0800b0a0 tx=0x7faf0800b3b0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.495+0000 7faf15948700 1 -- 172.21.15.70:0/3583265803 shutdown_connections 2024-04-26T20:26:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.495+0000 7faf15948700 1 --2- 172.21.15.70:0/3583265803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf1006bad0 0x7faf101102e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.495+0000 7faf15948700 1 --2- 172.21.15.70:0/3583265803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf101094a0 0x7faf10109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.495+0000 7faf15948700 1 --2- 172.21.15.70:0/3583265803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf1006b130 0x7faf1006b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.495+0000 7faf15948700 1 -- 172.21.15.70:0/3583265803 >> 172.21.15.70:0/3583265803 conn(0x7faf100792d0 msgr2=0x7faf100796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.495+0000 7faf15948700 1 -- 172.21.15.70:0/3583265803 shutdown_connections 2024-04-26T20:26:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.495+0000 7faf15948700 1 -- 172.21.15.70:0/3583265803 wait complete. 2024-04-26T20:26:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf15948700 1 Processor -- start 2024-04-26T20:26:20.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf15948700 1 -- start start 2024-04-26T20:26:20.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf15948700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf1006b130 0x7faf1019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:20.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf15948700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf1006bad0 0x7faf1019ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:20.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf15948700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf101094a0 0x7faf10199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:20.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf15948700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faf101137d0 con 0x7faf1006b130 2024-04-26T20:26:20.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf15948700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faf10113650 con 0x7faf1006bad0 2024-04-26T20:26:20.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf15948700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faf10113950 con 0x7faf101094a0 2024-04-26T20:26:20.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf0effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf1006b130 0x7faf1019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:20.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf0effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf1006b130 0x7faf1019fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44570/0 (socket says 172.21.15.70:44570) 2024-04-26T20:26:20.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf0effd700 1 -- 172.21.15.70:0/64867411 learned_addr learned my addr 172.21.15.70:0/64867411 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf0e7fc700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf1006bad0 0x7faf1019ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf0f7fe700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf101094a0 0x7faf10199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf0effd700 1 -- 172.21.15.70:0/64867411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf101094a0 msgr2=0x7faf10199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf0effd700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf101094a0 0x7faf10199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf0effd700 1 -- 172.21.15.70:0/64867411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf1006bad0 msgr2=0x7faf1019ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.496+0000 7faf0effd700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf1006bad0 0x7faf1019ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.497+0000 7faf0effd700 1 -- 172.21.15.70:0/64867411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1019a3f0 con 0x7faf1006b130 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.497+0000 7faf0effd700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf1006b130 0x7faf1019fa40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faf0000b530 tx=0x7faf0000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.497+0000 7faf14946700 1 -- 172.21.15.70:0/64867411 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00015020 con 0x7faf1006b130 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.497+0000 7faf15948700 1 -- 172.21.15.70:0/64867411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1019a6e0 con 0x7faf1006b130 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.497+0000 7faf14946700 1 -- 172.21.15.70:0/64867411 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf00011d00 con 0x7faf1006b130 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.497+0000 7faf14946700 1 -- 172.21.15.70:0/64867411 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00010e40 con 0x7faf1006b130 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.497+0000 7faf15948700 1 -- 172.21.15.70:0/64867411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf101a69c0 con 0x7faf1006b130 2024-04-26T20:26:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.498+0000 7faf15948700 1 -- 172.21.15.70:0/64867411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf1010ba10 con 0x7faf1006b130 2024-04-26T20:26:20.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.499+0000 7faf14946700 1 -- 172.21.15.70:0/64867411 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7faf00018020 con 0x7faf1006b130 2024-04-26T20:26:20.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.500+0000 7faf14946700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faef80a3d50 0x7faef80a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:20.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.500+0000 7faf0e7fc700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faef80a3d50 0x7faef80a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:20.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.500+0000 7faf14946700 1 -- 172.21.15.70:0/64867411 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7faf000cfb30 con 0x7faf1006b130 2024-04-26T20:26:20.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.500+0000 7faf0e7fc700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faef80a3d50 0x7faef80a6210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faf1019b260 tx=0x7faf04009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:20.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.504+0000 7faf14946700 1 -- 172.21.15.70:0/64867411 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7faf0001f020 con 0x7faf1006b130 2024-04-26T20:26:20.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.710+0000 7faf15948700 1 -- 172.21.15.70:0/64867411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7faf1010b3f0 con 0x7faf1006b130 2024-04-26T20:26:20.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.711+0000 7faf14946700 1 -- 172.21.15.70:0/64867411 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faf0009c4b0 con 0x7faf1006b130 2024-04-26T20:26:20.712 INFO:teuthology.orchestra.run.smithi070.stdout:223338299439 2024-04-26T20:26:20.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 -- 172.21.15.70:0/64867411 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faef80a3d50 msgr2=0x7faef80a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:20.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faef80a3d50 0x7faef80a6210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faf1019b260 tx=0x7faf04009190 comp rx=0 tx=0).stop 2024-04-26T20:26:20.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 -- 172.21.15.70:0/64867411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf1006b130 msgr2=0x7faf1019fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:20.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf1006b130 0x7faf1019fa40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faf0000b530 tx=0x7faf0000b840 comp rx=0 tx=0).stop 2024-04-26T20:26:20.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 -- 172.21.15.70:0/64867411 shutdown_connections 2024-04-26T20:26:20.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7faef80a3d50 0x7faef80a6210 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf101094a0 0x7faf10199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf1006b130 0x7faf1019fa40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 --2- 172.21.15.70:0/64867411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf1006bad0 0x7faf1019ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:20.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 -- 172.21.15.70:0/64867411 >> 172.21.15.70:0/64867411 conn(0x7faf100792d0 msgr2=0x7faf101003d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:20.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 -- 172.21.15.70:0/64867411 shutdown_connections 2024-04-26T20:26:20.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:20.713+0000 7faf15948700 1 -- 172.21.15.70:0/64867411 wait complete. 2024-04-26T20:26:21.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:20 smithi070 ceph-mon[29124]: pgmap v324: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s; 4.6 KiB/s, 1 objects/s recovering 2024-04-26T20:26:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:20 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3043412331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T20:26:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:20 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/64867411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T20:26:21.115 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037797 got 257698037802 for osd.8 2024-04-26T20:26:21.115 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:21.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:20 smithi098 ceph-mon[32591]: pgmap v324: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s; 4.6 KiB/s, 1 objects/s recovering 2024-04-26T20:26:21.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:20 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3043412331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T20:26:21.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:20 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/64867411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T20:26:21.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:20 smithi080 ceph-mon[32278]: pgmap v324: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s; 4.6 KiB/s, 1 objects/s recovering 2024-04-26T20:26:21.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:20 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3043412331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T20:26:21.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:20 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/64867411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T20:26:22.012 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149756 got 111669149762 for osd.3 2024-04-26T20:26:22.013 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:22.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.206+0000 7f9a80d11700 1 -- 172.21.15.70:0/2764204870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c109560 msgr2=0x7f9a7c109940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:22.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.206+0000 7f9a80d11700 1 --2- 172.21.15.70:0/2764204870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c109560 0x7f9a7c109940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9a700099c0 tx=0x7f9a70009cd0 comp rx=0 tx=0).stop 2024-04-26T20:26:22.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.206+0000 7f9a80d11700 1 -- 172.21.15.70:0/2764204870 shutdown_connections 2024-04-26T20:26:22.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.206+0000 7f9a80d11700 1 --2- 172.21.15.70:0/2764204870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a7c103e80 0x7f9a7c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:22.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.206+0000 7f9a80d11700 1 --2- 172.21.15.70:0/2764204870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c109560 0x7f9a7c109940 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:22.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.206+0000 7f9a80d11700 1 --2- 172.21.15.70:0/2764204870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a7c1034c0 0x7f9a7c103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:22.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.207+0000 7f9a80d11700 1 -- 172.21.15.70:0/2764204870 >> 172.21.15.70:0/2764204870 conn(0x7f9a7c07a5d0 msgr2=0x7f9a7c07a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:22.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.207+0000 7f9a80d11700 1 -- 172.21.15.70:0/2764204870 shutdown_connections 2024-04-26T20:26:22.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.207+0000 7f9a80d11700 1 -- 172.21.15.70:0/2764204870 wait complete. 2024-04-26T20:26:22.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.207+0000 7f9a80d11700 1 Processor -- start 2024-04-26T20:26:22.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.207+0000 7f9a80d11700 1 -- start start 2024-04-26T20:26:22.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.207+0000 7f9a80d11700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a7c1034c0 0x7f9a7c19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:22.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.207+0000 7f9a80d11700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c103e80 0x7f9a7c19ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:22.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a80d11700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a7c109560 0x7f9a7c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a80d11700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c113870 con 0x7f9a7c103e80 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a80d11700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1136f0 con 0x7f9a7c109560 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a80d11700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1139f0 con 0x7f9a7c1034c0 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a79d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c103e80 0x7f9a7c19ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a79d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c103e80 0x7f9a7c19ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44584/0 (socket says 172.21.15.70:44584) 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a79d9b700 1 -- 172.21.15.70:0/4228452122 learned_addr learned my addr 172.21.15.70:0/4228452122 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a7a59c700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a7c1034c0 0x7f9a7c19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a7ad9d700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a7c109560 0x7f9a7c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a79d9b700 1 -- 172.21.15.70:0/4228452122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a7c1034c0 msgr2=0x7f9a7c19fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a79d9b700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a7c1034c0 0x7f9a7c19fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a79d9b700 1 -- 172.21.15.70:0/4228452122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a7c109560 msgr2=0x7f9a7c199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a79d9b700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a7c109560 0x7f9a7c199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:22.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a79d9b700 1 -- 172.21.15.70:0/4228452122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c19a3f0 con 0x7f9a7c103e80 2024-04-26T20:26:22.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a7ad9d700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a7c109560 0x7f9a7c199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:22.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a79d9b700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c103e80 0x7f9a7c19ff80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00d980 tx=0x7f9a6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:22.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a6b7fe700 1 -- 172.21.15.70:0/4228452122 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c017070 con 0x7f9a7c103e80 2024-04-26T20:26:22.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a6b7fe700 1 -- 172.21.15.70:0/4228452122 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9a6c005020 con 0x7f9a7c103e80 2024-04-26T20:26:22.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a80d11700 1 -- 172.21.15.70:0/4228452122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c19a6e0 con 0x7f9a7c103e80 2024-04-26T20:26:22.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a6b7fe700 1 -- 172.21.15.70:0/4228452122 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c009bf0 con 0x7f9a7c103e80 2024-04-26T20:26:22.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.208+0000 7f9a80d11700 1 -- 172.21.15.70:0/4228452122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c1a69c0 con 0x7f9a7c103e80 2024-04-26T20:26:22.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.209+0000 7f9a80d11700 1 -- 172.21.15.70:0/4228452122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7c10b9f0 con 0x7f9a7c103e80 2024-04-26T20:26:22.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.210+0000 7f9a6b7fe700 1 -- 172.21.15.70:0/4228452122 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9a6c0051d0 con 0x7f9a7c103e80 2024-04-26T20:26:22.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.211+0000 7f9a6b7fe700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9a640a3cd0 0x7f9a640a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:22.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.211+0000 7f9a7a59c700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9a640a3cd0 0x7f9a640a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:22.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.211+0000 7f9a6b7fe700 1 -- 172.21.15.70:0/4228452122 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f9a6c0d0450 con 0x7f9a7c103e80 2024-04-26T20:26:22.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.211+0000 7f9a7a59c700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9a640a3cd0 0x7f9a640a6190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000b580 tx=0x7f9a70005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:22.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.215+0000 7f9a6b7fe700 1 -- 172.21.15.70:0/4228452122 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f9a6c020020 con 0x7f9a7c103e80 2024-04-26T20:26:22.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.420+0000 7f9a80d11700 1 -- 172.21.15.70:0/4228452122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9a7c19afd0 con 0x7f9a7c103e80 2024-04-26T20:26:22.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.420+0000 7f9a6b7fe700 1 -- 172.21.15.70:0/4228452122 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a6c09ccc0 con 0x7f9a7c103e80 2024-04-26T20:26:22.421 INFO:teuthology.orchestra.run.smithi070.stdout:77309411401 2024-04-26T20:26:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.422+0000 7f9a80d11700 1 -- 172.21.15.70:0/4228452122 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9a640a3cd0 msgr2=0x7f9a640a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.422+0000 7f9a80d11700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9a640a3cd0 0x7f9a640a6190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000b580 tx=0x7f9a70005a90 comp rx=0 tx=0).stop 2024-04-26T20:26:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.422+0000 7f9a80d11700 1 -- 172.21.15.70:0/4228452122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c103e80 msgr2=0x7f9a7c19ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.422+0000 7f9a80d11700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c103e80 0x7f9a7c19ff80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00d980 tx=0x7f9a6c00dc90 comp rx=0 tx=0).stop 2024-04-26T20:26:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.422+0000 7f9a80d11700 1 -- 172.21.15.70:0/4228452122 shutdown_connections 2024-04-26T20:26:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.422+0000 7f9a80d11700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9a640a3cd0 0x7f9a640a6190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.422+0000 7f9a80d11700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a7c109560 0x7f9a7c199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.422+0000 7f9a80d11700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a7c1034c0 0x7f9a7c19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.422+0000 7f9a80d11700 1 --2- 172.21.15.70:0/4228452122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c103e80 0x7f9a7c19ff80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.422+0000 7f9a80d11700 1 -- 172.21.15.70:0/4228452122 >> 172.21.15.70:0/4228452122 conn(0x7f9a7c07a5d0 msgr2=0x7f9a7c102040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.423+0000 7f9a80d11700 1 -- 172.21.15.70:0/4228452122 shutdown_connections 2024-04-26T20:26:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:22.423+0000 7f9a80d11700 1 -- 172.21.15.70:0/4228452122 wait complete. 2024-04-26T20:26:22.634 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299432 got 223338299439 for osd.7 2024-04-26T20:26:22.634 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:23.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:22 smithi070 ceph-mon[29124]: pgmap v325: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s; 4.2 KiB/s, 0 objects/s recovering 2024-04-26T20:26:23.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:22 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/4228452122' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T20:26:23.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:22 smithi098 ceph-mon[32591]: pgmap v325: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s; 4.2 KiB/s, 0 objects/s recovering 2024-04-26T20:26:23.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:22 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/4228452122' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T20:26:23.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:22 smithi080 ceph-mon[32278]: pgmap v325: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s; 4.2 KiB/s, 0 objects/s recovering 2024-04-26T20:26:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:22 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/4228452122' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T20:26:23.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.405+0000 7fd082f66700 1 -- 172.21.15.70:0/2661413112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c102d10 msgr2=0x7fd07c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.405+0000 7fd082f66700 1 --2- 172.21.15.70:0/2661413112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c102d10 0x7fd07c10f2d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd07400b0a0 tx=0x7fd07400b3b0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.405+0000 7fd082f66700 1 -- 172.21.15.70:0/2661413112 shutdown_connections 2024-04-26T20:26:23.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.405+0000 7fd082f66700 1 --2- 172.21.15.70:0/2661413112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c102d10 0x7fd07c10f2d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.405+0000 7fd082f66700 1 --2- 172.21.15.70:0/2661413112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd07c104270 0x7fd07c104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.405+0000 7fd082f66700 1 --2- 172.21.15.70:0/2661413112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07c102350 0x7fd07c1027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.405+0000 7fd082f66700 1 -- 172.21.15.70:0/2661413112 >> 172.21.15.70:0/2661413112 conn(0x7fd07c078390 msgr2=0x7fd07c0787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:23.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.405+0000 7fd082f66700 1 -- 172.21.15.70:0/2661413112 shutdown_connections 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.406+0000 7fd082f66700 1 -- 172.21.15.70:0/2661413112 wait complete. 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.406+0000 7fd082f66700 1 Processor -- start 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.406+0000 7fd082f66700 1 -- start start 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.406+0000 7fd082f66700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd07c102350 0x7fd07c19e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd082f66700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c102d10 0x7fd07c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd082f66700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07c104270 0x7fd07c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd082f66700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c112710 con 0x7fd07c102d10 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd082f66700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c112590 con 0x7fd07c104270 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd082f66700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c112890 con 0x7fd07c102350 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd07bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c102d10 0x7fd07c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd07bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c102d10 0x7fd07c19ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44600/0 (socket says 172.21.15.70:44600) 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd07bfff700 1 -- 172.21.15.70:0/1498103485 learned_addr learned my addr 172.21.15.70:0/1498103485 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:23.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd081503700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07c104270 0x7fd07c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd07bfff700 1 -- 172.21.15.70:0/1498103485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd07c102350 msgr2=0x7fd07c19e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd07bfff700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd07c102350 0x7fd07c19e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd07bfff700 1 -- 172.21.15.70:0/1498103485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07c104270 msgr2=0x7fd07c1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd07bfff700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07c104270 0x7fd07c1988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd07bfff700 1 -- 172.21.15.70:0/1498103485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c199010 con 0x7fd07c102d10 2024-04-26T20:26:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd07bfff700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c102d10 0x7fd07c19ec30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd06800c9b0 tx=0x7fd06800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd079ffb700 1 -- 172.21.15.70:0/1498103485 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068007b00 con 0x7fd07c102d10 2024-04-26T20:26:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd079ffb700 1 -- 172.21.15.70:0/1498103485 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd068007ca0 con 0x7fd07c102d10 2024-04-26T20:26:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd082f66700 1 -- 172.21.15.70:0/1498103485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07c199300 con 0x7fd07c102d10 2024-04-26T20:26:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.407+0000 7fd079ffb700 1 -- 172.21.15.70:0/1498103485 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0680187c0 con 0x7fd07c102d10 2024-04-26T20:26:23.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.408+0000 7fd082f66700 1 -- 172.21.15.70:0/1498103485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd07c1a55c0 con 0x7fd07c102d10 2024-04-26T20:26:23.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.408+0000 7fd082f66700 1 -- 172.21.15.70:0/1498103485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd07c06a110 con 0x7fd07c102d10 2024-04-26T20:26:23.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.409+0000 7fd079ffb700 1 -- 172.21.15.70:0/1498103485 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd06800f450 con 0x7fd07c102d10 2024-04-26T20:26:23.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.410+0000 7fd079ffb700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd06c0a3d50 0x7fd06c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.410+0000 7fd080d02700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd06c0a3d50 0x7fd06c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.410+0000 7fd079ffb700 1 -- 172.21.15.70:0/1498103485 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fd0680d0600 con 0x7fd07c102d10 2024-04-26T20:26:23.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.410+0000 7fd080d02700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd06c0a3d50 0x7fd06c0a6210 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd07c1999f0 tx=0x7fd070005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:23.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.415+0000 7fd079ffb700 1 -- 172.21.15.70:0/1498103485 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd068014030 con 0x7fd07c102d10 2024-04-26T20:26:23.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.622+0000 7fd082f66700 1 -- 172.21.15.70:0/1498103485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fd07c1a58a0 con 0x7fd07c102d10 2024-04-26T20:26:23.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.622+0000 7fd079ffb700 1 -- 172.21.15.70:0/1498103485 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd06809ce70 con 0x7fd07c102d10 2024-04-26T20:26:23.623 INFO:teuthology.orchestra.run.smithi070.stdout:292057776166 2024-04-26T20:26:23.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.624+0000 7fd082f66700 1 -- 172.21.15.70:0/1498103485 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd06c0a3d50 msgr2=0x7fd06c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.624+0000 7fd082f66700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd06c0a3d50 0x7fd06c0a6210 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd07c1999f0 tx=0x7fd070005c80 comp rx=0 tx=0).stop 2024-04-26T20:26:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.624+0000 7fd082f66700 1 -- 172.21.15.70:0/1498103485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c102d10 msgr2=0x7fd07c19ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.624+0000 7fd082f66700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c102d10 0x7fd07c19ec30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd06800c9b0 tx=0x7fd06800cd70 comp rx=0 tx=0).stop 2024-04-26T20:26:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.625+0000 7fd082f66700 1 -- 172.21.15.70:0/1498103485 shutdown_connections 2024-04-26T20:26:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.625+0000 7fd082f66700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd06c0a3d50 0x7fd06c0a6210 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.625+0000 7fd082f66700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd07c104270 0x7fd07c1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.625+0000 7fd082f66700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd07c102350 0x7fd07c19e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.625+0000 7fd082f66700 1 --2- 172.21.15.70:0/1498103485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd07c102d10 0x7fd07c19ec30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.625+0000 7fd082f66700 1 -- 172.21.15.70:0/1498103485 >> 172.21.15.70:0/1498103485 conn(0x7fd07c078390 msgr2=0x7fd07c100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.625+0000 7fd082f66700 1 -- 172.21.15.70:0/1498103485 shutdown_connections 2024-04-26T20:26:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:23.625+0000 7fd082f66700 1 -- 172.21.15.70:0/1498103485 wait complete. 2024-04-26T20:26:23.885 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411397 got 77309411401 for osd.2 2024-04-26T20:26:23.885 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:24.170 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:23 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1498103485' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T20:26:24.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:23 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1498103485' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T20:26:24.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:23 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1498103485' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.558+0000 7ff37bb16700 1 -- 172.21.15.70:0/984545728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3741023b0 msgr2=0x7ff3741102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.558+0000 7ff37bb16700 1 --2- 172.21.15.70:0/984545728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3741023b0 0x7ff3741102f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00b0a0 tx=0x7ff36c00b3b0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.558+0000 7ff37bb16700 1 -- 172.21.15.70:0/984545728 shutdown_connections 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.558+0000 7ff37bb16700 1 --2- 172.21.15.70:0/984545728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3741023b0 0x7ff3741102f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.558+0000 7ff37bb16700 1 --2- 172.21.15.70:0/984545728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3741094b0 0x7ff374109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.558+0000 7ff37bb16700 1 --2- 172.21.15.70:0/984545728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff374101a10 0x7ff374101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.558+0000 7ff37bb16700 1 -- 172.21.15.70:0/984545728 >> 172.21.15.70:0/984545728 conn(0x7ff374078990 msgr2=0x7ff3740ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.558+0000 7ff37bb16700 1 -- 172.21.15.70:0/984545728 shutdown_connections 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.558+0000 7ff37bb16700 1 -- 172.21.15.70:0/984545728 wait complete. 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff37bb16700 1 Processor -- start 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff37bb16700 1 -- start start 2024-04-26T20:26:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff37bb16700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff374101a10 0x7ff37419f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff37bb16700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3741023b0 0x7ff37419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff37bb16700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3741094b0 0x7ff374199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff37bb16700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff374113780 con 0x7ff374101a10 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff37bb16700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff374113600 con 0x7ff3741094b0 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff37bb16700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff374113900 con 0x7ff3741023b0 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff3798b2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff374101a10 0x7ff37419f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff3798b2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff374101a10 0x7ff37419f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44616/0 (socket says 172.21.15.70:44616) 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff3798b2700 1 -- 172.21.15.70:0/3098194068 learned_addr learned my addr 172.21.15.70:0/3098194068 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff3790b1700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3741023b0 0x7ff37419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff3798b2700 1 -- 172.21.15.70:0/3098194068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3741023b0 msgr2=0x7ff37419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff3798b2700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3741023b0 0x7ff37419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff3798b2700 1 -- 172.21.15.70:0/3098194068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3741094b0 msgr2=0x7ff374199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:24.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff3798b2700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3741094b0 0x7ff374199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.559+0000 7ff3798b2700 1 -- 172.21.15.70:0/3098194068 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37419a1a0 con 0x7ff374101a10 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.560+0000 7ff3798b2700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff374101a10 0x7ff37419f830 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff37000d980 tx=0x7ff37000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.560+0000 7ff36affd700 1 -- 172.21.15.70:0/3098194068 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370017070 con 0x7ff374101a10 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.560+0000 7ff36affd700 1 -- 172.21.15.70:0/3098194068 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff370005020 con 0x7ff374101a10 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.560+0000 7ff37bb16700 1 -- 172.21.15.70:0/3098194068 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff37419a490 con 0x7ff374101a10 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.560+0000 7ff36affd700 1 -- 172.21.15.70:0/3098194068 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370009bf0 con 0x7ff374101a10 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.560+0000 7ff37bb16700 1 -- 172.21.15.70:0/3098194068 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3741a6700 con 0x7ff374101a10 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.561+0000 7ff37bb16700 1 -- 172.21.15.70:0/3098194068 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff374104d30 con 0x7ff374101a10 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.562+0000 7ff36affd700 1 -- 172.21.15.70:0/3098194068 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff3700051d0 con 0x7ff374101a10 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.562+0000 7ff36affd700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff3600a3cd0 0x7ff3600a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.563+0000 7ff36affd700 1 -- 172.21.15.70:0/3098194068 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7ff3700d0820 con 0x7ff374101a10 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.563+0000 7ff3790b1700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff3600a3cd0 0x7ff3600a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.563+0000 7ff3790b1700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff3600a3cd0 0x7ff3600a6190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff374100ff0 tx=0x7ff364009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:24.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.566+0000 7ff36affd700 1 -- 172.21.15.70:0/3098194068 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff370020020 con 0x7ff374101a10 2024-04-26T20:26:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.795+0000 7ff37bb16700 1 -- 172.21.15.70:0/3098194068 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7ff37402e490 con 0x7ff374101a10 2024-04-26T20:26:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.795+0000 7ff36affd700 1 -- 172.21.15.70:0/3098194068 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff37009d090 con 0x7ff374101a10 2024-04-26T20:26:24.797 INFO:teuthology.orchestra.run.smithi070.stdout:313532612641 2024-04-26T20:26:24.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.797+0000 7ff37bb16700 1 -- 172.21.15.70:0/3098194068 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff3600a3cd0 msgr2=0x7ff3600a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:24.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.797+0000 7ff37bb16700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff3600a3cd0 0x7ff3600a6190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff374100ff0 tx=0x7ff364009190 comp rx=0 tx=0).stop 2024-04-26T20:26:24.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.797+0000 7ff37bb16700 1 -- 172.21.15.70:0/3098194068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff374101a10 msgr2=0x7ff37419f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:24.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.797+0000 7ff37bb16700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff374101a10 0x7ff37419f830 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff37000d980 tx=0x7ff37000dc90 comp rx=0 tx=0).stop 2024-04-26T20:26:24.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.797+0000 7ff37bb16700 1 -- 172.21.15.70:0/3098194068 shutdown_connections 2024-04-26T20:26:24.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.797+0000 7ff37bb16700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff3600a3cd0 0x7ff3600a6190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.797+0000 7ff37bb16700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3741094b0 0x7ff374199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.797+0000 7ff37bb16700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff374101a10 0x7ff37419f830 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.797+0000 7ff37bb16700 1 --2- 172.21.15.70:0/3098194068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3741023b0 0x7ff37419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.797+0000 7ff37bb16700 1 -- 172.21.15.70:0/3098194068 >> 172.21.15.70:0/3098194068 conn(0x7ff374078990 msgr2=0x7ff374106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:24.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.798+0000 7ff37bb16700 1 -- 172.21.15.70:0/3098194068 shutdown_connections 2024-04-26T20:26:24.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:24.798+0000 7ff37bb16700 1 -- 172.21.15.70:0/3098194068 wait complete. 2024-04-26T20:26:25.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:24 smithi070 ceph-mon[29124]: pgmap v326: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 4.2 KiB/s, 0 objects/s recovering 2024-04-26T20:26:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:24 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3098194068' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T20:26:25.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:24 smithi098 ceph-mon[32591]: pgmap v326: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 4.2 KiB/s, 0 objects/s recovering 2024-04-26T20:26:25.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:24 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3098194068' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T20:26:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:24 smithi080 ceph-mon[32278]: pgmap v326: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 4.2 KiB/s, 0 objects/s recovering 2024-04-26T20:26:25.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:24 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3098194068' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T20:26:25.522 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776162 got 292057776166 for osd.9 2024-04-26T20:26:25.522 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:25.762 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:25.763 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:26.209 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612635 got 313532612641 for osd.10 2024-04-26T20:26:26.209 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:26 smithi098 ceph-mon[32591]: pgmap v327: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:26:27.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:26 smithi080 ceph-mon[32278]: pgmap v327: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:26:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:26 smithi070 ceph-mon[29124]: pgmap v327: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:26:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.597+0000 7fe33a831700 1 -- 172.21.15.70:0/476645205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3341025b0 msgr2=0x7fe334102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.597+0000 7fe33a831700 1 --2- 172.21.15.70:0/476645205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3341025b0 0x7fe334102990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe3240099c0 tx=0x7fe324009cd0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.597+0000 7fe33a831700 1 -- 172.21.15.70:0/476645205 shutdown_connections 2024-04-26T20:26:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.597+0000 7fe33a831700 1 --2- 172.21.15.70:0/476645205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe334107640 0x7fe33410f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.597+0000 7fe33a831700 1 --2- 172.21.15.70:0/476645205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3341025b0 0x7fe334102990 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.597+0000 7fe33a831700 1 --2- 172.21.15.70:0/476645205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe334102f60 0x7fe334106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.597+0000 7fe33a831700 1 -- 172.21.15.70:0/476645205 >> 172.21.15.70:0/476645205 conn(0x7fe3340792f0 msgr2=0x7fe334079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:27.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.597+0000 7fe33a831700 1 -- 172.21.15.70:0/476645205 shutdown_connections 2024-04-26T20:26:27.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.597+0000 7fe33a831700 1 -- 172.21.15.70:0/476645205 wait complete. 2024-04-26T20:26:27.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.597+0000 7fe33a831700 1 Processor -- start 2024-04-26T20:26:27.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe33a831700 1 -- start start 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe33a831700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3341025b0 0x7fe3341987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe33a831700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe334102f60 0x7fe334198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe33a831700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe334107640 0x7fe334199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe33a831700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe334112610 con 0x7fe334107640 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe33a831700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe334112490 con 0x7fe334102f60 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe33a831700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe334112790 con 0x7fe3341025b0 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe338dce700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe334107640 0x7fe334199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe338dce700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe334107640 0x7fe334199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44632/0 (socket says 172.21.15.70:44632) 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe338dce700 1 -- 172.21.15.70:0/350277630 learned_addr learned my addr 172.21.15.70:0/350277630 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe3337fe700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe334102f60 0x7fe334198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe333fff700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3341025b0 0x7fe3341987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe338dce700 1 -- 172.21.15.70:0/350277630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3341025b0 msgr2=0x7fe3341987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe338dce700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3341025b0 0x7fe3341987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe338dce700 1 -- 172.21.15.70:0/350277630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe334102f60 msgr2=0x7fe334198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe338dce700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe334102f60 0x7fe334198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.598+0000 7fe338dce700 1 -- 172.21.15.70:0/350277630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3341a8030 con 0x7fe334107640 2024-04-26T20:26:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.599+0000 7fe338dce700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe334107640 0x7fe334199240 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe32c007d70 tx=0x7fe32c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.599+0000 7fe3317fa700 1 -- 172.21.15.70:0/350277630 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c016020 con 0x7fe334107640 2024-04-26T20:26:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.599+0000 7fe3317fa700 1 -- 172.21.15.70:0/350277630 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe32c00ac90 con 0x7fe334107640 2024-04-26T20:26:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.599+0000 7fe33a831700 1 -- 172.21.15.70:0/350277630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3341a8320 con 0x7fe334107640 2024-04-26T20:26:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.599+0000 7fe3317fa700 1 -- 172.21.15.70:0/350277630 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0115e0 con 0x7fe334107640 2024-04-26T20:26:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.599+0000 7fe33a831700 1 -- 172.21.15.70:0/350277630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3341a8860 con 0x7fe334107640 2024-04-26T20:26:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.600+0000 7fe33a831700 1 -- 172.21.15.70:0/350277630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33406a110 con 0x7fe334107640 2024-04-26T20:26:27.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.601+0000 7fe3317fa700 1 -- 172.21.15.70:0/350277630 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe32c019020 con 0x7fe334107640 2024-04-26T20:26:27.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.602+0000 7fe3317fa700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe31c0a3d50 0x7fe31c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.602+0000 7fe333fff700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe31c0a3d50 0x7fe31c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.602+0000 7fe3317fa700 1 -- 172.21.15.70:0/350277630 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fe32c0d0750 con 0x7fe334107640 2024-04-26T20:26:27.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.602+0000 7fe333fff700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe31c0a3d50 0x7fe31c0a6210 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe324009990 tx=0x7fe32400b870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:27.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.605+0000 7fe3317fa700 1 -- 172.21.15.70:0/350277630 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fe32c020020 con 0x7fe334107640 2024-04-26T20:26:27.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.807+0000 7fe33a831700 1 -- 172.21.15.70:0/350277630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe33402e490 con 0x7fe334107640 2024-04-26T20:26:27.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.808+0000 7fe3317fa700 1 -- 172.21.15.70:0/350277630 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe32c09d070 con 0x7fe334107640 2024-04-26T20:26:27.809 INFO:teuthology.orchestra.run.smithi070.stdout:201863462966 2024-04-26T20:26:27.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 -- 172.21.15.70:0/350277630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe31c0a3d50 msgr2=0x7fe31c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe31c0a3d50 0x7fe31c0a6210 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe324009990 tx=0x7fe32400b870 comp rx=0 tx=0).stop 2024-04-26T20:26:27.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 -- 172.21.15.70:0/350277630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe334107640 msgr2=0x7fe334199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe334107640 0x7fe334199240 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe32c007d70 tx=0x7fe32c00a340 comp rx=0 tx=0).stop 2024-04-26T20:26:27.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 -- 172.21.15.70:0/350277630 shutdown_connections 2024-04-26T20:26:27.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe31c0a3d50 0x7fe31c0a6210 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe334107640 0x7fe334199240 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3341025b0 0x7fe3341987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 --2- 172.21.15.70:0/350277630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe334102f60 0x7fe334198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 -- 172.21.15.70:0/350277630 >> 172.21.15.70:0/350277630 conn(0x7fe3340792f0 msgr2=0x7fe3341003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:27.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 -- 172.21.15.70:0/350277630 shutdown_connections 2024-04-26T20:26:27.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:27.810+0000 7fe33a831700 1 -- 172.21.15.70:0/350277630 wait complete. 2024-04-26T20:26:28.005 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:27 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/350277630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T20:26:28.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:27 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/350277630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T20:26:28.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:27 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/350277630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T20:26:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:28 smithi070 ceph-mon[29124]: pgmap v328: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:26:29.100 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462961 got 201863462966 for osd.6 2024-04-26T20:26:29.100 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:29.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:28 smithi098 ceph-mon[32591]: pgmap v328: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:26:29.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:28 smithi080 ceph-mon[32278]: pgmap v328: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:26:30.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.292+0000 7f80cad57700 1 -- 172.21.15.70:0/859027070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80c4108390 msgr2=0x7f80c4108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.292+0000 7f80cad57700 1 --2- 172.21.15.70:0/859027070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80c4108390 0x7f80c4108770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009990 tx=0x7f80b8009ca0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.292+0000 7f80cad57700 1 -- 172.21.15.70:0/859027070 shutdown_connections 2024-04-26T20:26:30.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.292+0000 7f80cad57700 1 --2- 172.21.15.70:0/859027070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80c4102ce0 0x7f80c410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.292+0000 7f80cad57700 1 --2- 172.21.15.70:0/859027070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80c4108390 0x7f80c4108770 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.292+0000 7f80cad57700 1 --2- 172.21.15.70:0/859027070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80c4102320 0x7f80c41027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.292+0000 7f80cad57700 1 -- 172.21.15.70:0/859027070 >> 172.21.15.70:0/859027070 conn(0x7f80c40792d0 msgr2=0x7f80c40796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:30.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.292+0000 7f80cad57700 1 -- 172.21.15.70:0/859027070 shutdown_connections 2024-04-26T20:26:30.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.292+0000 7f80cad57700 1 -- 172.21.15.70:0/859027070 wait complete. 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.292+0000 7f80cad57700 1 Processor -- start 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80cad57700 1 -- start start 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80cad57700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80c4102320 0x7f80c419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80cad57700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80c4102ce0 0x7f80c419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80cad57700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80c4108390 0x7f80c4199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80cad57700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4112610 con 0x7f80c4102ce0 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80cad57700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4112490 con 0x7f80c4108390 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80cad57700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4112790 con 0x7f80c4102320 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80c4102ce0 0x7f80c419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80c4102ce0 0x7f80c419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59058/0 (socket says 172.21.15.70:59058) 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c3fff700 1 -- 172.21.15.70:0/956815944 learned_addr learned my addr 172.21.15.70:0/956815944 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c8af3700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80c4102320 0x7f80c419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:30.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c92f4700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80c4108390 0x7f80c4199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c3fff700 1 -- 172.21.15.70:0/956815944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80c4102320 msgr2=0x7f80c419f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c3fff700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80c4102320 0x7f80c419f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c3fff700 1 -- 172.21.15.70:0/956815944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80c4108390 msgr2=0x7f80c4199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c3fff700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80c4108390 0x7f80c4199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c3fff700 1 -- 172.21.15.70:0/956815944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c419a1c0 con 0x7f80c4102ce0 2024-04-26T20:26:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c3fff700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80c4102ce0 0x7f80c419fd90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f80b000d950 tx=0x7f80b000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c1ffb700 1 -- 172.21.15.70:0/956815944 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0016070 con 0x7f80c4102ce0 2024-04-26T20:26:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c1ffb700 1 -- 172.21.15.70:0/956815944 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80b0009e10 con 0x7f80c4102ce0 2024-04-26T20:26:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80cad57700 1 -- 172.21.15.70:0/956815944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c419a4b0 con 0x7f80c4102ce0 2024-04-26T20:26:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.293+0000 7f80c1ffb700 1 -- 172.21.15.70:0/956815944 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b000f620 con 0x7f80c4102ce0 2024-04-26T20:26:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.294+0000 7f80cad57700 1 -- 172.21.15.70:0/956815944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c41a6720 con 0x7f80c4102ce0 2024-04-26T20:26:30.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.295+0000 7f80cad57700 1 -- 172.21.15.70:0/956815944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c406a110 con 0x7f80c4102ce0 2024-04-26T20:26:30.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.296+0000 7f80c1ffb700 1 -- 172.21.15.70:0/956815944 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f80b0019070 con 0x7f80c4102ce0 2024-04-26T20:26:30.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.296+0000 7f80c1ffb700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80b40a3cd0 0x7f80b40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:30.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.296+0000 7f80c8af3700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80b40a3cd0 0x7f80b40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:30.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.296+0000 7f80c1ffb700 1 -- 172.21.15.70:0/956815944 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f80b00d0170 con 0x7f80c4102ce0 2024-04-26T20:26:30.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.297+0000 7f80c8af3700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80b40a3cd0 0x7f80b40a6190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f80c4100b70 tx=0x7f80b8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:30.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.301+0000 7f80c1ffb700 1 -- 172.21.15.70:0/956815944 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f80b009c9e0 con 0x7f80c4102ce0 2024-04-26T20:26:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.187+0000 7fb96ea1b700 1 -- 172.21.15.70:0/2837618127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9681023b0 msgr2=0x7fb9681102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.187+0000 7fb96ea1b700 1 --2- 172.21.15.70:0/2837618127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9681023b0 0x7fb9681102f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb96000b0a0 tx=0x7fb96000b3b0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.187+0000 7fb96ea1b700 1 -- 172.21.15.70:0/2837618127 shutdown_connections 2024-04-26T20:26:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.187+0000 7fb96ea1b700 1 --2- 172.21.15.70:0/2837618127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9681023b0 0x7fb9681102f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.187+0000 7fb96ea1b700 1 --2- 172.21.15.70:0/2837618127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9681094b0 0x7fb968109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.187+0000 7fb96ea1b700 1 --2- 172.21.15.70:0/2837618127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb968101a10 0x7fb968101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.187+0000 7fb96ea1b700 1 -- 172.21.15.70:0/2837618127 >> 172.21.15.70:0/2837618127 conn(0x7fb968078990 msgr2=0x7fb9680ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.187+0000 7fb96ea1b700 1 -- 172.21.15.70:0/2837618127 shutdown_connections 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.187+0000 7fb96ea1b700 1 -- 172.21.15.70:0/2837618127 wait complete. 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.188+0000 7fb96ea1b700 1 Processor -- start 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.188+0000 7fb96ea1b700 1 -- start start 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb96ea1b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb968101a10 0x7fb968102bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb96ea1b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9681023b0 0x7fb968103130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb96ea1b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9681094b0 0x7fb968103670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb96ea1b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb968113770 con 0x7fb9681023b0 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb96ea1b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb9681135f0 con 0x7fb9681094b0 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb96ea1b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9681138f0 con 0x7fb968101a10 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9681023b0 0x7fb968103130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9681023b0 0x7fb968103130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59044/0 (socket says 172.21.15.70:59044) 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb9677fe700 1 -- 172.21.15.70:0/1780402383 learned_addr learned my addr 172.21.15.70:0/1780402383 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb967fff700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb968101a10 0x7fb968102bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb96cfb8700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9681094b0 0x7fb968103670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb9677fe700 1 -- 172.21.15.70:0/1780402383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb968101a10 msgr2=0x7fb968102bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb9677fe700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb968101a10 0x7fb968102bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb9677fe700 1 -- 172.21.15.70:0/1780402383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9681094b0 msgr2=0x7fb968103670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb9677fe700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9681094b0 0x7fb968103670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb9677fe700 1 -- 172.21.15.70:0/1780402383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9681a8110 con 0x7fb9681023b0 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.189+0000 7fb9677fe700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9681023b0 0x7fb968103130 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c920 tx=0x7fb95c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.190+0000 7fb9657fa700 1 -- 172.21.15.70:0/1780402383 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c007b00 con 0x7fb9681023b0 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.190+0000 7fb96ea1b700 1 -- 172.21.15.70:0/1780402383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9681a8400 con 0x7fb9681023b0 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.190+0000 7fb9657fa700 1 -- 172.21.15.70:0/1780402383 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb95c004d00 con 0x7fb9681023b0 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.190+0000 7fb9657fa700 1 -- 172.21.15.70:0/1780402383 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c005560 con 0x7fb9681023b0 2024-04-26T20:26:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.190+0000 7fb96ea1b700 1 -- 172.21.15.70:0/1780402383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9681a8990 con 0x7fb9681023b0 2024-04-26T20:26:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.191+0000 7fb96ea1b700 1 -- 172.21.15.70:0/1780402383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb968104d30 con 0x7fb9681023b0 2024-04-26T20:26:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.192+0000 7fb9657fa700 1 -- 172.21.15.70:0/1780402383 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb95c004750 con 0x7fb9681023b0 2024-04-26T20:26:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.193+0000 7fb9657fa700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb9500a3cd0 0x7fb9500a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.193+0000 7fb967fff700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb9500a3cd0 0x7fb9500a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.193+0000 7fb9657fa700 1 -- 172.21.15.70:0/1780402383 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fb95c0d0530 con 0x7fb9681023b0 2024-04-26T20:26:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.193+0000 7fb967fff700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb9500a3cd0 0x7fb9500a6190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb958009a10 tx=0x7fb958009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.197+0000 7fb9657fa700 1 -- 172.21.15.70:0/1780402383 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb95c014030 con 0x7fb9681023b0 2024-04-26T20:26:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.409+0000 7fb96ea1b700 1 -- 172.21.15.70:0/1780402383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb96802e490 con 0x7fb9681023b0 2024-04-26T20:26:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.410+0000 7fb9657fa700 1 -- 172.21.15.70:0/1780402383 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb95c098020 con 0x7fb9681023b0 2024-04-26T20:26:30.631 INFO:teuthology.orchestra.run.smithi070.stdout:55834574928 2024-04-26T20:26:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 -- 172.21.15.70:0/1780402383 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb9500a3cd0 msgr2=0x7fb9500a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb9500a3cd0 0x7fb9500a6190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb958009a10 tx=0x7fb958009190 comp rx=0 tx=0).stop 2024-04-26T20:26:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 -- 172.21.15.70:0/1780402383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9681023b0 msgr2=0x7fb968103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9681023b0 0x7fb968103130 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c920 tx=0x7fb95c00cc30 comp rx=0 tx=0).stop 2024-04-26T20:26:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 -- 172.21.15.70:0/1780402383 shutdown_connections 2024-04-26T20:26:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb9500a3cd0 0x7fb9500a6190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9681094b0 0x7fb968103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb968101a10 0x7fb968102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 --2- 172.21.15.70:0/1780402383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9681023b0 0x7fb968103130 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 -- 172.21.15.70:0/1780402383 >> 172.21.15.70:0/1780402383 conn(0x7fb968078990 msgr2=0x7fb968106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 -- 172.21.15.70:0/1780402383 shutdown_connections 2024-04-26T20:26:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.412+0000 7fb96ea1b700 1 -- 172.21.15.70:0/1780402383 wait complete. 2024-04-26T20:26:30.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.508+0000 7f80cad57700 1 -- 172.21.15.70:0/956815944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f80c41a6950 con 0x7f80c4102ce0 2024-04-26T20:26:30.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.508+0000 7f80c1ffb700 1 -- 172.21.15.70:0/956815944 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f80b009c2e0 con 0x7f80c4102ce0 2024-04-26T20:26:30.633 INFO:teuthology.orchestra.run.smithi070.stdout:146028888129 2024-04-26T20:26:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.510+0000 7f80cad57700 1 -- 172.21.15.70:0/956815944 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80b40a3cd0 msgr2=0x7f80b40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.510+0000 7f80cad57700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80b40a3cd0 0x7f80b40a6190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f80c4100b70 tx=0x7f80b8005960 comp rx=0 tx=0).stop 2024-04-26T20:26:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.510+0000 7f80cad57700 1 -- 172.21.15.70:0/956815944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80c4102ce0 msgr2=0x7f80c419fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.510+0000 7f80cad57700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80c4102ce0 0x7f80c419fd90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f80b000d950 tx=0x7f80b000dc60 comp rx=0 tx=0).stop 2024-04-26T20:26:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.510+0000 7f80cad57700 1 -- 172.21.15.70:0/956815944 shutdown_connections 2024-04-26T20:26:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.510+0000 7f80cad57700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80b40a3cd0 0x7f80b40a6190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.510+0000 7f80cad57700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80c4108390 0x7f80c4199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.510+0000 7f80cad57700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80c4102320 0x7f80c419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.510+0000 7f80cad57700 1 --2- 172.21.15.70:0/956815944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80c4102ce0 0x7f80c419fd90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.510+0000 7f80cad57700 1 -- 172.21.15.70:0/956815944 >> 172.21.15.70:0/956815944 conn(0x7f80c40792d0 msgr2=0x7f80c41016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:30.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.511+0000 7f80cad57700 1 -- 172.21.15.70:0/956815944 shutdown_connections 2024-04-26T20:26:30.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:30.511+0000 7f80cad57700 1 -- 172.21.15.70:0/956815944 wait complete. 2024-04-26T20:26:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:30 smithi098 ceph-mon[32591]: pgmap v329: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:26:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:30 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1780402383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T20:26:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:30 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/956815944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T20:26:31.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:30 smithi080 ceph-mon[32278]: pgmap v329: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:26:31.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:30 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1780402383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T20:26:31.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:30 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/956815944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T20:26:31.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:30 smithi070 ceph-mon[29124]: pgmap v329: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:26:31.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:30 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1780402383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T20:26:31.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:30 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/956815944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T20:26:31.325 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888125 got 146028888129 for osd.4 2024-04-26T20:26:31.326 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:32.047 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574923 got 55834574928 for osd.1 2024-04-26T20:26:32.047 DEBUG:teuthology.parallel:result is None 2024-04-26T20:26:32.048 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T20:26:32.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T20:26:32.531 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:32.998 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:32 smithi070 ceph-mon[29124]: pgmap v330: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-26T20:26:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:32 smithi098 ceph-mon[32591]: pgmap v330: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-26T20:26:33.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:32 smithi080 ceph-mon[32278]: pgmap v330: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-26T20:26:34.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.198+0000 7f651e78b700 1 -- 172.21.15.70:0/544977304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65181094a0 msgr2=0x7f6518109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:34.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.198+0000 7f651e78b700 1 --2- 172.21.15.70:0/544977304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65181094a0 0x7f6518109880 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6508009990 tx=0x7f6508009ca0 comp rx=0 tx=0).stop 2024-04-26T20:26:34.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.198+0000 7f651e78b700 1 -- 172.21.15.70:0/544977304 shutdown_connections 2024-04-26T20:26:34.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.198+0000 7f651e78b700 1 --2- 172.21.15.70:0/544977304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f651806c4f0 0x7f65181102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:34.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.198+0000 7f651e78b700 1 --2- 172.21.15.70:0/544977304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65181094a0 0x7f6518109880 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:34.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.198+0000 7f651e78b700 1 --2- 172.21.15.70:0/544977304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f651806bb50 0x7f651806bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:34.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.198+0000 7f651e78b700 1 -- 172.21.15.70:0/544977304 >> 172.21.15.70:0/544977304 conn(0x7f65180792d0 msgr2=0x7f65180796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:34.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.198+0000 7f651e78b700 1 -- 172.21.15.70:0/544977304 shutdown_connections 2024-04-26T20:26:34.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.198+0000 7f651e78b700 1 -- 172.21.15.70:0/544977304 wait complete. 2024-04-26T20:26:34.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.198+0000 7f651e78b700 1 Processor -- start 2024-04-26T20:26:34.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.198+0000 7f651e78b700 1 -- start start 2024-04-26T20:26:34.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f651e78b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f651806bb50 0x7f651819bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:34.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f651e78b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f651806c4f0 0x7f651819c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:34.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f651e78b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65181094a0 0x7f65181a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f651e78b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65181137d0 con 0x7f651806c4f0 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f651e78b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6518113650 con 0x7f65181094a0 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f651e78b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6518113950 con 0x7f651806bb50 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f65177fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f651806c4f0 0x7f651819c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f65177fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f651806c4f0 0x7f651819c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59088/0 (socket says 172.21.15.70:59088) 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f65177fe700 1 -- 172.21.15.70:0/1336368875 learned_addr learned my addr 172.21.15.70:0/1336368875 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f6517fff700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f651806bb50 0x7f651819bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f651cd28700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65181094a0 0x7f65181a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f65177fe700 1 -- 172.21.15.70:0/1336368875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f651806bb50 msgr2=0x7f651819bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f65177fe700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f651806bb50 0x7f651819bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f65177fe700 1 -- 172.21.15.70:0/1336368875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65181094a0 msgr2=0x7f65181a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f65177fe700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65181094a0 0x7f65181a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f65177fe700 1 -- 172.21.15.70:0/1336368875 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65181a0f30 con 0x7f651806c4f0 2024-04-26T20:26:34.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f651cd28700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65181094a0 0x7f65181a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:34.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f65177fe700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f651806c4f0 0x7f651819c460 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f650c00b530 tx=0x7f650c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:34.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f65157fa700 1 -- 172.21.15.70:0/1336368875 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c015020 con 0x7f651806c4f0 2024-04-26T20:26:34.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f651e78b700 1 -- 172.21.15.70:0/1336368875 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65181a1220 con 0x7f651806c4f0 2024-04-26T20:26:34.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.199+0000 7f65157fa700 1 -- 172.21.15.70:0/1336368875 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f650c011d00 con 0x7f651806c4f0 2024-04-26T20:26:34.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.200+0000 7f65157fa700 1 -- 172.21.15.70:0/1336368875 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c010e60 con 0x7f651806c4f0 2024-04-26T20:26:34.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.200+0000 7f651e78b700 1 -- 172.21.15.70:0/1336368875 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65181a8aa0 con 0x7f651806c4f0 2024-04-26T20:26:34.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.200+0000 7f651e78b700 1 -- 172.21.15.70:0/1336368875 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f651806a110 con 0x7f651806c4f0 2024-04-26T20:26:34.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.201+0000 7f65157fa700 1 -- 172.21.15.70:0/1336368875 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f650c018020 con 0x7f651806c4f0 2024-04-26T20:26:34.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.202+0000 7f65157fa700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65000a3cd0 0x7f65000a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:34.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.202+0000 7f6517fff700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65000a3cd0 0x7f65000a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:34.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.202+0000 7f65157fa700 1 -- 172.21.15.70:0/1336368875 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f650c0cfcb0 con 0x7f651806c4f0 2024-04-26T20:26:34.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.203+0000 7f6517fff700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65000a3cd0 0x7f65000a6190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6508009750 tx=0x7f650800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:34.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.207+0000 7f65157fa700 1 -- 172.21.15.70:0/1336368875 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f650c01f020 con 0x7f651806c4f0 2024-04-26T20:26:34.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.458+0000 7f651e78b700 1 -- 172.21.15.70:0/1336368875 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6518063860 con 0x7f65000a3cd0 2024-04-26T20:26:34.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.465+0000 7f65157fa700 1 -- 172.21.15.70:0/1336368875 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259026 (secure 0 0 0) 0x7f6518063860 con 0x7f65000a3cd0 2024-04-26T20:26:34.470 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:26:34.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.469+0000 7f651e78b700 1 -- 172.21.15.70:0/1336368875 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65000a3cd0 msgr2=0x7f65000a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:34.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.469+0000 7f651e78b700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65000a3cd0 0x7f65000a6190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6508009750 tx=0x7f650800b540 comp rx=0 tx=0).stop 2024-04-26T20:26:34.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.469+0000 7f651e78b700 1 -- 172.21.15.70:0/1336368875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f651806c4f0 msgr2=0x7f651819c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:34.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.469+0000 7f651e78b700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f651806c4f0 0x7f651819c460 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f650c00b530 tx=0x7f650c00b8f0 comp rx=0 tx=0).stop 2024-04-26T20:26:34.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.470+0000 7f651e78b700 1 -- 172.21.15.70:0/1336368875 shutdown_connections 2024-04-26T20:26:34.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.470+0000 7f651e78b700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f65000a3cd0 0x7f65000a6190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:34.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.470+0000 7f651e78b700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65181094a0 0x7f65181a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:34.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.470+0000 7f651e78b700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f651806bb50 0x7f651819bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:34.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.470+0000 7f651e78b700 1 --2- 172.21.15.70:0/1336368875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f651806c4f0 0x7f651819c460 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:34.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.470+0000 7f651e78b700 1 -- 172.21.15.70:0/1336368875 >> 172.21.15.70:0/1336368875 conn(0x7f65180792d0 msgr2=0x7f651810e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:34.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.470+0000 7f651e78b700 1 -- 172.21.15.70:0/1336368875 shutdown_connections 2024-04-26T20:26:34.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:34.470+0000 7f651e78b700 1 -- 172.21.15.70:0/1336368875 wait complete. 2024-04-26T20:26:34.473 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-04-26T20:26:35.178 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:34 smithi070 ceph-mon[29124]: pgmap v331: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-26T20:26:35.178 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:35.178 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:34 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:35.207 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-04-26T20:26:33.796771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649200,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":863,"num_read_kb":545,"num_write":416,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1232242,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369280,"kb_used_data":11740,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572544,"statfs":{"total":1151940427776,"available":1151562285056,"internally_reserved":0,"allocated":12021760,"data_stored":7452924,"data_compressed":189643,"data_compressed_allocated":253952,"data_compressed_original":2031616,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003198"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795281+0000","last_change":"2024-04-26T20:25:15.898926+0000","last_active":"2024-04-26T20:26:08.795281+0000","last_peered":"2024-04-26T20:26:08.795281+0000","last_clean":"2024-04-26T20:26:08.795281+0000","last_became_active":"2024-04-26T20:25:15.897656+0000","last_became_peered":"2024-04-26T20:25:15.897656+0000","last_unstale":"2024-04-26T20:26:08.795281+0000","last_undegraded":"2024-04-26T20:26:08.795281+0000","last_fullsized":"2024-04-26T20:26:08.795281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:39.483318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796998+0000","last_change":"2024-04-26T20:25:15.891362+0000","last_active":"2024-04-26T20:26:08.796998+0000","last_peered":"2024-04-26T20:26:08.796998+0000","last_clean":"2024-04-26T20:26:08.796998+0000","last_became_active":"2024-04-26T20:25:15.891038+0000","last_became_peered":"2024-04-26T20:25:15.891038+0000","last_unstale":"2024-04-26T20:26:08.796998+0000","last_undegraded":"2024-04-26T20:26:08.796998+0000","last_fullsized":"2024-04-26T20:26:08.796998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:12.286584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796971+0000","last_change":"2024-04-26T20:25:15.896964+0000","last_active":"2024-04-26T20:26:08.796971+0000","last_peered":"2024-04-26T20:26:08.796971+0000","last_clean":"2024-04-26T20:26:08.796971+0000","last_became_active":"2024-04-26T20:25:15.896645+0000","last_became_peered":"2024-04-26T20:25:15.896645+0000","last_unstale":"2024-04-26T20:26:08.796971+0000","last_undegraded":"2024-04-26T20:26:08.796971+0000","last_fullsized":"2024-04-26T20:26:08.796971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:48.748913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.920904+0000","last_change":"2024-04-26T20:25:15.901504+0000","last_active":"2024-04-26T20:26:08.920904+0000","last_peered":"2024-04-26T20:26:08.920904+0000","last_clean":"2024-04-26T20:26:08.920904+0000","last_became_active":"2024-04-26T20:25:15.900563+0000","last_became_peered":"2024-04-26T20:25:15.900563+0000","last_unstale":"2024-04-26T20:26:08.920904+0000","last_undegraded":"2024-04-26T20:26:08.920904+0000","last_fullsized":"2024-04-26T20:26:08.920904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:58.102101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797412+0000","last_change":"2024-04-26T20:25:15.888692+0000","last_active":"2024-04-26T20:26:08.797412+0000","last_peered":"2024-04-26T20:26:08.797412+0000","last_clean":"2024-04-26T20:26:08.797412+0000","last_became_active":"2024-04-26T20:25:15.888344+0000","last_became_peered":"2024-04-26T20:25:15.888344+0000","last_unstale":"2024-04-26T20:26:08.797412+0000","last_undegraded":"2024-04-26T20:26:08.797412+0000","last_fullsized":"2024-04-26T20:26:08.797412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:53.206291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796067+0000","last_change":"2024-04-26T20:25:15.895663+0000","last_active":"2024-04-26T20:26:08.796067+0000","last_peered":"2024-04-26T20:26:08.796067+0000","last_clean":"2024-04-26T20:26:08.796067+0000","last_became_active":"2024-04-26T20:25:15.895353+0000","last_became_peered":"2024-04-26T20:25:15.895353+0000","last_unstale":"2024-04-26T20:26:08.796067+0000","last_undegraded":"2024-04-26T20:26:08.796067+0000","last_fullsized":"2024-04-26T20:26:08.796067+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:49.441973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.114435+0000","last_change":"2024-04-26T20:26:09.114435+0000","last_active":"2024-04-26T20:26:09.114435+0000","last_peered":"2024-04-26T20:26:09.114435+0000","last_clean":"2024-04-26T20:26:09.114435+0000","last_became_active":"2024-04-26T20:26:09.113972+0000","last_became_peered":"2024-04-26T20:26:09.113972+0000","last_unstale":"2024-04-26T20:26:09.114435+0000","last_undegraded":"2024-04-26T20:26:09.114435+0000","last_fullsized":"2024-04-26T20:26:09.114435+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:21.399136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.459906+0000","last_change":"2024-04-26T20:25:15.889342+0000","last_active":"2024-04-26T20:26:09.459906+0000","last_peered":"2024-04-26T20:26:09.459906+0000","last_clean":"2024-04-26T20:26:09.459906+0000","last_became_active":"2024-04-26T20:25:15.886829+0000","last_became_peered":"2024-04-26T20:25:15.886829+0000","last_unstale":"2024-04-26T20:26:09.459906+0000","last_undegraded":"2024-04-26T20:26:09.459906+0000","last_fullsized":"2024-04-26T20:26:09.459906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:35.350107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.799408+0000","last_change":"2024-04-26T20:25:15.893991+0000","last_active":"2024-04-26T20:26:08.799408+0000","last_peered":"2024-04-26T20:26:08.799408+0000","last_clean":"2024-04-26T20:26:08.799408+0000","last_became_active":"2024-04-26T20:25:15.893653+0000","last_became_peered":"2024-04-26T20:25:15.893653+0000","last_unstale":"2024-04-26T20:26:08.799408+0000","last_undegraded":"2024-04-26T20:26:08.799408+0000","last_fullsized":"2024-04-26T20:26:08.799408+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:46.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.802132+0000","last_change":"2024-04-26T20:26:08.802132+0000","last_active":"2024-04-26T20:26:08.802132+0000","last_peered":"2024-04-26T20:26:08.802132+0000","last_clean":"2024-04-26T20:26:08.802132+0000","last_became_active":"2024-04-26T20:26:08.801857+0000","last_became_peered":"2024-04-26T20:26:08.801857+0000","last_unstale":"2024-04-26T20:26:08.802132+0000","last_undegraded":"2024-04-26T20:26:08.802132+0000","last_fullsized":"2024-04-26T20:26:08.802132+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:58.621108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795876+0000","last_change":"2024-04-26T20:25:15.890189+0000","last_active":"2024-04-26T20:26:08.795876+0000","last_peered":"2024-04-26T20:26:08.795876+0000","last_clean":"2024-04-26T20:26:08.795876+0000","last_became_active":"2024-04-26T20:25:15.889695+0000","last_became_peered":"2024-04-26T20:25:15.889695+0000","last_unstale":"2024-04-26T20:26:08.795876+0000","last_undegraded":"2024-04-26T20:26:08.795876+0000","last_fullsized":"2024-04-26T20:26:08.795876+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:06.598687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.920824+0000","last_change":"2024-04-26T20:25:15.900906+0000","last_active":"2024-04-26T20:26:08.920824+0000","last_peered":"2024-04-26T20:26:08.920824+0000","last_clean":"2024-04-26T20:26:08.920824+0000","last_became_active":"2024-04-26T20:25:15.899689+0000","last_became_peered":"2024-04-26T20:25:15.899689+0000","last_unstale":"2024-04-26T20:26:08.920824+0000","last_undegraded":"2024-04-26T20:26:08.920824+0000","last_fullsized":"2024-04-26T20:26:08.920824+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:03.042267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113119+0000","last_change":"2024-04-26T20:25:15.887410+0000","last_active":"2024-04-26T20:26:09.113119+0000","last_peered":"2024-04-26T20:26:09.113119+0000","last_clean":"2024-04-26T20:26:09.113119+0000","last_became_active":"2024-04-26T20:25:15.887112+0000","last_became_peered":"2024-04-26T20:25:15.887112+0000","last_unstale":"2024-04-26T20:26:09.113119+0000","last_undegraded":"2024-04-26T20:26:09.113119+0000","last_fullsized":"2024-04-26T20:26:09.113119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:23.149512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796794+0000","last_change":"2024-04-26T20:25:15.891275+0000","last_active":"2024-04-26T20:26:08.796794+0000","last_peered":"2024-04-26T20:26:08.796794+0000","last_clean":"2024-04-26T20:26:08.796794+0000","last_became_active":"2024-04-26T20:25:15.890947+0000","last_became_peered":"2024-04-26T20:25:15.890947+0000","last_unstale":"2024-04-26T20:26:08.796794+0000","last_undegraded":"2024-04-26T20:26:08.796794+0000","last_fullsized":"2024-04-26T20:26:08.796794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:29.000821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796865+0000","last_change":"2024-04-26T20:25:15.900806+0000","last_active":"2024-04-26T20:26:08.796865+0000","last_peered":"2024-04-26T20:26:08.796865+0000","last_clean":"2024-04-26T20:26:08.796865+0000","last_became_active":"2024-04-26T20:25:15.900560+0000","last_became_peered":"2024-04-26T20:25:15.900560+0000","last_unstale":"2024-04-26T20:26:08.796865+0000","last_undegraded":"2024-04-26T20:26:08.796865+0000","last_fullsized":"2024-04-26T20:26:08.796865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:51:08.728607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798589+0000","last_change":"2024-04-26T20:25:15.890862+0000","last_active":"2024-04-26T20:26:08.798589+0000","last_peered":"2024-04-26T20:26:08.798589+0000","last_clean":"2024-04-26T20:26:08.798589+0000","last_became_active":"2024-04-26T20:25:15.890504+0000","last_became_peered":"2024-04-26T20:25:15.890504+0000","last_unstale":"2024-04-26T20:26:08.798589+0000","last_undegraded":"2024-04-26T20:26:08.798589+0000","last_fullsized":"2024-04-26T20:26:08.798589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:31.207826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795409+0000","last_change":"2024-04-26T20:25:15.902984+0000","last_active":"2024-04-26T20:26:08.795409+0000","last_peered":"2024-04-26T20:26:08.795409+0000","last_clean":"2024-04-26T20:26:08.795409+0000","last_became_active":"2024-04-26T20:25:15.902644+0000","last_became_peered":"2024-04-26T20:25:15.902644+0000","last_unstale":"2024-04-26T20:26:08.795409+0000","last_undegraded":"2024-04-26T20:26:08.795409+0000","last_fullsized":"2024-04-26T20:26:08.795409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:39.054035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.793940+0000","last_change":"2024-04-26T20:25:15.890139+0000","last_active":"2024-04-26T20:26:08.793940+0000","last_peered":"2024-04-26T20:26:08.793940+0000","last_clean":"2024-04-26T20:26:08.793940+0000","last_became_active":"2024-04-26T20:25:15.889800+0000","last_became_peered":"2024-04-26T20:25:15.889800+0000","last_unstale":"2024-04-26T20:26:08.793940+0000","last_undegraded":"2024-04-26T20:26:08.793940+0000","last_fullsized":"2024-04-26T20:26:08.793940+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:14.886217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798696+0000","last_change":"2024-04-26T20:25:15.885580+0000","last_active":"2024-04-26T20:26:08.798696+0000","last_peered":"2024-04-26T20:26:08.798696+0000","last_clean":"2024-04-26T20:26:08.798696+0000","last_became_active":"2024-04-26T20:25:15.884518+0000","last_became_peered":"2024-04-26T20:25:15.884518+0000","last_unstale":"2024-04-26T20:26:08.798696+0000","last_undegraded":"2024-04-26T20:26:08.798696+0000","last_fullsized":"2024-04-26T20:26:08.798696+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:48:49.587462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:29.136549+0000","last_change":"2024-04-26T20:25:15.009552+0000","last_active":"2024-04-26T20:26:29.136549+0000","last_peered":"2024-04-26T20:26:29.136549+0000","last_clean":"2024-04-26T20:26:29.136549+0000","last_became_active":"2024-04-26T20:25:15.009176+0000","last_became_peered":"2024-04-26T20:25:15.009176+0000","last_unstale":"2024-04-26T20:26:29.136549+0000","last_undegraded":"2024-04-26T20:26:29.136549+0000","last_fullsized":"2024-04-26T20:26:29.136549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:20.740317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460163+0000","last_change":"2024-04-26T20:25:15.890270+0000","last_active":"2024-04-26T20:26:09.460163+0000","last_peered":"2024-04-26T20:26:09.460163+0000","last_clean":"2024-04-26T20:26:09.460163+0000","last_became_active":"2024-04-26T20:25:15.887668+0000","last_became_peered":"2024-04-26T20:25:15.887668+0000","last_unstale":"2024-04-26T20:26:09.460163+0000","last_undegraded":"2024-04-26T20:26:09.460163+0000","last_fullsized":"2024-04-26T20:26:09.460163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:51.531220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460468+0000","last_change":"2024-04-26T20:25:15.012133+0000","last_active":"2024-04-26T20:26:09.460468+0000","last_peered":"2024-04-26T20:26:09.460468+0000","last_clean":"2024-04-26T20:26:09.460468+0000","last_became_active":"2024-04-26T20:25:15.011820+0000","last_became_peered":"2024-04-26T20:25:15.011820+0000","last_unstale":"2024-04-26T20:26:09.460468+0000","last_undegraded":"2024-04-26T20:26:09.460468+0000","last_fullsized":"2024-04-26T20:26:09.460468+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:36.634590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797100+0000","last_change":"2024-04-26T20:25:15.893941+0000","last_active":"2024-04-26T20:26:08.797100+0000","last_peered":"2024-04-26T20:26:08.797100+0000","last_clean":"2024-04-26T20:26:08.797100+0000","last_became_active":"2024-04-26T20:25:15.893616+0000","last_became_peered":"2024-04-26T20:25:15.893616+0000","last_unstale":"2024-04-26T20:26:08.797100+0000","last_undegraded":"2024-04-26T20:26:08.797100+0000","last_fullsized":"2024-04-26T20:26:08.797100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:57.893700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798230+0000","last_change":"2024-04-26T20:25:15.011497+0000","last_active":"2024-04-26T20:26:08.798230+0000","last_peered":"2024-04-26T20:26:08.798230+0000","last_clean":"2024-04-26T20:26:08.798230+0000","last_became_active":"2024-04-26T20:25:15.011122+0000","last_became_peered":"2024-04-26T20:25:15.011122+0000","last_unstale":"2024-04-26T20:26:08.798230+0000","last_undegraded":"2024-04-26T20:26:08.798230+0000","last_fullsized":"2024-04-26T20:26:08.798230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:01.130321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798768+0000","last_change":"2024-04-26T20:25:15.892041+0000","last_active":"2024-04-26T20:26:08.798768+0000","last_peered":"2024-04-26T20:26:08.798768+0000","last_clean":"2024-04-26T20:26:08.798768+0000","last_became_active":"2024-04-26T20:25:15.891648+0000","last_became_peered":"2024-04-26T20:25:15.891648+0000","last_unstale":"2024-04-26T20:26:08.798768+0000","last_undegraded":"2024-04-26T20:26:08.798768+0000","last_fullsized":"2024-04-26T20:26:08.798768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:05.729057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797614+0000","last_change":"2024-04-26T20:25:15.005211+0000","last_active":"2024-04-26T20:26:08.797614+0000","last_peered":"2024-04-26T20:26:08.797614+0000","last_clean":"2024-04-26T20:26:08.797614+0000","last_became_active":"2024-04-26T20:25:15.004879+0000","last_became_peered":"2024-04-26T20:25:15.004879+0000","last_unstale":"2024-04-26T20:26:08.797614+0000","last_undegraded":"2024-04-26T20:26:08.797614+0000","last_fullsized":"2024-04-26T20:26:08.797614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:01.865953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.801118+0000","last_change":"2024-04-26T20:25:15.895878+0000","last_active":"2024-04-26T20:26:08.801118+0000","last_peered":"2024-04-26T20:26:08.801118+0000","last_clean":"2024-04-26T20:26:08.801118+0000","last_became_active":"2024-04-26T20:25:15.895491+0000","last_became_peered":"2024-04-26T20:25:15.895491+0000","last_unstale":"2024-04-26T20:26:08.801118+0000","last_undegraded":"2024-04-26T20:26:08.801118+0000","last_fullsized":"2024-04-26T20:26:08.801118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:41.370320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.140851+0000","last_change":"2024-04-26T20:25:15.013186+0000","last_active":"2024-04-26T20:26:31.140851+0000","last_peered":"2024-04-26T20:26:31.140851+0000","last_clean":"2024-04-26T20:26:31.140851+0000","last_became_active":"2024-04-26T20:25:15.012856+0000","last_became_peered":"2024-04-26T20:25:15.012856+0000","last_unstale":"2024-04-26T20:26:31.140851+0000","last_undegraded":"2024-04-26T20:26:31.140851+0000","last_fullsized":"2024-04-26T20:26:31.140851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:46.978954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797969+0000","last_change":"2024-04-26T20:25:15.896234+0000","last_active":"2024-04-26T20:26:08.797969+0000","last_peered":"2024-04-26T20:26:08.797969+0000","last_clean":"2024-04-26T20:26:08.797969+0000","last_became_active":"2024-04-26T20:25:15.895661+0000","last_became_peered":"2024-04-26T20:25:15.895661+0000","last_unstale":"2024-04-26T20:26:08.797969+0000","last_undegraded":"2024-04-26T20:26:08.797969+0000","last_fullsized":"2024-04-26T20:26:08.797969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:44.716677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795948+0000","last_change":"2024-04-26T20:25:15.004635+0000","last_active":"2024-04-26T20:26:08.795948+0000","last_peered":"2024-04-26T20:26:08.795948+0000","last_clean":"2024-04-26T20:26:08.795948+0000","last_became_active":"2024-04-26T20:25:15.004099+0000","last_became_peered":"2024-04-26T20:25:15.004099+0000","last_unstale":"2024-04-26T20:26:08.795948+0000","last_undegraded":"2024-04-26T20:26:08.795948+0000","last_fullsized":"2024-04-26T20:26:08.795948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:28.770212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800723+0000","last_change":"2024-04-26T20:25:15.898180+0000","last_active":"2024-04-26T20:26:08.800723+0000","last_peered":"2024-04-26T20:26:08.800723+0000","last_clean":"2024-04-26T20:26:08.800723+0000","last_became_active":"2024-04-26T20:25:15.897631+0000","last_became_peered":"2024-04-26T20:25:15.897631+0000","last_unstale":"2024-04-26T20:26:08.800723+0000","last_undegraded":"2024-04-26T20:26:08.800723+0000","last_fullsized":"2024-04-26T20:26:08.800723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:17.936321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113273+0000","last_change":"2024-04-26T20:25:15.003966+0000","last_active":"2024-04-26T20:26:09.113273+0000","last_peered":"2024-04-26T20:26:09.113273+0000","last_clean":"2024-04-26T20:26:09.113273+0000","last_became_active":"2024-04-26T20:25:15.003611+0000","last_became_peered":"2024-04-26T20:25:15.003611+0000","last_unstale":"2024-04-26T20:26:09.113273+0000","last_undegraded":"2024-04-26T20:26:09.113273+0000","last_fullsized":"2024-04-26T20:26:09.113273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:46.494480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.459966+0000","last_change":"2024-04-26T20:25:15.892263+0000","last_active":"2024-04-26T20:26:09.459966+0000","last_peered":"2024-04-26T20:26:09.459966+0000","last_clean":"2024-04-26T20:26:09.459966+0000","last_became_active":"2024-04-26T20:25:15.891912+0000","last_became_peered":"2024-04-26T20:25:15.891912+0000","last_unstale":"2024-04-26T20:26:09.459966+0000","last_undegraded":"2024-04-26T20:26:09.459966+0000","last_fullsized":"2024-04-26T20:26:09.459966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:08.956838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800731+0000","last_change":"2024-04-26T20:25:15.007227+0000","last_active":"2024-04-26T20:26:08.800731+0000","last_peered":"2024-04-26T20:26:08.800731+0000","last_clean":"2024-04-26T20:26:08.800731+0000","last_became_active":"2024-04-26T20:25:15.006901+0000","last_became_peered":"2024-04-26T20:25:15.006901+0000","last_unstale":"2024-04-26T20:26:08.800731+0000","last_undegraded":"2024-04-26T20:26:08.800731+0000","last_fullsized":"2024-04-26T20:26:08.800731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:55.391429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.793619+0000","last_change":"2024-04-26T20:25:15.887979+0000","last_active":"2024-04-26T20:26:08.793619+0000","last_peered":"2024-04-26T20:26:08.793619+0000","last_clean":"2024-04-26T20:26:08.793619+0000","last_became_active":"2024-04-26T20:25:15.887302+0000","last_became_peered":"2024-04-26T20:25:15.887302+0000","last_unstale":"2024-04-26T20:26:08.793619+0000","last_undegraded":"2024-04-26T20:26:08.793619+0000","last_fullsized":"2024-04-26T20:26:08.793619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:41:08.662082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":163,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.140095+0000","last_change":"2024-04-26T20:25:15.005718+0000","last_active":"2024-04-26T20:26:31.140095+0000","last_peered":"2024-04-26T20:26:31.140095+0000","last_clean":"2024-04-26T20:26:31.140095+0000","last_became_active":"2024-04-26T20:25:15.005397+0000","last_became_peered":"2024-04-26T20:25:15.005397+0000","last_unstale":"2024-04-26T20:26:31.140095+0000","last_undegraded":"2024-04-26T20:26:31.140095+0000","last_fullsized":"2024-04-26T20:26:31.140095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:02.398788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.799432+0000","last_change":"2024-04-26T20:25:15.893214+0000","last_active":"2024-04-26T20:26:08.799432+0000","last_peered":"2024-04-26T20:26:08.799432+0000","last_clean":"2024-04-26T20:26:08.799432+0000","last_became_active":"2024-04-26T20:25:15.892615+0000","last_became_peered":"2024-04-26T20:25:15.892615+0000","last_unstale":"2024-04-26T20:26:08.799432+0000","last_undegraded":"2024-04-26T20:26:08.799432+0000","last_fullsized":"2024-04-26T20:26:08.799432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:51.940520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.930524+0000","last_change":"2024-04-26T20:26:08.930524+0000","last_active":"2024-04-26T20:26:08.930524+0000","last_peered":"2024-04-26T20:26:08.930524+0000","last_clean":"2024-04-26T20:26:08.930524+0000","last_became_active":"2024-04-26T20:26:08.921269+0000","last_became_peered":"2024-04-26T20:26:08.921269+0000","last_unstale":"2024-04-26T20:26:08.930524+0000","last_undegraded":"2024-04-26T20:26:08.930524+0000","last_fullsized":"2024-04-26T20:26:08.930524+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:01.322278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,4],"acting":[11,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797030+0000","last_change":"2024-04-26T20:25:15.900729+0000","last_active":"2024-04-26T20:26:08.797030+0000","last_peered":"2024-04-26T20:26:08.797030+0000","last_clean":"2024-04-26T20:26:08.797030+0000","last_became_active":"2024-04-26T20:25:15.900427+0000","last_became_peered":"2024-04-26T20:25:15.900427+0000","last_unstale":"2024-04-26T20:26:08.797030+0000","last_undegraded":"2024-04-26T20:26:08.797030+0000","last_fullsized":"2024-04-26T20:26:08.797030+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:02.321351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.801238+0000","last_change":"2024-04-26T20:25:15.012186+0000","last_active":"2024-04-26T20:26:08.801238+0000","last_peered":"2024-04-26T20:26:08.801238+0000","last_clean":"2024-04-26T20:26:08.801238+0000","last_became_active":"2024-04-26T20:25:15.011853+0000","last_became_peered":"2024-04-26T20:25:15.011853+0000","last_unstale":"2024-04-26T20:26:08.801238+0000","last_undegraded":"2024-04-26T20:26:08.801238+0000","last_fullsized":"2024-04-26T20:26:08.801238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:33.893616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.799207+0000","last_change":"2024-04-26T20:25:15.900656+0000","last_active":"2024-04-26T20:26:08.799207+0000","last_peered":"2024-04-26T20:26:08.799207+0000","last_clean":"2024-04-26T20:26:08.799207+0000","last_became_active":"2024-04-26T20:25:15.899663+0000","last_became_peered":"2024-04-26T20:25:15.899663+0000","last_unstale":"2024-04-26T20:26:08.799207+0000","last_undegraded":"2024-04-26T20:26:08.799207+0000","last_fullsized":"2024-04-26T20:26:08.799207+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:40.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'28","reported_seq":211,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.146020+0000","last_change":"2024-04-26T20:26:09.122542+0000","last_active":"2024-04-26T20:26:31.146020+0000","last_peered":"2024-04-26T20:26:31.146020+0000","last_clean":"2024-04-26T20:26:31.146020+0000","last_became_active":"2024-04-26T20:26:09.114509+0000","last_became_peered":"2024-04-26T20:26:09.114509+0000","last_unstale":"2024-04-26T20:26:31.146020+0000","last_undegraded":"2024-04-26T20:26:31.146020+0000","last_fullsized":"2024-04-26T20:26:31.146020+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:28.714495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51394,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":117,"num_write":30,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":51394,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797260+0000","last_change":"2024-04-26T20:25:15.892134+0000","last_active":"2024-04-26T20:26:08.797260+0000","last_peered":"2024-04-26T20:26:08.797260+0000","last_clean":"2024-04-26T20:26:08.797260+0000","last_became_active":"2024-04-26T20:25:15.890965+0000","last_became_peered":"2024-04-26T20:25:15.890965+0000","last_unstale":"2024-04-26T20:26:08.797260+0000","last_undegraded":"2024-04-26T20:26:08.797260+0000","last_fullsized":"2024-04-26T20:26:08.797260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:11.834642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798561+0000","last_change":"2024-04-26T20:25:15.006020+0000","last_active":"2024-04-26T20:26:08.798561+0000","last_peered":"2024-04-26T20:26:08.798561+0000","last_clean":"2024-04-26T20:26:08.798561+0000","last_became_active":"2024-04-26T20:25:15.005579+0000","last_became_peered":"2024-04-26T20:25:15.005579+0000","last_unstale":"2024-04-26T20:26:08.798561+0000","last_undegraded":"2024-04-26T20:26:08.798561+0000","last_fullsized":"2024-04-26T20:26:08.798561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:51.777497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113007+0000","last_change":"2024-04-26T20:25:15.888561+0000","last_active":"2024-04-26T20:26:09.113007+0000","last_peered":"2024-04-26T20:26:09.113007+0000","last_clean":"2024-04-26T20:26:09.113007+0000","last_became_active":"2024-04-26T20:25:15.888249+0000","last_became_peered":"2024-04-26T20:25:15.888249+0000","last_unstale":"2024-04-26T20:26:09.113007+0000","last_undegraded":"2024-04-26T20:26:09.113007+0000","last_fullsized":"2024-04-26T20:26:09.113007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:29.352406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800370+0000","last_change":"2024-04-26T20:25:15.010139+0000","last_active":"2024-04-26T20:26:08.800370+0000","last_peered":"2024-04-26T20:26:08.800370+0000","last_clean":"2024-04-26T20:26:08.800370+0000","last_became_active":"2024-04-26T20:25:15.009826+0000","last_became_peered":"2024-04-26T20:25:15.009826+0000","last_unstale":"2024-04-26T20:26:08.800370+0000","last_undegraded":"2024-04-26T20:26:08.800370+0000","last_fullsized":"2024-04-26T20:26:08.800370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:31.801205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.114035+0000","last_change":"2024-04-26T20:26:09.114035+0000","last_active":"2024-04-26T20:26:09.114035+0000","last_peered":"2024-04-26T20:26:09.114035+0000","last_clean":"2024-04-26T20:26:09.114035+0000","last_became_active":"2024-04-26T20:26:09.113615+0000","last_became_peered":"2024-04-26T20:26:09.113615+0000","last_unstale":"2024-04-26T20:26:09.114035+0000","last_undegraded":"2024-04-26T20:26:09.114035+0000","last_fullsized":"2024-04-26T20:26:09.114035+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:10.623770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.139856+0000","last_change":"2024-04-26T20:25:15.009046+0000","last_active":"2024-04-26T20:26:31.139856+0000","last_peered":"2024-04-26T20:26:31.139856+0000","last_clean":"2024-04-26T20:26:31.139856+0000","last_became_active":"2024-04-26T20:25:15.006321+0000","last_became_peered":"2024-04-26T20:25:15.006321+0000","last_unstale":"2024-04-26T20:26:31.139856+0000","last_undegraded":"2024-04-26T20:26:31.139856+0000","last_fullsized":"2024-04-26T20:26:31.139856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:30.993709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795431+0000","last_change":"2024-04-26T20:25:15.896722+0000","last_active":"2024-04-26T20:26:08.795431+0000","last_peered":"2024-04-26T20:26:08.795431+0000","last_clean":"2024-04-26T20:26:08.795431+0000","last_became_active":"2024-04-26T20:25:15.896377+0000","last_became_peered":"2024-04-26T20:25:15.896377+0000","last_unstale":"2024-04-26T20:26:08.795431+0000","last_undegraded":"2024-04-26T20:26:08.795431+0000","last_fullsized":"2024-04-26T20:26:08.795431+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:39.899679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797035+0000","last_change":"2024-04-26T20:25:15.016262+0000","last_active":"2024-04-26T20:26:08.797035+0000","last_peered":"2024-04-26T20:26:08.797035+0000","last_clean":"2024-04-26T20:26:08.797035+0000","last_became_active":"2024-04-26T20:25:15.015744+0000","last_became_peered":"2024-04-26T20:25:15.015744+0000","last_unstale":"2024-04-26T20:26:08.797035+0000","last_undegraded":"2024-04-26T20:26:08.797035+0000","last_fullsized":"2024-04-26T20:26:08.797035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:50.231250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800533+0000","last_change":"2024-04-26T20:25:15.894702+0000","last_active":"2024-04-26T20:26:08.800533+0000","last_peered":"2024-04-26T20:26:08.800533+0000","last_clean":"2024-04-26T20:26:08.800533+0000","last_became_active":"2024-04-26T20:25:15.894338+0000","last_became_peered":"2024-04-26T20:25:15.894338+0000","last_unstale":"2024-04-26T20:26:08.800533+0000","last_undegraded":"2024-04-26T20:26:08.800533+0000","last_fullsized":"2024-04-26T20:26:08.800533+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:01.515041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797878+0000","last_change":"2024-04-26T20:25:15.011207+0000","last_active":"2024-04-26T20:26:08.797878+0000","last_peered":"2024-04-26T20:26:08.797878+0000","last_clean":"2024-04-26T20:26:08.797878+0000","last_became_active":"2024-04-26T20:25:15.010733+0000","last_became_peered":"2024-04-26T20:25:15.010733+0000","last_unstale":"2024-04-26T20:26:08.797878+0000","last_undegraded":"2024-04-26T20:26:08.797878+0000","last_fullsized":"2024-04-26T20:26:08.797878+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:35.584041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795183+0000","last_change":"2024-04-26T20:25:15.896061+0000","last_active":"2024-04-26T20:26:08.795183+0000","last_peered":"2024-04-26T20:26:08.795183+0000","last_clean":"2024-04-26T20:26:08.795183+0000","last_became_active":"2024-04-26T20:25:15.895712+0000","last_became_peered":"2024-04-26T20:25:15.895712+0000","last_unstale":"2024-04-26T20:26:08.795183+0000","last_undegraded":"2024-04-26T20:26:08.795183+0000","last_fullsized":"2024-04-26T20:26:08.795183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.663831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.793771+0000","last_change":"2024-04-26T20:25:15.010300+0000","last_active":"2024-04-26T20:26:08.793771+0000","last_peered":"2024-04-26T20:26:08.793771+0000","last_clean":"2024-04-26T20:26:08.793771+0000","last_became_active":"2024-04-26T20:25:15.009999+0000","last_became_peered":"2024-04-26T20:25:15.009999+0000","last_unstale":"2024-04-26T20:26:08.793771+0000","last_undegraded":"2024-04-26T20:26:08.793771+0000","last_fullsized":"2024-04-26T20:26:08.793771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:07.394664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797365+0000","last_change":"2024-04-26T20:25:15.888356+0000","last_active":"2024-04-26T20:26:08.797365+0000","last_peered":"2024-04-26T20:26:08.797365+0000","last_clean":"2024-04-26T20:26:08.797365+0000","last_became_active":"2024-04-26T20:25:15.888056+0000","last_became_peered":"2024-04-26T20:25:15.888056+0000","last_unstale":"2024-04-26T20:26:08.797365+0000","last_undegraded":"2024-04-26T20:26:08.797365+0000","last_fullsized":"2024-04-26T20:26:08.797365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:49:22.697718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.139647+0000","last_change":"2024-04-26T20:25:15.008552+0000","last_active":"2024-04-26T20:26:31.139647+0000","last_peered":"2024-04-26T20:26:31.139647+0000","last_clean":"2024-04-26T20:26:31.139647+0000","last_became_active":"2024-04-26T20:25:15.008217+0000","last_became_peered":"2024-04-26T20:25:15.008217+0000","last_unstale":"2024-04-26T20:26:31.139647+0000","last_undegraded":"2024-04-26T20:26:31.139647+0000","last_fullsized":"2024-04-26T20:26:31.139647+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:23.803674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796128+0000","last_change":"2024-04-26T20:25:15.896655+0000","last_active":"2024-04-26T20:26:08.796128+0000","last_peered":"2024-04-26T20:26:08.796128+0000","last_clean":"2024-04-26T20:26:08.796128+0000","last_became_active":"2024-04-26T20:25:15.896335+0000","last_became_peered":"2024-04-26T20:25:15.896335+0000","last_unstale":"2024-04-26T20:26:08.796128+0000","last_undegraded":"2024-04-26T20:26:08.796128+0000","last_fullsized":"2024-04-26T20:26:08.796128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:38.168159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.803267+0000","last_change":"2024-04-26T20:26:08.803267+0000","last_active":"2024-04-26T20:26:08.803267+0000","last_peered":"2024-04-26T20:26:08.803267+0000","last_clean":"2024-04-26T20:26:08.803267+0000","last_became_active":"2024-04-26T20:26:08.802845+0000","last_became_peered":"2024-04-26T20:26:08.802845+0000","last_unstale":"2024-04-26T20:26:08.803267+0000","last_undegraded":"2024-04-26T20:26:08.803267+0000","last_fullsized":"2024-04-26T20:26:08.803267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:23.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.139284+0000","last_change":"2024-04-26T20:25:15.012015+0000","last_active":"2024-04-26T20:26:31.139284+0000","last_peered":"2024-04-26T20:26:31.139284+0000","last_clean":"2024-04-26T20:26:31.139284+0000","last_became_active":"2024-04-26T20:25:15.011705+0000","last_became_peered":"2024-04-26T20:25:15.011705+0000","last_unstale":"2024-04-26T20:26:31.139284+0000","last_undegraded":"2024-04-26T20:26:31.139284+0000","last_fullsized":"2024-04-26T20:26:31.139284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:10.213375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460156+0000","last_change":"2024-04-26T20:25:15.885294+0000","last_active":"2024-04-26T20:26:09.460156+0000","last_peered":"2024-04-26T20:26:09.460156+0000","last_clean":"2024-04-26T20:26:09.460156+0000","last_became_active":"2024-04-26T20:25:15.884963+0000","last_became_peered":"2024-04-26T20:25:15.884963+0000","last_unstale":"2024-04-26T20:26:09.460156+0000","last_undegraded":"2024-04-26T20:26:09.460156+0000","last_fullsized":"2024-04-26T20:26:09.460156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:21:29.222616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.920418+0000","last_change":"2024-04-26T20:25:15.006101+0000","last_active":"2024-04-26T20:26:08.920418+0000","last_peered":"2024-04-26T20:26:08.920418+0000","last_clean":"2024-04-26T20:26:08.920418+0000","last_became_active":"2024-04-26T20:25:15.005566+0000","last_became_peered":"2024-04-26T20:25:15.005566+0000","last_unstale":"2024-04-26T20:26:08.920418+0000","last_undegraded":"2024-04-26T20:26:08.920418+0000","last_fullsized":"2024-04-26T20:26:08.920418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:15.392418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796224+0000","last_change":"2024-04-26T20:23:58.975689+0000","last_active":"2024-04-26T20:26:08.796224+0000","last_peered":"2024-04-26T20:26:08.796224+0000","last_clean":"2024-04-26T20:26:08.796224+0000","last_became_active":"2024-04-26T20:23:58.975250+0000","last_became_peered":"2024-04-26T20:23:58.975250+0000","last_unstale":"2024-04-26T20:26:08.796224+0000","last_undegraded":"2024-04-26T20:26:08.796224+0000","last_fullsized":"2024-04-26T20:26:08.796224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:20:34.477920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:20:34.477920+0000","last_clean_scrub_stamp":"2024-04-26T20:20:34.477920+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:51.870155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113103+0000","last_change":"2024-04-26T20:25:15.895244+0000","last_active":"2024-04-26T20:26:09.113103+0000","last_peered":"2024-04-26T20:26:09.113103+0000","last_clean":"2024-04-26T20:26:09.113103+0000","last_became_active":"2024-04-26T20:25:15.894943+0000","last_became_peered":"2024-04-26T20:25:15.894943+0000","last_unstale":"2024-04-26T20:26:09.113103+0000","last_undegraded":"2024-04-26T20:26:09.113103+0000","last_fullsized":"2024-04-26T20:26:09.113103+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:03.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.924777+0000","last_change":"2024-04-26T20:26:08.924777+0000","last_active":"2024-04-26T20:26:08.924777+0000","last_peered":"2024-04-26T20:26:08.924777+0000","last_clean":"2024-04-26T20:26:08.924777+0000","last_became_active":"2024-04-26T20:26:08.921514+0000","last_became_peered":"2024-04-26T20:26:08.921514+0000","last_unstale":"2024-04-26T20:26:08.924777+0000","last_undegraded":"2024-04-26T20:26:08.924777+0000","last_fullsized":"2024-04-26T20:26:08.924777+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:02.422556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.805964+0000","last_change":"2024-04-26T20:26:08.805964+0000","last_active":"2024-04-26T20:26:08.805964+0000","last_peered":"2024-04-26T20:26:08.805964+0000","last_clean":"2024-04-26T20:26:08.805964+0000","last_became_active":"2024-04-26T20:26:08.798606+0000","last_became_peered":"2024-04-26T20:26:08.798606+0000","last_unstale":"2024-04-26T20:26:08.805964+0000","last_undegraded":"2024-04-26T20:26:08.805964+0000","last_fullsized":"2024-04-26T20:26:08.805964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:26:56.047752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113630+0000","last_change":"2024-04-26T20:25:15.881988+0000","last_active":"2024-04-26T20:26:09.113630+0000","last_peered":"2024-04-26T20:26:09.113630+0000","last_clean":"2024-04-26T20:26:09.113630+0000","last_became_active":"2024-04-26T20:25:15.881615+0000","last_became_peered":"2024-04-26T20:25:15.881615+0000","last_unstale":"2024-04-26T20:26:09.113630+0000","last_undegraded":"2024-04-26T20:26:09.113630+0000","last_fullsized":"2024-04-26T20:26:09.113630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:24.511442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.793917+0000","last_change":"2024-04-26T20:25:15.005468+0000","last_active":"2024-04-26T20:26:08.793917+0000","last_peered":"2024-04-26T20:26:08.793917+0000","last_clean":"2024-04-26T20:26:08.793917+0000","last_became_active":"2024-04-26T20:25:15.005164+0000","last_became_peered":"2024-04-26T20:25:15.005164+0000","last_unstale":"2024-04-26T20:26:08.793917+0000","last_undegraded":"2024-04-26T20:26:08.793917+0000","last_fullsized":"2024-04-26T20:26:08.793917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:58.964128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460524+0000","last_change":"2024-04-26T20:25:15.893298+0000","last_active":"2024-04-26T20:26:09.460524+0000","last_peered":"2024-04-26T20:26:09.460524+0000","last_clean":"2024-04-26T20:26:09.460524+0000","last_became_active":"2024-04-26T20:25:15.892981+0000","last_became_peered":"2024-04-26T20:25:15.892981+0000","last_unstale":"2024-04-26T20:26:09.460524+0000","last_undegraded":"2024-04-26T20:26:09.460524+0000","last_fullsized":"2024-04-26T20:26:09.460524+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:09.916807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.921008+0000","last_change":"2024-04-26T20:25:15.007962+0000","last_active":"2024-04-26T20:26:08.921008+0000","last_peered":"2024-04-26T20:26:08.921008+0000","last_clean":"2024-04-26T20:26:08.921008+0000","last_became_active":"2024-04-26T20:25:15.007592+0000","last_became_peered":"2024-04-26T20:25:15.007592+0000","last_unstale":"2024-04-26T20:26:08.921008+0000","last_undegraded":"2024-04-26T20:26:08.921008+0000","last_fullsized":"2024-04-26T20:26:08.921008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:26.364350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797175+0000","last_change":"2024-04-26T20:25:15.895272+0000","last_active":"2024-04-26T20:26:08.797175+0000","last_peered":"2024-04-26T20:26:08.797175+0000","last_clean":"2024-04-26T20:26:08.797175+0000","last_became_active":"2024-04-26T20:25:15.894962+0000","last_became_peered":"2024-04-26T20:25:15.894962+0000","last_unstale":"2024-04-26T20:26:08.797175+0000","last_undegraded":"2024-04-26T20:26:08.797175+0000","last_fullsized":"2024-04-26T20:26:08.797175+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:13.714365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798660+0000","last_change":"2024-04-26T20:25:15.014580+0000","last_active":"2024-04-26T20:26:08.798660+0000","last_peered":"2024-04-26T20:26:08.798660+0000","last_clean":"2024-04-26T20:26:08.798660+0000","last_became_active":"2024-04-26T20:25:15.014320+0000","last_became_peered":"2024-04-26T20:25:15.014320+0000","last_unstale":"2024-04-26T20:26:08.798660+0000","last_undegraded":"2024-04-26T20:26:08.798660+0000","last_fullsized":"2024-04-26T20:26:08.798660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:43.689597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797835+0000","last_change":"2024-04-26T20:25:15.891833+0000","last_active":"2024-04-26T20:26:08.797835+0000","last_peered":"2024-04-26T20:26:08.797835+0000","last_clean":"2024-04-26T20:26:08.797835+0000","last_became_active":"2024-04-26T20:25:15.891514+0000","last_became_peered":"2024-04-26T20:25:15.891514+0000","last_unstale":"2024-04-26T20:26:08.797835+0000","last_undegraded":"2024-04-26T20:26:08.797835+0000","last_fullsized":"2024-04-26T20:26:08.797835+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:16.673434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460037+0000","last_change":"2024-04-26T20:25:15.006756+0000","last_active":"2024-04-26T20:26:09.460037+0000","last_peered":"2024-04-26T20:26:09.460037+0000","last_clean":"2024-04-26T20:26:09.460037+0000","last_became_active":"2024-04-26T20:25:15.006297+0000","last_became_peered":"2024-04-26T20:25:15.006297+0000","last_unstale":"2024-04-26T20:26:09.460037+0000","last_undegraded":"2024-04-26T20:26:09.460037+0000","last_fullsized":"2024-04-26T20:26:09.460037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:28.797708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.794888+0000","last_change":"2024-04-26T20:25:15.891105+0000","last_active":"2024-04-26T20:26:08.794888+0000","last_peered":"2024-04-26T20:26:08.794888+0000","last_clean":"2024-04-26T20:26:08.794888+0000","last_became_active":"2024-04-26T20:25:15.890761+0000","last_became_peered":"2024-04-26T20:25:15.890761+0000","last_unstale":"2024-04-26T20:26:08.794888+0000","last_undegraded":"2024-04-26T20:26:08.794888+0000","last_fullsized":"2024-04-26T20:26:08.794888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:48.010351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797873+0000","last_change":"2024-04-26T20:25:15.009981+0000","last_active":"2024-04-26T20:26:08.797873+0000","last_peered":"2024-04-26T20:26:08.797873+0000","last_clean":"2024-04-26T20:26:08.797873+0000","last_became_active":"2024-04-26T20:25:15.009662+0000","last_became_peered":"2024-04-26T20:25:15.009662+0000","last_unstale":"2024-04-26T20:26:08.797873+0000","last_undegraded":"2024-04-26T20:26:08.797873+0000","last_fullsized":"2024-04-26T20:26:08.797873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:53.199823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460337+0000","last_change":"2024-04-26T20:25:15.889831+0000","last_active":"2024-04-26T20:26:09.460337+0000","last_peered":"2024-04-26T20:26:09.460337+0000","last_clean":"2024-04-26T20:26:09.460337+0000","last_became_active":"2024-04-26T20:25:15.887421+0000","last_became_peered":"2024-04-26T20:25:15.887421+0000","last_unstale":"2024-04-26T20:26:09.460337+0000","last_undegraded":"2024-04-26T20:26:09.460337+0000","last_fullsized":"2024-04-26T20:26:09.460337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:01.118612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797531+0000","last_change":"2024-04-26T20:25:15.007963+0000","last_active":"2024-04-26T20:26:08.797531+0000","last_peered":"2024-04-26T20:26:08.797531+0000","last_clean":"2024-04-26T20:26:08.797531+0000","last_became_active":"2024-04-26T20:25:15.007598+0000","last_became_peered":"2024-04-26T20:25:15.007598+0000","last_unstale":"2024-04-26T20:26:08.797531+0000","last_undegraded":"2024-04-26T20:26:08.797531+0000","last_fullsized":"2024-04-26T20:26:08.797531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:31.490912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795845+0000","last_change":"2024-04-26T20:25:15.890349+0000","last_active":"2024-04-26T20:26:08.795845+0000","last_peered":"2024-04-26T20:26:08.795845+0000","last_clean":"2024-04-26T20:26:08.795845+0000","last_became_active":"2024-04-26T20:25:15.890022+0000","last_became_peered":"2024-04-26T20:25:15.890022+0000","last_unstale":"2024-04-26T20:26:08.795845+0000","last_undegraded":"2024-04-26T20:26:08.795845+0000","last_fullsized":"2024-04-26T20:26:08.795845+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:41.283095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.140720+0000","last_change":"2024-04-26T20:25:15.012522+0000","last_active":"2024-04-26T20:26:31.140720+0000","last_peered":"2024-04-26T20:26:31.140720+0000","last_clean":"2024-04-26T20:26:31.140720+0000","last_became_active":"2024-04-26T20:25:15.012157+0000","last_became_peered":"2024-04-26T20:25:15.012157+0000","last_unstale":"2024-04-26T20:26:31.140720+0000","last_undegraded":"2024-04-26T20:26:31.140720+0000","last_fullsized":"2024-04-26T20:26:31.140720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:54.598330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795902+0000","last_change":"2024-04-26T20:25:15.896016+0000","last_active":"2024-04-26T20:26:08.795902+0000","last_peered":"2024-04-26T20:26:08.795902+0000","last_clean":"2024-04-26T20:26:08.795902+0000","last_became_active":"2024-04-26T20:25:15.895467+0000","last_became_peered":"2024-04-26T20:25:15.895467+0000","last_unstale":"2024-04-26T20:26:08.795902+0000","last_undegraded":"2024-04-26T20:26:08.795902+0000","last_fullsized":"2024-04-26T20:26:08.795902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:28.368634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800998+0000","last_change":"2024-04-26T20:25:15.010645+0000","last_active":"2024-04-26T20:26:08.800998+0000","last_peered":"2024-04-26T20:26:08.800998+0000","last_clean":"2024-04-26T20:26:08.800998+0000","last_became_active":"2024-04-26T20:25:15.010337+0000","last_became_peered":"2024-04-26T20:25:15.010337+0000","last_unstale":"2024-04-26T20:26:08.800998+0000","last_undegraded":"2024-04-26T20:26:08.800998+0000","last_fullsized":"2024-04-26T20:26:08.800998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:40.081464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795611+0000","last_change":"2024-04-26T20:25:15.896806+0000","last_active":"2024-04-26T20:26:08.795611+0000","last_peered":"2024-04-26T20:26:08.795611+0000","last_clean":"2024-04-26T20:26:08.795611+0000","last_became_active":"2024-04-26T20:25:15.896459+0000","last_became_peered":"2024-04-26T20:25:15.896459+0000","last_unstale":"2024-04-26T20:26:08.795611+0000","last_undegraded":"2024-04-26T20:26:08.795611+0000","last_fullsized":"2024-04-26T20:26:08.795611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:25.407874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113013+0000","last_change":"2024-04-26T20:25:15.013291+0000","last_active":"2024-04-26T20:26:09.113013+0000","last_peered":"2024-04-26T20:26:09.113013+0000","last_clean":"2024-04-26T20:26:09.113013+0000","last_became_active":"2024-04-26T20:25:15.012442+0000","last_became_peered":"2024-04-26T20:25:15.012442+0000","last_unstale":"2024-04-26T20:26:09.113013+0000","last_undegraded":"2024-04-26T20:26:09.113013+0000","last_fullsized":"2024-04-26T20:26:09.113013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:56.913314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796084+0000","last_change":"2024-04-26T20:25:15.897364+0000","last_active":"2024-04-26T20:26:08.796084+0000","last_peered":"2024-04-26T20:26:08.796084+0000","last_clean":"2024-04-26T20:26:08.796084+0000","last_became_active":"2024-04-26T20:25:15.895699+0000","last_became_peered":"2024-04-26T20:25:15.895699+0000","last_unstale":"2024-04-26T20:26:08.796084+0000","last_undegraded":"2024-04-26T20:26:08.796084+0000","last_fullsized":"2024-04-26T20:26:08.796084+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:49.507200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.794926+0000","last_change":"2024-04-26T20:25:15.895932+0000","last_active":"2024-04-26T20:26:08.794926+0000","last_peered":"2024-04-26T20:26:08.794926+0000","last_clean":"2024-04-26T20:26:08.794926+0000","last_became_active":"2024-04-26T20:25:15.895583+0000","last_became_peered":"2024-04-26T20:25:15.895583+0000","last_unstale":"2024-04-26T20:26:08.794926+0000","last_undegraded":"2024-04-26T20:26:08.794926+0000","last_fullsized":"2024-04-26T20:26:08.794926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:24.865728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798259+0000","last_change":"2024-04-26T20:25:15.899267+0000","last_active":"2024-04-26T20:26:08.798259+0000","last_peered":"2024-04-26T20:26:08.798259+0000","last_clean":"2024-04-26T20:26:08.798259+0000","last_became_active":"2024-04-26T20:25:15.898841+0000","last_became_peered":"2024-04-26T20:25:15.898841+0000","last_unstale":"2024-04-26T20:26:08.798259+0000","last_undegraded":"2024-04-26T20:26:08.798259+0000","last_fullsized":"2024-04-26T20:26:08.798259+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:28.448452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797750+0000","last_change":"2024-04-26T20:25:15.886667+0000","last_active":"2024-04-26T20:26:08.797750+0000","last_peered":"2024-04-26T20:26:08.797750+0000","last_clean":"2024-04-26T20:26:08.797750+0000","last_became_active":"2024-04-26T20:25:15.886338+0000","last_became_peered":"2024-04-26T20:25:15.886338+0000","last_unstale":"2024-04-26T20:26:08.797750+0000","last_undegraded":"2024-04-26T20:26:08.797750+0000","last_fullsized":"2024-04-26T20:26:08.797750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:20.666594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797065+0000","last_change":"2024-04-26T20:25:15.895551+0000","last_active":"2024-04-26T20:26:08.797065+0000","last_peered":"2024-04-26T20:26:08.797065+0000","last_clean":"2024-04-26T20:26:08.797065+0000","last_became_active":"2024-04-26T20:25:15.895129+0000","last_became_peered":"2024-04-26T20:25:15.895129+0000","last_unstale":"2024-04-26T20:26:08.797065+0000","last_undegraded":"2024-04-26T20:26:08.797065+0000","last_fullsized":"2024-04-26T20:26:08.797065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.959022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113670+0000","last_change":"2024-04-26T20:25:15.895286+0000","last_active":"2024-04-26T20:26:09.113670+0000","last_peered":"2024-04-26T20:26:09.113670+0000","last_clean":"2024-04-26T20:26:09.113670+0000","last_became_active":"2024-04-26T20:25:15.894954+0000","last_became_peered":"2024-04-26T20:25:15.894954+0000","last_unstale":"2024-04-26T20:26:09.113670+0000","last_undegraded":"2024-04-26T20:26:09.113670+0000","last_fullsized":"2024-04-26T20:26:09.113670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:02.805037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795627+0000","last_change":"2024-04-26T20:25:15.896824+0000","last_active":"2024-04-26T20:26:08.795627+0000","last_peered":"2024-04-26T20:26:08.795627+0000","last_clean":"2024-04-26T20:26:08.795627+0000","last_became_active":"2024-04-26T20:25:15.896337+0000","last_became_peered":"2024-04-26T20:25:15.896337+0000","last_unstale":"2024-04-26T20:26:08.795627+0000","last_undegraded":"2024-04-26T20:26:08.795627+0000","last_fullsized":"2024-04-26T20:26:08.795627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:31.105915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800014+0000","last_change":"2024-04-26T20:25:15.890207+0000","last_active":"2024-04-26T20:26:08.800014+0000","last_peered":"2024-04-26T20:26:08.800014+0000","last_clean":"2024-04-26T20:26:08.800014+0000","last_became_active":"2024-04-26T20:25:15.889890+0000","last_became_peered":"2024-04-26T20:25:15.889890+0000","last_unstale":"2024-04-26T20:26:08.800014+0000","last_undegraded":"2024-04-26T20:26:08.800014+0000","last_fullsized":"2024-04-26T20:26:08.800014+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:44.562779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.920753+0000","last_change":"2024-04-26T20:26:08.920448+0000","last_active":"2024-04-26T20:26:08.920753+0000","last_peered":"2024-04-26T20:26:08.920753+0000","last_clean":"2024-04-26T20:26:08.920753+0000","last_became_active":"2024-04-26T20:26:08.920148+0000","last_became_peered":"2024-04-26T20:26:08.920148+0000","last_unstale":"2024-04-26T20:26:08.920753+0000","last_undegraded":"2024-04-26T20:26:08.920753+0000","last_fullsized":"2024-04-26T20:26:08.920753+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:47.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800886+0000","last_change":"2024-04-26T20:25:15.895097+0000","last_active":"2024-04-26T20:26:08.800886+0000","last_peered":"2024-04-26T20:26:08.800886+0000","last_clean":"2024-04-26T20:26:08.800886+0000","last_became_active":"2024-04-26T20:25:15.894647+0000","last_became_peered":"2024-04-26T20:25:15.894647+0000","last_unstale":"2024-04-26T20:26:08.800886+0000","last_undegraded":"2024-04-26T20:26:08.800886+0000","last_fullsized":"2024-04-26T20:26:08.800886+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:48.651323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.459927+0000","last_change":"2024-04-26T20:25:15.886174+0000","last_active":"2024-04-26T20:26:09.459927+0000","last_peered":"2024-04-26T20:26:09.459927+0000","last_clean":"2024-04-26T20:26:09.459927+0000","last_became_active":"2024-04-26T20:25:15.885869+0000","last_became_peered":"2024-04-26T20:25:15.885869+0000","last_unstale":"2024-04-26T20:26:09.459927+0000","last_undegraded":"2024-04-26T20:26:09.459927+0000","last_fullsized":"2024-04-26T20:26:09.459927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:54.776504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.799224+0000","last_change":"2024-04-26T20:25:15.888377+0000","last_active":"2024-04-26T20:26:08.799224+0000","last_peered":"2024-04-26T20:26:08.799224+0000","last_clean":"2024-04-26T20:26:08.799224+0000","last_became_active":"2024-04-26T20:25:15.888042+0000","last_became_peered":"2024-04-26T20:25:15.888042+0000","last_unstale":"2024-04-26T20:26:08.799224+0000","last_undegraded":"2024-04-26T20:26:08.799224+0000","last_fullsized":"2024-04-26T20:26:08.799224+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.922321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113111+0000","last_change":"2024-04-26T20:25:15.887255+0000","last_active":"2024-04-26T20:26:09.113111+0000","last_peered":"2024-04-26T20:26:09.113111+0000","last_clean":"2024-04-26T20:26:09.113111+0000","last_became_active":"2024-04-26T20:25:15.886936+0000","last_became_peered":"2024-04-26T20:25:15.886936+0000","last_unstale":"2024-04-26T20:26:09.113111+0000","last_undegraded":"2024-04-26T20:26:09.113111+0000","last_fullsized":"2024-04-26T20:26:09.113111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:54.135181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795086+0000","last_change":"2024-04-26T20:25:15.893371+0000","last_active":"2024-04-26T20:26:08.795086+0000","last_peered":"2024-04-26T20:26:08.795086+0000","last_clean":"2024-04-26T20:26:08.795086+0000","last_became_active":"2024-04-26T20:25:15.892490+0000","last_became_peered":"2024-04-26T20:25:15.892490+0000","last_unstale":"2024-04-26T20:26:08.795086+0000","last_undegraded":"2024-04-26T20:26:08.795086+0000","last_fullsized":"2024-04-26T20:26:08.795086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:39.337577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":211446,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58598,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":727,"num_read_kb":426,"num_write":233,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":51506,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":495616,"data_stored":175794,"data_compressed":12091,"data_compressed_allocated":20480,"data_compressed_original":65536,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351006,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":460472,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612643,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1101824,"data_stored":1102783,"data_compressed":43701,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776168,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":983040,"data_stored":459899,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037805,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":460165,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299442,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":1052795,"data_compressed":41841,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462968,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":511010,"data_compressed":14152,"data_compressed_allocated":20480,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":511923,"data_compressed":7641,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":461346,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":461140,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":459441,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888130,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":459868,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724605,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":1052082,"data_compressed":41841,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":53146,"data_compressed":1860,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":52116,"data_compressed":8371,"data_compressed_allocated":12288,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":53521,"data_compressed":1860,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:26:35.211 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T20:26:35.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:34 smithi098 ceph-mon[32591]: pgmap v331: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-26T20:26:35.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:35.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:34 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:35.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:34 smithi080 ceph-mon[32278]: pgmap v331: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-26T20:26:35.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:35.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:34 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:35.457 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:35 smithi098 ceph-mon[32591]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:26:36.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:36.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:36.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:35 smithi098 ceph-mon[32591]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:36.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:35 smithi080 ceph-mon[32278]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:26:36.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:35 smithi080 ceph-mon[32278]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:36.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:35 smithi070 ceph-mon[29124]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:26:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:36.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:35 smithi070 ceph-mon[29124]: from='mgr.14152 172.21.15.70:0/3730919467' entity='mgr.x' 2024-04-26T20:26:36.960 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:36 smithi070 ceph-mon[29124]: pgmap v332: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:26:37.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.157+0000 7f94c31a6700 1 -- 172.21.15.70:0/953672041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94bc1094d0 msgr2=0x7f94bc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:37.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.157+0000 7f94c31a6700 1 --2- 172.21.15.70:0/953672041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94bc1094d0 0x7f94bc1098b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f94b400b0d0 tx=0x7f94b400b3e0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.157+0000 7f94c31a6700 1 -- 172.21.15.70:0/953672041 shutdown_connections 2024-04-26T20:26:37.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.157+0000 7f94c31a6700 1 --2- 172.21.15.70:0/953672041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94bc102330 0x7f94bc1102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.157+0000 7f94c31a6700 1 --2- 172.21.15.70:0/953672041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94bc1094d0 0x7f94bc1098b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.157+0000 7f94c31a6700 1 --2- 172.21.15.70:0/953672041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94bc101970 0x7f94bc101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.157+0000 7f94c31a6700 1 -- 172.21.15.70:0/953672041 >> 172.21.15.70:0/953672041 conn(0x7f94bc078920 msgr2=0x7f94bc0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:37.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.157+0000 7f94c31a6700 1 -- 172.21.15.70:0/953672041 shutdown_connections 2024-04-26T20:26:37.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.157+0000 7f94c31a6700 1 -- 172.21.15.70:0/953672041 wait complete. 2024-04-26T20:26:37.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.157+0000 7f94c31a6700 1 Processor -- start 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.157+0000 7f94c31a6700 1 -- start start 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c31a6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94bc101970 0x7f94bc102b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c31a6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94bc102330 0x7f94bc103090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c31a6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94bc1094d0 0x7f94bc1035d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c31a6700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc113730 con 0x7f94bc1094d0 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c31a6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc1135b0 con 0x7f94bc101970 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c31a6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc1138b0 con 0x7f94bc102330 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c1743700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94bc1094d0 0x7f94bc1035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c1743700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94bc1094d0 0x7f94bc1035d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59110/0 (socket says 172.21.15.70:59110) 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c1743700 1 -- 172.21.15.70:0/112946078 learned_addr learned my addr 172.21.15.70:0/112946078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c0f42700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94bc101970 0x7f94bc102b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94bbfff700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94bc102330 0x7f94bc103090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:37.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c1743700 1 -- 172.21.15.70:0/112946078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94bc102330 msgr2=0x7f94bc103090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c1743700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94bc102330 0x7f94bc103090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c1743700 1 -- 172.21.15.70:0/112946078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94bc101970 msgr2=0x7f94bc102b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c1743700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94bc101970 0x7f94bc102b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c1743700 1 -- 172.21.15.70:0/112946078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc1a8080 con 0x7f94bc1094d0 2024-04-26T20:26:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94bbfff700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94bc102330 0x7f94bc103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c1743700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94bc1094d0 0x7f94bc1035d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c970 tx=0x7f94a400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94b9ffb700 1 -- 172.21.15.70:0/112946078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a40078f0 con 0x7f94bc1094d0 2024-04-26T20:26:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94c31a6700 1 -- 172.21.15.70:0/112946078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94bc1a8370 con 0x7f94bc1094d0 2024-04-26T20:26:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94b9ffb700 1 -- 172.21.15.70:0/112946078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94a400f450 con 0x7f94bc1094d0 2024-04-26T20:26:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.158+0000 7f94b9ffb700 1 -- 172.21.15.70:0/112946078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4018640 con 0x7f94bc1094d0 2024-04-26T20:26:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.159+0000 7f94c31a6700 1 -- 172.21.15.70:0/112946078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94bc1a88b0 con 0x7f94bc1094d0 2024-04-26T20:26:37.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.160+0000 7f94c31a6700 1 -- 172.21.15.70:0/112946078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94bc10b990 con 0x7f94bc1094d0 2024-04-26T20:26:37.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.161+0000 7f94b9ffb700 1 -- 172.21.15.70:0/112946078 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f94a4007a90 con 0x7f94bc1094d0 2024-04-26T20:26:37.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.161+0000 7f94b9ffb700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f94a80a3cd0 0x7f94a80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:37.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.161+0000 7f94c0f42700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f94a80a3cd0 0x7f94a80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:37.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.161+0000 7f94b9ffb700 1 -- 172.21.15.70:0/112946078 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f94a40d03d0 con 0x7f94bc1094d0 2024-04-26T20:26:37.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.162+0000 7f94c0f42700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f94a80a3cd0 0x7f94a80a6190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f94b400d010 tx=0x7f94b400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:37.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.166+0000 7f94b9ffb700 1 -- 172.21.15.70:0/112946078 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f94a4014030 con 0x7f94bc1094d0 2024-04-26T20:26:37.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:36 smithi098 ceph-mon[32591]: pgmap v332: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:26:37.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:36 smithi080 ceph-mon[32278]: pgmap v332: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:26:37.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.364+0000 7f94c31a6700 1 -- 172.21.15.70:0/112946078 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94bc063860 con 0x7f94a80a3cd0 2024-04-26T20:26:37.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.371+0000 7f94b9ffb700 1 -- 172.21.15.70:0/112946078 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259026 (secure 0 0 0) 0x7f94bc063860 con 0x7f94a80a3cd0 2024-04-26T20:26:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:26:37.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 -- 172.21.15.70:0/112946078 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f94a80a3cd0 msgr2=0x7f94a80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:37.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f94a80a3cd0 0x7f94a80a6190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f94b400d010 tx=0x7f94b400b040 comp rx=0 tx=0).stop 2024-04-26T20:26:37.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 -- 172.21.15.70:0/112946078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94bc1094d0 msgr2=0x7f94bc1035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:37.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94bc1094d0 0x7f94bc1035d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c970 tx=0x7f94a400cc80 comp rx=0 tx=0).stop 2024-04-26T20:26:37.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 -- 172.21.15.70:0/112946078 shutdown_connections 2024-04-26T20:26:37.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f94a80a3cd0 0x7f94a80a6190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94bc1094d0 0x7f94bc1035d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94bc101970 0x7f94bc102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 --2- 172.21.15.70:0/112946078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94bc102330 0x7f94bc103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 -- 172.21.15.70:0/112946078 >> 172.21.15.70:0/112946078 conn(0x7f94bc078920 msgr2=0x7f94bc0fffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:37.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 -- 172.21.15.70:0/112946078 shutdown_connections 2024-04-26T20:26:37.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:37.374+0000 7f94c31a6700 1 -- 172.21.15.70:0/112946078 wait complete. 2024-04-26T20:26:37.379 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-04-26T20:26:38.116 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-04-26T20:26:35.797373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649200,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":863,"num_read_kb":545,"num_write":416,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1232242,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369280,"kb_used_data":11740,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572544,"statfs":{"total":1151940427776,"available":1151562285056,"internally_reserved":0,"allocated":12021760,"data_stored":7452924,"data_compressed":189643,"data_compressed_allocated":253952,"data_compressed_original":2031616,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003091"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795281+0000","last_change":"2024-04-26T20:25:15.898926+0000","last_active":"2024-04-26T20:26:08.795281+0000","last_peered":"2024-04-26T20:26:08.795281+0000","last_clean":"2024-04-26T20:26:08.795281+0000","last_became_active":"2024-04-26T20:25:15.897656+0000","last_became_peered":"2024-04-26T20:25:15.897656+0000","last_unstale":"2024-04-26T20:26:08.795281+0000","last_undegraded":"2024-04-26T20:26:08.795281+0000","last_fullsized":"2024-04-26T20:26:08.795281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:39.483318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796998+0000","last_change":"2024-04-26T20:25:15.891362+0000","last_active":"2024-04-26T20:26:08.796998+0000","last_peered":"2024-04-26T20:26:08.796998+0000","last_clean":"2024-04-26T20:26:08.796998+0000","last_became_active":"2024-04-26T20:25:15.891038+0000","last_became_peered":"2024-04-26T20:25:15.891038+0000","last_unstale":"2024-04-26T20:26:08.796998+0000","last_undegraded":"2024-04-26T20:26:08.796998+0000","last_fullsized":"2024-04-26T20:26:08.796998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:12.286584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796971+0000","last_change":"2024-04-26T20:25:15.896964+0000","last_active":"2024-04-26T20:26:08.796971+0000","last_peered":"2024-04-26T20:26:08.796971+0000","last_clean":"2024-04-26T20:26:08.796971+0000","last_became_active":"2024-04-26T20:25:15.896645+0000","last_became_peered":"2024-04-26T20:25:15.896645+0000","last_unstale":"2024-04-26T20:26:08.796971+0000","last_undegraded":"2024-04-26T20:26:08.796971+0000","last_fullsized":"2024-04-26T20:26:08.796971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:48.748913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.920904+0000","last_change":"2024-04-26T20:25:15.901504+0000","last_active":"2024-04-26T20:26:08.920904+0000","last_peered":"2024-04-26T20:26:08.920904+0000","last_clean":"2024-04-26T20:26:08.920904+0000","last_became_active":"2024-04-26T20:25:15.900563+0000","last_became_peered":"2024-04-26T20:25:15.900563+0000","last_unstale":"2024-04-26T20:26:08.920904+0000","last_undegraded":"2024-04-26T20:26:08.920904+0000","last_fullsized":"2024-04-26T20:26:08.920904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:58.102101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797412+0000","last_change":"2024-04-26T20:25:15.888692+0000","last_active":"2024-04-26T20:26:08.797412+0000","last_peered":"2024-04-26T20:26:08.797412+0000","last_clean":"2024-04-26T20:26:08.797412+0000","last_became_active":"2024-04-26T20:25:15.888344+0000","last_became_peered":"2024-04-26T20:25:15.888344+0000","last_unstale":"2024-04-26T20:26:08.797412+0000","last_undegraded":"2024-04-26T20:26:08.797412+0000","last_fullsized":"2024-04-26T20:26:08.797412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:53.206291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796067+0000","last_change":"2024-04-26T20:25:15.895663+0000","last_active":"2024-04-26T20:26:08.796067+0000","last_peered":"2024-04-26T20:26:08.796067+0000","last_clean":"2024-04-26T20:26:08.796067+0000","last_became_active":"2024-04-26T20:25:15.895353+0000","last_became_peered":"2024-04-26T20:25:15.895353+0000","last_unstale":"2024-04-26T20:26:08.796067+0000","last_undegraded":"2024-04-26T20:26:08.796067+0000","last_fullsized":"2024-04-26T20:26:08.796067+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:49.441973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.114435+0000","last_change":"2024-04-26T20:26:09.114435+0000","last_active":"2024-04-26T20:26:09.114435+0000","last_peered":"2024-04-26T20:26:09.114435+0000","last_clean":"2024-04-26T20:26:09.114435+0000","last_became_active":"2024-04-26T20:26:09.113972+0000","last_became_peered":"2024-04-26T20:26:09.113972+0000","last_unstale":"2024-04-26T20:26:09.114435+0000","last_undegraded":"2024-04-26T20:26:09.114435+0000","last_fullsized":"2024-04-26T20:26:09.114435+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:21.399136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.459906+0000","last_change":"2024-04-26T20:25:15.889342+0000","last_active":"2024-04-26T20:26:09.459906+0000","last_peered":"2024-04-26T20:26:09.459906+0000","last_clean":"2024-04-26T20:26:09.459906+0000","last_became_active":"2024-04-26T20:25:15.886829+0000","last_became_peered":"2024-04-26T20:25:15.886829+0000","last_unstale":"2024-04-26T20:26:09.459906+0000","last_undegraded":"2024-04-26T20:26:09.459906+0000","last_fullsized":"2024-04-26T20:26:09.459906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:35.350107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.799408+0000","last_change":"2024-04-26T20:25:15.893991+0000","last_active":"2024-04-26T20:26:08.799408+0000","last_peered":"2024-04-26T20:26:08.799408+0000","last_clean":"2024-04-26T20:26:08.799408+0000","last_became_active":"2024-04-26T20:25:15.893653+0000","last_became_peered":"2024-04-26T20:25:15.893653+0000","last_unstale":"2024-04-26T20:26:08.799408+0000","last_undegraded":"2024-04-26T20:26:08.799408+0000","last_fullsized":"2024-04-26T20:26:08.799408+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:46.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.802132+0000","last_change":"2024-04-26T20:26:08.802132+0000","last_active":"2024-04-26T20:26:08.802132+0000","last_peered":"2024-04-26T20:26:08.802132+0000","last_clean":"2024-04-26T20:26:08.802132+0000","last_became_active":"2024-04-26T20:26:08.801857+0000","last_became_peered":"2024-04-26T20:26:08.801857+0000","last_unstale":"2024-04-26T20:26:08.802132+0000","last_undegraded":"2024-04-26T20:26:08.802132+0000","last_fullsized":"2024-04-26T20:26:08.802132+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:58.621108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795876+0000","last_change":"2024-04-26T20:25:15.890189+0000","last_active":"2024-04-26T20:26:08.795876+0000","last_peered":"2024-04-26T20:26:08.795876+0000","last_clean":"2024-04-26T20:26:08.795876+0000","last_became_active":"2024-04-26T20:25:15.889695+0000","last_became_peered":"2024-04-26T20:25:15.889695+0000","last_unstale":"2024-04-26T20:26:08.795876+0000","last_undegraded":"2024-04-26T20:26:08.795876+0000","last_fullsized":"2024-04-26T20:26:08.795876+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:06.598687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.920824+0000","last_change":"2024-04-26T20:25:15.900906+0000","last_active":"2024-04-26T20:26:08.920824+0000","last_peered":"2024-04-26T20:26:08.920824+0000","last_clean":"2024-04-26T20:26:08.920824+0000","last_became_active":"2024-04-26T20:25:15.899689+0000","last_became_peered":"2024-04-26T20:25:15.899689+0000","last_unstale":"2024-04-26T20:26:08.920824+0000","last_undegraded":"2024-04-26T20:26:08.920824+0000","last_fullsized":"2024-04-26T20:26:08.920824+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:03.042267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113119+0000","last_change":"2024-04-26T20:25:15.887410+0000","last_active":"2024-04-26T20:26:09.113119+0000","last_peered":"2024-04-26T20:26:09.113119+0000","last_clean":"2024-04-26T20:26:09.113119+0000","last_became_active":"2024-04-26T20:25:15.887112+0000","last_became_peered":"2024-04-26T20:25:15.887112+0000","last_unstale":"2024-04-26T20:26:09.113119+0000","last_undegraded":"2024-04-26T20:26:09.113119+0000","last_fullsized":"2024-04-26T20:26:09.113119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:23.149512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796794+0000","last_change":"2024-04-26T20:25:15.891275+0000","last_active":"2024-04-26T20:26:08.796794+0000","last_peered":"2024-04-26T20:26:08.796794+0000","last_clean":"2024-04-26T20:26:08.796794+0000","last_became_active":"2024-04-26T20:25:15.890947+0000","last_became_peered":"2024-04-26T20:25:15.890947+0000","last_unstale":"2024-04-26T20:26:08.796794+0000","last_undegraded":"2024-04-26T20:26:08.796794+0000","last_fullsized":"2024-04-26T20:26:08.796794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:29.000821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796865+0000","last_change":"2024-04-26T20:25:15.900806+0000","last_active":"2024-04-26T20:26:08.796865+0000","last_peered":"2024-04-26T20:26:08.796865+0000","last_clean":"2024-04-26T20:26:08.796865+0000","last_became_active":"2024-04-26T20:25:15.900560+0000","last_became_peered":"2024-04-26T20:25:15.900560+0000","last_unstale":"2024-04-26T20:26:08.796865+0000","last_undegraded":"2024-04-26T20:26:08.796865+0000","last_fullsized":"2024-04-26T20:26:08.796865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:51:08.728607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798589+0000","last_change":"2024-04-26T20:25:15.890862+0000","last_active":"2024-04-26T20:26:08.798589+0000","last_peered":"2024-04-26T20:26:08.798589+0000","last_clean":"2024-04-26T20:26:08.798589+0000","last_became_active":"2024-04-26T20:25:15.890504+0000","last_became_peered":"2024-04-26T20:25:15.890504+0000","last_unstale":"2024-04-26T20:26:08.798589+0000","last_undegraded":"2024-04-26T20:26:08.798589+0000","last_fullsized":"2024-04-26T20:26:08.798589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:31.207826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795409+0000","last_change":"2024-04-26T20:25:15.902984+0000","last_active":"2024-04-26T20:26:08.795409+0000","last_peered":"2024-04-26T20:26:08.795409+0000","last_clean":"2024-04-26T20:26:08.795409+0000","last_became_active":"2024-04-26T20:25:15.902644+0000","last_became_peered":"2024-04-26T20:25:15.902644+0000","last_unstale":"2024-04-26T20:26:08.795409+0000","last_undegraded":"2024-04-26T20:26:08.795409+0000","last_fullsized":"2024-04-26T20:26:08.795409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:39.054035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.793940+0000","last_change":"2024-04-26T20:25:15.890139+0000","last_active":"2024-04-26T20:26:08.793940+0000","last_peered":"2024-04-26T20:26:08.793940+0000","last_clean":"2024-04-26T20:26:08.793940+0000","last_became_active":"2024-04-26T20:25:15.889800+0000","last_became_peered":"2024-04-26T20:25:15.889800+0000","last_unstale":"2024-04-26T20:26:08.793940+0000","last_undegraded":"2024-04-26T20:26:08.793940+0000","last_fullsized":"2024-04-26T20:26:08.793940+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:14.886217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798696+0000","last_change":"2024-04-26T20:25:15.885580+0000","last_active":"2024-04-26T20:26:08.798696+0000","last_peered":"2024-04-26T20:26:08.798696+0000","last_clean":"2024-04-26T20:26:08.798696+0000","last_became_active":"2024-04-26T20:25:15.884518+0000","last_became_peered":"2024-04-26T20:25:15.884518+0000","last_unstale":"2024-04-26T20:26:08.798696+0000","last_undegraded":"2024-04-26T20:26:08.798696+0000","last_fullsized":"2024-04-26T20:26:08.798696+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:48:49.587462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:29.136549+0000","last_change":"2024-04-26T20:25:15.009552+0000","last_active":"2024-04-26T20:26:29.136549+0000","last_peered":"2024-04-26T20:26:29.136549+0000","last_clean":"2024-04-26T20:26:29.136549+0000","last_became_active":"2024-04-26T20:25:15.009176+0000","last_became_peered":"2024-04-26T20:25:15.009176+0000","last_unstale":"2024-04-26T20:26:29.136549+0000","last_undegraded":"2024-04-26T20:26:29.136549+0000","last_fullsized":"2024-04-26T20:26:29.136549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:20.740317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460163+0000","last_change":"2024-04-26T20:25:15.890270+0000","last_active":"2024-04-26T20:26:09.460163+0000","last_peered":"2024-04-26T20:26:09.460163+0000","last_clean":"2024-04-26T20:26:09.460163+0000","last_became_active":"2024-04-26T20:25:15.887668+0000","last_became_peered":"2024-04-26T20:25:15.887668+0000","last_unstale":"2024-04-26T20:26:09.460163+0000","last_undegraded":"2024-04-26T20:26:09.460163+0000","last_fullsized":"2024-04-26T20:26:09.460163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:51.531220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460468+0000","last_change":"2024-04-26T20:25:15.012133+0000","last_active":"2024-04-26T20:26:09.460468+0000","last_peered":"2024-04-26T20:26:09.460468+0000","last_clean":"2024-04-26T20:26:09.460468+0000","last_became_active":"2024-04-26T20:25:15.011820+0000","last_became_peered":"2024-04-26T20:25:15.011820+0000","last_unstale":"2024-04-26T20:26:09.460468+0000","last_undegraded":"2024-04-26T20:26:09.460468+0000","last_fullsized":"2024-04-26T20:26:09.460468+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:36.634590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797100+0000","last_change":"2024-04-26T20:25:15.893941+0000","last_active":"2024-04-26T20:26:08.797100+0000","last_peered":"2024-04-26T20:26:08.797100+0000","last_clean":"2024-04-26T20:26:08.797100+0000","last_became_active":"2024-04-26T20:25:15.893616+0000","last_became_peered":"2024-04-26T20:25:15.893616+0000","last_unstale":"2024-04-26T20:26:08.797100+0000","last_undegraded":"2024-04-26T20:26:08.797100+0000","last_fullsized":"2024-04-26T20:26:08.797100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:57.893700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798230+0000","last_change":"2024-04-26T20:25:15.011497+0000","last_active":"2024-04-26T20:26:08.798230+0000","last_peered":"2024-04-26T20:26:08.798230+0000","last_clean":"2024-04-26T20:26:08.798230+0000","last_became_active":"2024-04-26T20:25:15.011122+0000","last_became_peered":"2024-04-26T20:25:15.011122+0000","last_unstale":"2024-04-26T20:26:08.798230+0000","last_undegraded":"2024-04-26T20:26:08.798230+0000","last_fullsized":"2024-04-26T20:26:08.798230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:01.130321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798768+0000","last_change":"2024-04-26T20:25:15.892041+0000","last_active":"2024-04-26T20:26:08.798768+0000","last_peered":"2024-04-26T20:26:08.798768+0000","last_clean":"2024-04-26T20:26:08.798768+0000","last_became_active":"2024-04-26T20:25:15.891648+0000","last_became_peered":"2024-04-26T20:25:15.891648+0000","last_unstale":"2024-04-26T20:26:08.798768+0000","last_undegraded":"2024-04-26T20:26:08.798768+0000","last_fullsized":"2024-04-26T20:26:08.798768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:05.729057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797614+0000","last_change":"2024-04-26T20:25:15.005211+0000","last_active":"2024-04-26T20:26:08.797614+0000","last_peered":"2024-04-26T20:26:08.797614+0000","last_clean":"2024-04-26T20:26:08.797614+0000","last_became_active":"2024-04-26T20:25:15.004879+0000","last_became_peered":"2024-04-26T20:25:15.004879+0000","last_unstale":"2024-04-26T20:26:08.797614+0000","last_undegraded":"2024-04-26T20:26:08.797614+0000","last_fullsized":"2024-04-26T20:26:08.797614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:01.865953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.801118+0000","last_change":"2024-04-26T20:25:15.895878+0000","last_active":"2024-04-26T20:26:08.801118+0000","last_peered":"2024-04-26T20:26:08.801118+0000","last_clean":"2024-04-26T20:26:08.801118+0000","last_became_active":"2024-04-26T20:25:15.895491+0000","last_became_peered":"2024-04-26T20:25:15.895491+0000","last_unstale":"2024-04-26T20:26:08.801118+0000","last_undegraded":"2024-04-26T20:26:08.801118+0000","last_fullsized":"2024-04-26T20:26:08.801118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:41.370320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.140851+0000","last_change":"2024-04-26T20:25:15.013186+0000","last_active":"2024-04-26T20:26:31.140851+0000","last_peered":"2024-04-26T20:26:31.140851+0000","last_clean":"2024-04-26T20:26:31.140851+0000","last_became_active":"2024-04-26T20:25:15.012856+0000","last_became_peered":"2024-04-26T20:25:15.012856+0000","last_unstale":"2024-04-26T20:26:31.140851+0000","last_undegraded":"2024-04-26T20:26:31.140851+0000","last_fullsized":"2024-04-26T20:26:31.140851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:46.978954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797969+0000","last_change":"2024-04-26T20:25:15.896234+0000","last_active":"2024-04-26T20:26:08.797969+0000","last_peered":"2024-04-26T20:26:08.797969+0000","last_clean":"2024-04-26T20:26:08.797969+0000","last_became_active":"2024-04-26T20:25:15.895661+0000","last_became_peered":"2024-04-26T20:25:15.895661+0000","last_unstale":"2024-04-26T20:26:08.797969+0000","last_undegraded":"2024-04-26T20:26:08.797969+0000","last_fullsized":"2024-04-26T20:26:08.797969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:44.716677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795948+0000","last_change":"2024-04-26T20:25:15.004635+0000","last_active":"2024-04-26T20:26:08.795948+0000","last_peered":"2024-04-26T20:26:08.795948+0000","last_clean":"2024-04-26T20:26:08.795948+0000","last_became_active":"2024-04-26T20:25:15.004099+0000","last_became_peered":"2024-04-26T20:25:15.004099+0000","last_unstale":"2024-04-26T20:26:08.795948+0000","last_undegraded":"2024-04-26T20:26:08.795948+0000","last_fullsized":"2024-04-26T20:26:08.795948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:28.770212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800723+0000","last_change":"2024-04-26T20:25:15.898180+0000","last_active":"2024-04-26T20:26:08.800723+0000","last_peered":"2024-04-26T20:26:08.800723+0000","last_clean":"2024-04-26T20:26:08.800723+0000","last_became_active":"2024-04-26T20:25:15.897631+0000","last_became_peered":"2024-04-26T20:25:15.897631+0000","last_unstale":"2024-04-26T20:26:08.800723+0000","last_undegraded":"2024-04-26T20:26:08.800723+0000","last_fullsized":"2024-04-26T20:26:08.800723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:17.936321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113273+0000","last_change":"2024-04-26T20:25:15.003966+0000","last_active":"2024-04-26T20:26:09.113273+0000","last_peered":"2024-04-26T20:26:09.113273+0000","last_clean":"2024-04-26T20:26:09.113273+0000","last_became_active":"2024-04-26T20:25:15.003611+0000","last_became_peered":"2024-04-26T20:25:15.003611+0000","last_unstale":"2024-04-26T20:26:09.113273+0000","last_undegraded":"2024-04-26T20:26:09.113273+0000","last_fullsized":"2024-04-26T20:26:09.113273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:46.494480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.459966+0000","last_change":"2024-04-26T20:25:15.892263+0000","last_active":"2024-04-26T20:26:09.459966+0000","last_peered":"2024-04-26T20:26:09.459966+0000","last_clean":"2024-04-26T20:26:09.459966+0000","last_became_active":"2024-04-26T20:25:15.891912+0000","last_became_peered":"2024-04-26T20:25:15.891912+0000","last_unstale":"2024-04-26T20:26:09.459966+0000","last_undegraded":"2024-04-26T20:26:09.459966+0000","last_fullsized":"2024-04-26T20:26:09.459966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:08.956838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800731+0000","last_change":"2024-04-26T20:25:15.007227+0000","last_active":"2024-04-26T20:26:08.800731+0000","last_peered":"2024-04-26T20:26:08.800731+0000","last_clean":"2024-04-26T20:26:08.800731+0000","last_became_active":"2024-04-26T20:25:15.006901+0000","last_became_peered":"2024-04-26T20:25:15.006901+0000","last_unstale":"2024-04-26T20:26:08.800731+0000","last_undegraded":"2024-04-26T20:26:08.800731+0000","last_fullsized":"2024-04-26T20:26:08.800731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:55.391429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.793619+0000","last_change":"2024-04-26T20:25:15.887979+0000","last_active":"2024-04-26T20:26:08.793619+0000","last_peered":"2024-04-26T20:26:08.793619+0000","last_clean":"2024-04-26T20:26:08.793619+0000","last_became_active":"2024-04-26T20:25:15.887302+0000","last_became_peered":"2024-04-26T20:25:15.887302+0000","last_unstale":"2024-04-26T20:26:08.793619+0000","last_undegraded":"2024-04-26T20:26:08.793619+0000","last_fullsized":"2024-04-26T20:26:08.793619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:41:08.662082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":163,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.140095+0000","last_change":"2024-04-26T20:25:15.005718+0000","last_active":"2024-04-26T20:26:31.140095+0000","last_peered":"2024-04-26T20:26:31.140095+0000","last_clean":"2024-04-26T20:26:31.140095+0000","last_became_active":"2024-04-26T20:25:15.005397+0000","last_became_peered":"2024-04-26T20:25:15.005397+0000","last_unstale":"2024-04-26T20:26:31.140095+0000","last_undegraded":"2024-04-26T20:26:31.140095+0000","last_fullsized":"2024-04-26T20:26:31.140095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:02.398788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.799432+0000","last_change":"2024-04-26T20:25:15.893214+0000","last_active":"2024-04-26T20:26:08.799432+0000","last_peered":"2024-04-26T20:26:08.799432+0000","last_clean":"2024-04-26T20:26:08.799432+0000","last_became_active":"2024-04-26T20:25:15.892615+0000","last_became_peered":"2024-04-26T20:25:15.892615+0000","last_unstale":"2024-04-26T20:26:08.799432+0000","last_undegraded":"2024-04-26T20:26:08.799432+0000","last_fullsized":"2024-04-26T20:26:08.799432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:51.940520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.930524+0000","last_change":"2024-04-26T20:26:08.930524+0000","last_active":"2024-04-26T20:26:08.930524+0000","last_peered":"2024-04-26T20:26:08.930524+0000","last_clean":"2024-04-26T20:26:08.930524+0000","last_became_active":"2024-04-26T20:26:08.921269+0000","last_became_peered":"2024-04-26T20:26:08.921269+0000","last_unstale":"2024-04-26T20:26:08.930524+0000","last_undegraded":"2024-04-26T20:26:08.930524+0000","last_fullsized":"2024-04-26T20:26:08.930524+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:01.322278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,4],"acting":[11,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797030+0000","last_change":"2024-04-26T20:25:15.900729+0000","last_active":"2024-04-26T20:26:08.797030+0000","last_peered":"2024-04-26T20:26:08.797030+0000","last_clean":"2024-04-26T20:26:08.797030+0000","last_became_active":"2024-04-26T20:25:15.900427+0000","last_became_peered":"2024-04-26T20:25:15.900427+0000","last_unstale":"2024-04-26T20:26:08.797030+0000","last_undegraded":"2024-04-26T20:26:08.797030+0000","last_fullsized":"2024-04-26T20:26:08.797030+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:02.321351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.801238+0000","last_change":"2024-04-26T20:25:15.012186+0000","last_active":"2024-04-26T20:26:08.801238+0000","last_peered":"2024-04-26T20:26:08.801238+0000","last_clean":"2024-04-26T20:26:08.801238+0000","last_became_active":"2024-04-26T20:25:15.011853+0000","last_became_peered":"2024-04-26T20:25:15.011853+0000","last_unstale":"2024-04-26T20:26:08.801238+0000","last_undegraded":"2024-04-26T20:26:08.801238+0000","last_fullsized":"2024-04-26T20:26:08.801238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:33.893616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.799207+0000","last_change":"2024-04-26T20:25:15.900656+0000","last_active":"2024-04-26T20:26:08.799207+0000","last_peered":"2024-04-26T20:26:08.799207+0000","last_clean":"2024-04-26T20:26:08.799207+0000","last_became_active":"2024-04-26T20:25:15.899663+0000","last_became_peered":"2024-04-26T20:25:15.899663+0000","last_unstale":"2024-04-26T20:26:08.799207+0000","last_undegraded":"2024-04-26T20:26:08.799207+0000","last_fullsized":"2024-04-26T20:26:08.799207+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:40.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'28","reported_seq":211,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.146020+0000","last_change":"2024-04-26T20:26:09.122542+0000","last_active":"2024-04-26T20:26:31.146020+0000","last_peered":"2024-04-26T20:26:31.146020+0000","last_clean":"2024-04-26T20:26:31.146020+0000","last_became_active":"2024-04-26T20:26:09.114509+0000","last_became_peered":"2024-04-26T20:26:09.114509+0000","last_unstale":"2024-04-26T20:26:31.146020+0000","last_undegraded":"2024-04-26T20:26:31.146020+0000","last_fullsized":"2024-04-26T20:26:31.146020+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:28.714495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51394,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":117,"num_write":30,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":51394,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797260+0000","last_change":"2024-04-26T20:25:15.892134+0000","last_active":"2024-04-26T20:26:08.797260+0000","last_peered":"2024-04-26T20:26:08.797260+0000","last_clean":"2024-04-26T20:26:08.797260+0000","last_became_active":"2024-04-26T20:25:15.890965+0000","last_became_peered":"2024-04-26T20:25:15.890965+0000","last_unstale":"2024-04-26T20:26:08.797260+0000","last_undegraded":"2024-04-26T20:26:08.797260+0000","last_fullsized":"2024-04-26T20:26:08.797260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:11.834642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798561+0000","last_change":"2024-04-26T20:25:15.006020+0000","last_active":"2024-04-26T20:26:08.798561+0000","last_peered":"2024-04-26T20:26:08.798561+0000","last_clean":"2024-04-26T20:26:08.798561+0000","last_became_active":"2024-04-26T20:25:15.005579+0000","last_became_peered":"2024-04-26T20:25:15.005579+0000","last_unstale":"2024-04-26T20:26:08.798561+0000","last_undegraded":"2024-04-26T20:26:08.798561+0000","last_fullsized":"2024-04-26T20:26:08.798561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:51.777497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113007+0000","last_change":"2024-04-26T20:25:15.888561+0000","last_active":"2024-04-26T20:26:09.113007+0000","last_peered":"2024-04-26T20:26:09.113007+0000","last_clean":"2024-04-26T20:26:09.113007+0000","last_became_active":"2024-04-26T20:25:15.888249+0000","last_became_peered":"2024-04-26T20:25:15.888249+0000","last_unstale":"2024-04-26T20:26:09.113007+0000","last_undegraded":"2024-04-26T20:26:09.113007+0000","last_fullsized":"2024-04-26T20:26:09.113007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:29.352406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800370+0000","last_change":"2024-04-26T20:25:15.010139+0000","last_active":"2024-04-26T20:26:08.800370+0000","last_peered":"2024-04-26T20:26:08.800370+0000","last_clean":"2024-04-26T20:26:08.800370+0000","last_became_active":"2024-04-26T20:25:15.009826+0000","last_became_peered":"2024-04-26T20:25:15.009826+0000","last_unstale":"2024-04-26T20:26:08.800370+0000","last_undegraded":"2024-04-26T20:26:08.800370+0000","last_fullsized":"2024-04-26T20:26:08.800370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:31.801205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.114035+0000","last_change":"2024-04-26T20:26:09.114035+0000","last_active":"2024-04-26T20:26:09.114035+0000","last_peered":"2024-04-26T20:26:09.114035+0000","last_clean":"2024-04-26T20:26:09.114035+0000","last_became_active":"2024-04-26T20:26:09.113615+0000","last_became_peered":"2024-04-26T20:26:09.113615+0000","last_unstale":"2024-04-26T20:26:09.114035+0000","last_undegraded":"2024-04-26T20:26:09.114035+0000","last_fullsized":"2024-04-26T20:26:09.114035+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:10.623770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.139856+0000","last_change":"2024-04-26T20:25:15.009046+0000","last_active":"2024-04-26T20:26:31.139856+0000","last_peered":"2024-04-26T20:26:31.139856+0000","last_clean":"2024-04-26T20:26:31.139856+0000","last_became_active":"2024-04-26T20:25:15.006321+0000","last_became_peered":"2024-04-26T20:25:15.006321+0000","last_unstale":"2024-04-26T20:26:31.139856+0000","last_undegraded":"2024-04-26T20:26:31.139856+0000","last_fullsized":"2024-04-26T20:26:31.139856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:30.993709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795431+0000","last_change":"2024-04-26T20:25:15.896722+0000","last_active":"2024-04-26T20:26:08.795431+0000","last_peered":"2024-04-26T20:26:08.795431+0000","last_clean":"2024-04-26T20:26:08.795431+0000","last_became_active":"2024-04-26T20:25:15.896377+0000","last_became_peered":"2024-04-26T20:25:15.896377+0000","last_unstale":"2024-04-26T20:26:08.795431+0000","last_undegraded":"2024-04-26T20:26:08.795431+0000","last_fullsized":"2024-04-26T20:26:08.795431+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:39.899679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797035+0000","last_change":"2024-04-26T20:25:15.016262+0000","last_active":"2024-04-26T20:26:08.797035+0000","last_peered":"2024-04-26T20:26:08.797035+0000","last_clean":"2024-04-26T20:26:08.797035+0000","last_became_active":"2024-04-26T20:25:15.015744+0000","last_became_peered":"2024-04-26T20:25:15.015744+0000","last_unstale":"2024-04-26T20:26:08.797035+0000","last_undegraded":"2024-04-26T20:26:08.797035+0000","last_fullsized":"2024-04-26T20:26:08.797035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:50.231250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800533+0000","last_change":"2024-04-26T20:25:15.894702+0000","last_active":"2024-04-26T20:26:08.800533+0000","last_peered":"2024-04-26T20:26:08.800533+0000","last_clean":"2024-04-26T20:26:08.800533+0000","last_became_active":"2024-04-26T20:25:15.894338+0000","last_became_peered":"2024-04-26T20:25:15.894338+0000","last_unstale":"2024-04-26T20:26:08.800533+0000","last_undegraded":"2024-04-26T20:26:08.800533+0000","last_fullsized":"2024-04-26T20:26:08.800533+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:01.515041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797878+0000","last_change":"2024-04-26T20:25:15.011207+0000","last_active":"2024-04-26T20:26:08.797878+0000","last_peered":"2024-04-26T20:26:08.797878+0000","last_clean":"2024-04-26T20:26:08.797878+0000","last_became_active":"2024-04-26T20:25:15.010733+0000","last_became_peered":"2024-04-26T20:25:15.010733+0000","last_unstale":"2024-04-26T20:26:08.797878+0000","last_undegraded":"2024-04-26T20:26:08.797878+0000","last_fullsized":"2024-04-26T20:26:08.797878+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:35.584041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795183+0000","last_change":"2024-04-26T20:25:15.896061+0000","last_active":"2024-04-26T20:26:08.795183+0000","last_peered":"2024-04-26T20:26:08.795183+0000","last_clean":"2024-04-26T20:26:08.795183+0000","last_became_active":"2024-04-26T20:25:15.895712+0000","last_became_peered":"2024-04-26T20:25:15.895712+0000","last_unstale":"2024-04-26T20:26:08.795183+0000","last_undegraded":"2024-04-26T20:26:08.795183+0000","last_fullsized":"2024-04-26T20:26:08.795183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.663831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.793771+0000","last_change":"2024-04-26T20:25:15.010300+0000","last_active":"2024-04-26T20:26:08.793771+0000","last_peered":"2024-04-26T20:26:08.793771+0000","last_clean":"2024-04-26T20:26:08.793771+0000","last_became_active":"2024-04-26T20:25:15.009999+0000","last_became_peered":"2024-04-26T20:25:15.009999+0000","last_unstale":"2024-04-26T20:26:08.793771+0000","last_undegraded":"2024-04-26T20:26:08.793771+0000","last_fullsized":"2024-04-26T20:26:08.793771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:07.394664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797365+0000","last_change":"2024-04-26T20:25:15.888356+0000","last_active":"2024-04-26T20:26:08.797365+0000","last_peered":"2024-04-26T20:26:08.797365+0000","last_clean":"2024-04-26T20:26:08.797365+0000","last_became_active":"2024-04-26T20:25:15.888056+0000","last_became_peered":"2024-04-26T20:25:15.888056+0000","last_unstale":"2024-04-26T20:26:08.797365+0000","last_undegraded":"2024-04-26T20:26:08.797365+0000","last_fullsized":"2024-04-26T20:26:08.797365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:49:22.697718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.139647+0000","last_change":"2024-04-26T20:25:15.008552+0000","last_active":"2024-04-26T20:26:31.139647+0000","last_peered":"2024-04-26T20:26:31.139647+0000","last_clean":"2024-04-26T20:26:31.139647+0000","last_became_active":"2024-04-26T20:25:15.008217+0000","last_became_peered":"2024-04-26T20:25:15.008217+0000","last_unstale":"2024-04-26T20:26:31.139647+0000","last_undegraded":"2024-04-26T20:26:31.139647+0000","last_fullsized":"2024-04-26T20:26:31.139647+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:23.803674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796128+0000","last_change":"2024-04-26T20:25:15.896655+0000","last_active":"2024-04-26T20:26:08.796128+0000","last_peered":"2024-04-26T20:26:08.796128+0000","last_clean":"2024-04-26T20:26:08.796128+0000","last_became_active":"2024-04-26T20:25:15.896335+0000","last_became_peered":"2024-04-26T20:25:15.896335+0000","last_unstale":"2024-04-26T20:26:08.796128+0000","last_undegraded":"2024-04-26T20:26:08.796128+0000","last_fullsized":"2024-04-26T20:26:08.796128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:38.168159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.803267+0000","last_change":"2024-04-26T20:26:08.803267+0000","last_active":"2024-04-26T20:26:08.803267+0000","last_peered":"2024-04-26T20:26:08.803267+0000","last_clean":"2024-04-26T20:26:08.803267+0000","last_became_active":"2024-04-26T20:26:08.802845+0000","last_became_peered":"2024-04-26T20:26:08.802845+0000","last_unstale":"2024-04-26T20:26:08.803267+0000","last_undegraded":"2024-04-26T20:26:08.803267+0000","last_fullsized":"2024-04-26T20:26:08.803267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:23.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.139284+0000","last_change":"2024-04-26T20:25:15.012015+0000","last_active":"2024-04-26T20:26:31.139284+0000","last_peered":"2024-04-26T20:26:31.139284+0000","last_clean":"2024-04-26T20:26:31.139284+0000","last_became_active":"2024-04-26T20:25:15.011705+0000","last_became_peered":"2024-04-26T20:25:15.011705+0000","last_unstale":"2024-04-26T20:26:31.139284+0000","last_undegraded":"2024-04-26T20:26:31.139284+0000","last_fullsized":"2024-04-26T20:26:31.139284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:10.213375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460156+0000","last_change":"2024-04-26T20:25:15.885294+0000","last_active":"2024-04-26T20:26:09.460156+0000","last_peered":"2024-04-26T20:26:09.460156+0000","last_clean":"2024-04-26T20:26:09.460156+0000","last_became_active":"2024-04-26T20:25:15.884963+0000","last_became_peered":"2024-04-26T20:25:15.884963+0000","last_unstale":"2024-04-26T20:26:09.460156+0000","last_undegraded":"2024-04-26T20:26:09.460156+0000","last_fullsized":"2024-04-26T20:26:09.460156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:21:29.222616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.920418+0000","last_change":"2024-04-26T20:25:15.006101+0000","last_active":"2024-04-26T20:26:08.920418+0000","last_peered":"2024-04-26T20:26:08.920418+0000","last_clean":"2024-04-26T20:26:08.920418+0000","last_became_active":"2024-04-26T20:25:15.005566+0000","last_became_peered":"2024-04-26T20:25:15.005566+0000","last_unstale":"2024-04-26T20:26:08.920418+0000","last_undegraded":"2024-04-26T20:26:08.920418+0000","last_fullsized":"2024-04-26T20:26:08.920418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:15.392418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796224+0000","last_change":"2024-04-26T20:23:58.975689+0000","last_active":"2024-04-26T20:26:08.796224+0000","last_peered":"2024-04-26T20:26:08.796224+0000","last_clean":"2024-04-26T20:26:08.796224+0000","last_became_active":"2024-04-26T20:23:58.975250+0000","last_became_peered":"2024-04-26T20:23:58.975250+0000","last_unstale":"2024-04-26T20:26:08.796224+0000","last_undegraded":"2024-04-26T20:26:08.796224+0000","last_fullsized":"2024-04-26T20:26:08.796224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:20:34.477920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:20:34.477920+0000","last_clean_scrub_stamp":"2024-04-26T20:20:34.477920+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:51.870155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113103+0000","last_change":"2024-04-26T20:25:15.895244+0000","last_active":"2024-04-26T20:26:09.113103+0000","last_peered":"2024-04-26T20:26:09.113103+0000","last_clean":"2024-04-26T20:26:09.113103+0000","last_became_active":"2024-04-26T20:25:15.894943+0000","last_became_peered":"2024-04-26T20:25:15.894943+0000","last_unstale":"2024-04-26T20:26:09.113103+0000","last_undegraded":"2024-04-26T20:26:09.113103+0000","last_fullsized":"2024-04-26T20:26:09.113103+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:03.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.924777+0000","last_change":"2024-04-26T20:26:08.924777+0000","last_active":"2024-04-26T20:26:08.924777+0000","last_peered":"2024-04-26T20:26:08.924777+0000","last_clean":"2024-04-26T20:26:08.924777+0000","last_became_active":"2024-04-26T20:26:08.921514+0000","last_became_peered":"2024-04-26T20:26:08.921514+0000","last_unstale":"2024-04-26T20:26:08.924777+0000","last_undegraded":"2024-04-26T20:26:08.924777+0000","last_fullsized":"2024-04-26T20:26:08.924777+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:02.422556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.805964+0000","last_change":"2024-04-26T20:26:08.805964+0000","last_active":"2024-04-26T20:26:08.805964+0000","last_peered":"2024-04-26T20:26:08.805964+0000","last_clean":"2024-04-26T20:26:08.805964+0000","last_became_active":"2024-04-26T20:26:08.798606+0000","last_became_peered":"2024-04-26T20:26:08.798606+0000","last_unstale":"2024-04-26T20:26:08.805964+0000","last_undegraded":"2024-04-26T20:26:08.805964+0000","last_fullsized":"2024-04-26T20:26:08.805964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:26:56.047752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113630+0000","last_change":"2024-04-26T20:25:15.881988+0000","last_active":"2024-04-26T20:26:09.113630+0000","last_peered":"2024-04-26T20:26:09.113630+0000","last_clean":"2024-04-26T20:26:09.113630+0000","last_became_active":"2024-04-26T20:25:15.881615+0000","last_became_peered":"2024-04-26T20:25:15.881615+0000","last_unstale":"2024-04-26T20:26:09.113630+0000","last_undegraded":"2024-04-26T20:26:09.113630+0000","last_fullsized":"2024-04-26T20:26:09.113630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:24.511442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.793917+0000","last_change":"2024-04-26T20:25:15.005468+0000","last_active":"2024-04-26T20:26:08.793917+0000","last_peered":"2024-04-26T20:26:08.793917+0000","last_clean":"2024-04-26T20:26:08.793917+0000","last_became_active":"2024-04-26T20:25:15.005164+0000","last_became_peered":"2024-04-26T20:25:15.005164+0000","last_unstale":"2024-04-26T20:26:08.793917+0000","last_undegraded":"2024-04-26T20:26:08.793917+0000","last_fullsized":"2024-04-26T20:26:08.793917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:58.964128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460524+0000","last_change":"2024-04-26T20:25:15.893298+0000","last_active":"2024-04-26T20:26:09.460524+0000","last_peered":"2024-04-26T20:26:09.460524+0000","last_clean":"2024-04-26T20:26:09.460524+0000","last_became_active":"2024-04-26T20:25:15.892981+0000","last_became_peered":"2024-04-26T20:25:15.892981+0000","last_unstale":"2024-04-26T20:26:09.460524+0000","last_undegraded":"2024-04-26T20:26:09.460524+0000","last_fullsized":"2024-04-26T20:26:09.460524+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:09.916807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.921008+0000","last_change":"2024-04-26T20:25:15.007962+0000","last_active":"2024-04-26T20:26:08.921008+0000","last_peered":"2024-04-26T20:26:08.921008+0000","last_clean":"2024-04-26T20:26:08.921008+0000","last_became_active":"2024-04-26T20:25:15.007592+0000","last_became_peered":"2024-04-26T20:25:15.007592+0000","last_unstale":"2024-04-26T20:26:08.921008+0000","last_undegraded":"2024-04-26T20:26:08.921008+0000","last_fullsized":"2024-04-26T20:26:08.921008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:26.364350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797175+0000","last_change":"2024-04-26T20:25:15.895272+0000","last_active":"2024-04-26T20:26:08.797175+0000","last_peered":"2024-04-26T20:26:08.797175+0000","last_clean":"2024-04-26T20:26:08.797175+0000","last_became_active":"2024-04-26T20:25:15.894962+0000","last_became_peered":"2024-04-26T20:25:15.894962+0000","last_unstale":"2024-04-26T20:26:08.797175+0000","last_undegraded":"2024-04-26T20:26:08.797175+0000","last_fullsized":"2024-04-26T20:26:08.797175+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:13.714365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798660+0000","last_change":"2024-04-26T20:25:15.014580+0000","last_active":"2024-04-26T20:26:08.798660+0000","last_peered":"2024-04-26T20:26:08.798660+0000","last_clean":"2024-04-26T20:26:08.798660+0000","last_became_active":"2024-04-26T20:25:15.014320+0000","last_became_peered":"2024-04-26T20:25:15.014320+0000","last_unstale":"2024-04-26T20:26:08.798660+0000","last_undegraded":"2024-04-26T20:26:08.798660+0000","last_fullsized":"2024-04-26T20:26:08.798660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:43.689597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797835+0000","last_change":"2024-04-26T20:25:15.891833+0000","last_active":"2024-04-26T20:26:08.797835+0000","last_peered":"2024-04-26T20:26:08.797835+0000","last_clean":"2024-04-26T20:26:08.797835+0000","last_became_active":"2024-04-26T20:25:15.891514+0000","last_became_peered":"2024-04-26T20:25:15.891514+0000","last_unstale":"2024-04-26T20:26:08.797835+0000","last_undegraded":"2024-04-26T20:26:08.797835+0000","last_fullsized":"2024-04-26T20:26:08.797835+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:16.673434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460037+0000","last_change":"2024-04-26T20:25:15.006756+0000","last_active":"2024-04-26T20:26:09.460037+0000","last_peered":"2024-04-26T20:26:09.460037+0000","last_clean":"2024-04-26T20:26:09.460037+0000","last_became_active":"2024-04-26T20:25:15.006297+0000","last_became_peered":"2024-04-26T20:25:15.006297+0000","last_unstale":"2024-04-26T20:26:09.460037+0000","last_undegraded":"2024-04-26T20:26:09.460037+0000","last_fullsized":"2024-04-26T20:26:09.460037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:28.797708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.794888+0000","last_change":"2024-04-26T20:25:15.891105+0000","last_active":"2024-04-26T20:26:08.794888+0000","last_peered":"2024-04-26T20:26:08.794888+0000","last_clean":"2024-04-26T20:26:08.794888+0000","last_became_active":"2024-04-26T20:25:15.890761+0000","last_became_peered":"2024-04-26T20:25:15.890761+0000","last_unstale":"2024-04-26T20:26:08.794888+0000","last_undegraded":"2024-04-26T20:26:08.794888+0000","last_fullsized":"2024-04-26T20:26:08.794888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:48.010351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797873+0000","last_change":"2024-04-26T20:25:15.009981+0000","last_active":"2024-04-26T20:26:08.797873+0000","last_peered":"2024-04-26T20:26:08.797873+0000","last_clean":"2024-04-26T20:26:08.797873+0000","last_became_active":"2024-04-26T20:25:15.009662+0000","last_became_peered":"2024-04-26T20:25:15.009662+0000","last_unstale":"2024-04-26T20:26:08.797873+0000","last_undegraded":"2024-04-26T20:26:08.797873+0000","last_fullsized":"2024-04-26T20:26:08.797873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:53.199823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.460337+0000","last_change":"2024-04-26T20:25:15.889831+0000","last_active":"2024-04-26T20:26:09.460337+0000","last_peered":"2024-04-26T20:26:09.460337+0000","last_clean":"2024-04-26T20:26:09.460337+0000","last_became_active":"2024-04-26T20:25:15.887421+0000","last_became_peered":"2024-04-26T20:25:15.887421+0000","last_unstale":"2024-04-26T20:26:09.460337+0000","last_undegraded":"2024-04-26T20:26:09.460337+0000","last_fullsized":"2024-04-26T20:26:09.460337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:01.118612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797531+0000","last_change":"2024-04-26T20:25:15.007963+0000","last_active":"2024-04-26T20:26:08.797531+0000","last_peered":"2024-04-26T20:26:08.797531+0000","last_clean":"2024-04-26T20:26:08.797531+0000","last_became_active":"2024-04-26T20:25:15.007598+0000","last_became_peered":"2024-04-26T20:25:15.007598+0000","last_unstale":"2024-04-26T20:26:08.797531+0000","last_undegraded":"2024-04-26T20:26:08.797531+0000","last_fullsized":"2024-04-26T20:26:08.797531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:31.490912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795845+0000","last_change":"2024-04-26T20:25:15.890349+0000","last_active":"2024-04-26T20:26:08.795845+0000","last_peered":"2024-04-26T20:26:08.795845+0000","last_clean":"2024-04-26T20:26:08.795845+0000","last_became_active":"2024-04-26T20:25:15.890022+0000","last_became_peered":"2024-04-26T20:25:15.890022+0000","last_unstale":"2024-04-26T20:26:08.795845+0000","last_undegraded":"2024-04-26T20:26:08.795845+0000","last_fullsized":"2024-04-26T20:26:08.795845+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:41.283095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:31.140720+0000","last_change":"2024-04-26T20:25:15.012522+0000","last_active":"2024-04-26T20:26:31.140720+0000","last_peered":"2024-04-26T20:26:31.140720+0000","last_clean":"2024-04-26T20:26:31.140720+0000","last_became_active":"2024-04-26T20:25:15.012157+0000","last_became_peered":"2024-04-26T20:25:15.012157+0000","last_unstale":"2024-04-26T20:26:31.140720+0000","last_undegraded":"2024-04-26T20:26:31.140720+0000","last_fullsized":"2024-04-26T20:26:31.140720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:54.598330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795902+0000","last_change":"2024-04-26T20:25:15.896016+0000","last_active":"2024-04-26T20:26:08.795902+0000","last_peered":"2024-04-26T20:26:08.795902+0000","last_clean":"2024-04-26T20:26:08.795902+0000","last_became_active":"2024-04-26T20:25:15.895467+0000","last_became_peered":"2024-04-26T20:25:15.895467+0000","last_unstale":"2024-04-26T20:26:08.795902+0000","last_undegraded":"2024-04-26T20:26:08.795902+0000","last_fullsized":"2024-04-26T20:26:08.795902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:28.368634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800998+0000","last_change":"2024-04-26T20:25:15.010645+0000","last_active":"2024-04-26T20:26:08.800998+0000","last_peered":"2024-04-26T20:26:08.800998+0000","last_clean":"2024-04-26T20:26:08.800998+0000","last_became_active":"2024-04-26T20:25:15.010337+0000","last_became_peered":"2024-04-26T20:25:15.010337+0000","last_unstale":"2024-04-26T20:26:08.800998+0000","last_undegraded":"2024-04-26T20:26:08.800998+0000","last_fullsized":"2024-04-26T20:26:08.800998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:40.081464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795611+0000","last_change":"2024-04-26T20:25:15.896806+0000","last_active":"2024-04-26T20:26:08.795611+0000","last_peered":"2024-04-26T20:26:08.795611+0000","last_clean":"2024-04-26T20:26:08.795611+0000","last_became_active":"2024-04-26T20:25:15.896459+0000","last_became_peered":"2024-04-26T20:25:15.896459+0000","last_unstale":"2024-04-26T20:26:08.795611+0000","last_undegraded":"2024-04-26T20:26:08.795611+0000","last_fullsized":"2024-04-26T20:26:08.795611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:25.407874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113013+0000","last_change":"2024-04-26T20:25:15.013291+0000","last_active":"2024-04-26T20:26:09.113013+0000","last_peered":"2024-04-26T20:26:09.113013+0000","last_clean":"2024-04-26T20:26:09.113013+0000","last_became_active":"2024-04-26T20:25:15.012442+0000","last_became_peered":"2024-04-26T20:25:15.012442+0000","last_unstale":"2024-04-26T20:26:09.113013+0000","last_undegraded":"2024-04-26T20:26:09.113013+0000","last_fullsized":"2024-04-26T20:26:09.113013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:13.983819+0000","last_clean_scrub_stamp":"2024-04-26T20:25:13.983819+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:56.913314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.796084+0000","last_change":"2024-04-26T20:25:15.897364+0000","last_active":"2024-04-26T20:26:08.796084+0000","last_peered":"2024-04-26T20:26:08.796084+0000","last_clean":"2024-04-26T20:26:08.796084+0000","last_became_active":"2024-04-26T20:25:15.895699+0000","last_became_peered":"2024-04-26T20:25:15.895699+0000","last_unstale":"2024-04-26T20:26:08.796084+0000","last_undegraded":"2024-04-26T20:26:08.796084+0000","last_fullsized":"2024-04-26T20:26:08.796084+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:49.507200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.794926+0000","last_change":"2024-04-26T20:25:15.895932+0000","last_active":"2024-04-26T20:26:08.794926+0000","last_peered":"2024-04-26T20:26:08.794926+0000","last_clean":"2024-04-26T20:26:08.794926+0000","last_became_active":"2024-04-26T20:25:15.895583+0000","last_became_peered":"2024-04-26T20:25:15.895583+0000","last_unstale":"2024-04-26T20:26:08.794926+0000","last_undegraded":"2024-04-26T20:26:08.794926+0000","last_fullsized":"2024-04-26T20:26:08.794926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:24.865728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.798259+0000","last_change":"2024-04-26T20:25:15.899267+0000","last_active":"2024-04-26T20:26:08.798259+0000","last_peered":"2024-04-26T20:26:08.798259+0000","last_clean":"2024-04-26T20:26:08.798259+0000","last_became_active":"2024-04-26T20:25:15.898841+0000","last_became_peered":"2024-04-26T20:25:15.898841+0000","last_unstale":"2024-04-26T20:26:08.798259+0000","last_undegraded":"2024-04-26T20:26:08.798259+0000","last_fullsized":"2024-04-26T20:26:08.798259+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:28.448452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797750+0000","last_change":"2024-04-26T20:25:15.886667+0000","last_active":"2024-04-26T20:26:08.797750+0000","last_peered":"2024-04-26T20:26:08.797750+0000","last_clean":"2024-04-26T20:26:08.797750+0000","last_became_active":"2024-04-26T20:25:15.886338+0000","last_became_peered":"2024-04-26T20:25:15.886338+0000","last_unstale":"2024-04-26T20:26:08.797750+0000","last_undegraded":"2024-04-26T20:26:08.797750+0000","last_fullsized":"2024-04-26T20:26:08.797750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:20.666594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.797065+0000","last_change":"2024-04-26T20:25:15.895551+0000","last_active":"2024-04-26T20:26:08.797065+0000","last_peered":"2024-04-26T20:26:08.797065+0000","last_clean":"2024-04-26T20:26:08.797065+0000","last_became_active":"2024-04-26T20:25:15.895129+0000","last_became_peered":"2024-04-26T20:25:15.895129+0000","last_unstale":"2024-04-26T20:26:08.797065+0000","last_undegraded":"2024-04-26T20:26:08.797065+0000","last_fullsized":"2024-04-26T20:26:08.797065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.959022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113670+0000","last_change":"2024-04-26T20:25:15.895286+0000","last_active":"2024-04-26T20:26:09.113670+0000","last_peered":"2024-04-26T20:26:09.113670+0000","last_clean":"2024-04-26T20:26:09.113670+0000","last_became_active":"2024-04-26T20:25:15.894954+0000","last_became_peered":"2024-04-26T20:25:15.894954+0000","last_unstale":"2024-04-26T20:26:09.113670+0000","last_undegraded":"2024-04-26T20:26:09.113670+0000","last_fullsized":"2024-04-26T20:26:09.113670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:02.805037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795627+0000","last_change":"2024-04-26T20:25:15.896824+0000","last_active":"2024-04-26T20:26:08.795627+0000","last_peered":"2024-04-26T20:26:08.795627+0000","last_clean":"2024-04-26T20:26:08.795627+0000","last_became_active":"2024-04-26T20:25:15.896337+0000","last_became_peered":"2024-04-26T20:25:15.896337+0000","last_unstale":"2024-04-26T20:26:08.795627+0000","last_undegraded":"2024-04-26T20:26:08.795627+0000","last_fullsized":"2024-04-26T20:26:08.795627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:31.105915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800014+0000","last_change":"2024-04-26T20:25:15.890207+0000","last_active":"2024-04-26T20:26:08.800014+0000","last_peered":"2024-04-26T20:26:08.800014+0000","last_clean":"2024-04-26T20:26:08.800014+0000","last_became_active":"2024-04-26T20:25:15.889890+0000","last_became_peered":"2024-04-26T20:25:15.889890+0000","last_unstale":"2024-04-26T20:26:08.800014+0000","last_undegraded":"2024-04-26T20:26:08.800014+0000","last_fullsized":"2024-04-26T20:26:08.800014+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:44.562779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.920753+0000","last_change":"2024-04-26T20:26:08.920448+0000","last_active":"2024-04-26T20:26:08.920753+0000","last_peered":"2024-04-26T20:26:08.920753+0000","last_clean":"2024-04-26T20:26:08.920753+0000","last_became_active":"2024-04-26T20:26:08.920148+0000","last_became_peered":"2024-04-26T20:26:08.920148+0000","last_unstale":"2024-04-26T20:26:08.920753+0000","last_undegraded":"2024-04-26T20:26:08.920753+0000","last_fullsized":"2024-04-26T20:26:08.920753+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:47.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.800886+0000","last_change":"2024-04-26T20:25:15.895097+0000","last_active":"2024-04-26T20:26:08.800886+0000","last_peered":"2024-04-26T20:26:08.800886+0000","last_clean":"2024-04-26T20:26:08.800886+0000","last_became_active":"2024-04-26T20:25:15.894647+0000","last_became_peered":"2024-04-26T20:25:15.894647+0000","last_unstale":"2024-04-26T20:26:08.800886+0000","last_undegraded":"2024-04-26T20:26:08.800886+0000","last_fullsized":"2024-04-26T20:26:08.800886+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:48.651323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.459927+0000","last_change":"2024-04-26T20:25:15.886174+0000","last_active":"2024-04-26T20:26:09.459927+0000","last_peered":"2024-04-26T20:26:09.459927+0000","last_clean":"2024-04-26T20:26:09.459927+0000","last_became_active":"2024-04-26T20:25:15.885869+0000","last_became_peered":"2024-04-26T20:25:15.885869+0000","last_unstale":"2024-04-26T20:26:09.459927+0000","last_undegraded":"2024-04-26T20:26:09.459927+0000","last_fullsized":"2024-04-26T20:26:09.459927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:54.776504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.799224+0000","last_change":"2024-04-26T20:25:15.888377+0000","last_active":"2024-04-26T20:26:08.799224+0000","last_peered":"2024-04-26T20:26:08.799224+0000","last_clean":"2024-04-26T20:26:08.799224+0000","last_became_active":"2024-04-26T20:25:15.888042+0000","last_became_peered":"2024-04-26T20:25:15.888042+0000","last_unstale":"2024-04-26T20:26:08.799224+0000","last_undegraded":"2024-04-26T20:26:08.799224+0000","last_fullsized":"2024-04-26T20:26:08.799224+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:25.922321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:09.113111+0000","last_change":"2024-04-26T20:25:15.887255+0000","last_active":"2024-04-26T20:26:09.113111+0000","last_peered":"2024-04-26T20:26:09.113111+0000","last_clean":"2024-04-26T20:26:09.113111+0000","last_became_active":"2024-04-26T20:25:15.886936+0000","last_became_peered":"2024-04-26T20:25:15.886936+0000","last_unstale":"2024-04-26T20:26:09.113111+0000","last_undegraded":"2024-04-26T20:26:09.113111+0000","last_fullsized":"2024-04-26T20:26:09.113111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:54.135181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T20:26:08.795086+0000","last_change":"2024-04-26T20:25:15.893371+0000","last_active":"2024-04-26T20:26:08.795086+0000","last_peered":"2024-04-26T20:26:08.795086+0000","last_clean":"2024-04-26T20:26:08.795086+0000","last_became_active":"2024-04-26T20:25:15.892490+0000","last_became_peered":"2024-04-26T20:25:15.892490+0000","last_unstale":"2024-04-26T20:26:08.795086+0000","last_undegraded":"2024-04-26T20:26:08.795086+0000","last_fullsized":"2024-04-26T20:26:08.795086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:25:14.990980+0000","last_clean_scrub_stamp":"2024-04-26T20:25:14.990980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:39.337577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":211446,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58598,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":727,"num_read_kb":426,"num_write":233,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":51506,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":495616,"data_stored":175794,"data_compressed":12091,"data_compressed_allocated":20480,"data_compressed_original":65536,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351006,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":460472,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612643,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1101824,"data_stored":1102783,"data_compressed":43701,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776168,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":983040,"data_stored":459899,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037806,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":460165,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299442,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":1052795,"data_compressed":41841,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462968,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":511010,"data_compressed":14152,"data_compressed_allocated":20480,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":511923,"data_compressed":7641,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":461346,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":461140,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":459441,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888130,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":459868,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724605,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":1052082,"data_compressed":41841,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36060,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":53146,"data_compressed":1860,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":52116,"data_compressed":8371,"data_compressed_allocated":12288,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":53521,"data_compressed":1860,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:26:38.120 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T20:26:38.120 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T20:26:38.120 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-26T20:26:38.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-26T20:26:38.359 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:38 smithi098 ceph-mon[32591]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:26:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:38 smithi098 ceph-mon[32591]: pgmap v333: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:26:39.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:38 smithi080 ceph-mon[32278]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:26:39.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:38 smithi080 ceph-mon[32278]: pgmap v333: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:26:39.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:38 smithi070 ceph-mon[29124]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:26:39.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:38 smithi070 ceph-mon[29124]: pgmap v333: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:26:40.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.039+0000 7f2807ef5700 1 -- 172.21.15.70:0/589932001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2800107b70 msgr2=0x7f2800107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:40.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.039+0000 7f2807ef5700 1 --2- 172.21.15.70:0/589932001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2800107b70 0x7f2800107f50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009990 tx=0x7f27fc009ca0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.039+0000 7f2807ef5700 1 -- 172.21.15.70:0/589932001 shutdown_connections 2024-04-26T20:26:40.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.039+0000 7f2807ef5700 1 --2- 172.21.15.70:0/589932001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2800102780 0x7f280010e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.039+0000 7f2807ef5700 1 --2- 172.21.15.70:0/589932001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2800107b70 0x7f2800107f50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.039+0000 7f2807ef5700 1 --2- 172.21.15.70:0/589932001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2800101dc0 0x7f2800102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.039+0000 7f2807ef5700 1 -- 172.21.15.70:0/589932001 >> 172.21.15.70:0/589932001 conn(0x7f2800077640 msgr2=0x7f2800077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.040+0000 7f2807ef5700 1 -- 172.21.15.70:0/589932001 shutdown_connections 2024-04-26T20:26:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.040+0000 7f2807ef5700 1 -- 172.21.15.70:0/589932001 wait complete. 2024-04-26T20:26:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.040+0000 7f2807ef5700 1 Processor -- start 2024-04-26T20:26:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.040+0000 7f2807ef5700 1 -- start start 2024-04-26T20:26:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2807ef5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2800101dc0 0x7f280019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2807ef5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2800102780 0x7f280019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2807ef5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2800107b70 0x7f28001999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2807ef5700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2800113780 con 0x7f2800101dc0 2024-04-26T20:26:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2807ef5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2800113600 con 0x7f2800102780 2024-04-26T20:26:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2807ef5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2800113900 con 0x7f2800107b70 2024-04-26T20:26:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2805c91700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2800101dc0 0x7f280019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2805c91700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2800101dc0 0x7f280019f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52652/0 (socket says 172.21.15.70:52652) 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2805c91700 1 -- 172.21.15.70:0/2432481454 learned_addr learned my addr 172.21.15.70:0/2432481454 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2805490700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2800102780 0x7f280019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2806492700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2800107b70 0x7f28001999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2805c91700 1 -- 172.21.15.70:0/2432481454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2800107b70 msgr2=0x7f28001999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2805c91700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2800107b70 0x7f28001999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2805c91700 1 -- 172.21.15.70:0/2432481454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2800102780 msgr2=0x7f280019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2805c91700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2800102780 0x7f280019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2805c91700 1 -- 172.21.15.70:0/2432481454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280019a120 con 0x7f2800101dc0 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2806492700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2800107b70 0x7f28001999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2805c91700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2800101dc0 0x7f280019f800 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009590 tx=0x7f27fc009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f27f6ffd700 1 -- 172.21.15.70:0/2432481454 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc027070 con 0x7f2800101dc0 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f2807ef5700 1 -- 172.21.15.70:0/2432481454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f280019a3b0 con 0x7f2800101dc0 2024-04-26T20:26:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f27f6ffd700 1 -- 172.21.15.70:0/2432481454 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27fc003fb0 con 0x7f2800101dc0 2024-04-26T20:26:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.041+0000 7f27f6ffd700 1 -- 172.21.15.70:0/2432481454 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc022cd0 con 0x7f2800101dc0 2024-04-26T20:26:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.042+0000 7f2807ef5700 1 -- 172.21.15.70:0/2432481454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28001a66d0 con 0x7f2800101dc0 2024-04-26T20:26:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.042+0000 7f2807ef5700 1 -- 172.21.15.70:0/2432481454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f280010a050 con 0x7f2800101dc0 2024-04-26T20:26:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.043+0000 7f27f6ffd700 1 -- 172.21.15.70:0/2432481454 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f27fc02a070 con 0x7f2800101dc0 2024-04-26T20:26:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.044+0000 7f27f6ffd700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f27ec0a3cd0 0x7f27ec0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.044+0000 7f2805490700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f27ec0a3cd0 0x7f27ec0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.044+0000 7f27f6ffd700 1 -- 172.21.15.70:0/2432481454 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f27fc0d13b0 con 0x7f2800101dc0 2024-04-26T20:26:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.044+0000 7f2805490700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f27ec0a3cd0 0x7f27ec0a6190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2800077b40 tx=0x7f27f0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:40.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.049+0000 7f27f6ffd700 1 -- 172.21.15.70:0/2432481454 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f27fc05f060 con 0x7f2800101dc0 2024-04-26T20:26:40.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.293+0000 7f2807ef5700 1 -- 172.21.15.70:0/2432481454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f280006a110 con 0x7f2800101dc0 2024-04-26T20:26:40.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.294+0000 7f27f6ffd700 1 -- 172.21.15.70:0/2432481454 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f27fc013070 con 0x7f2800101dc0 2024-04-26T20:26:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:26:40.295 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T20:26:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 -- 172.21.15.70:0/2432481454 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f27ec0a3cd0 msgr2=0x7f27ec0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f27ec0a3cd0 0x7f27ec0a6190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2800077b40 tx=0x7f27f0009190 comp rx=0 tx=0).stop 2024-04-26T20:26:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 -- 172.21.15.70:0/2432481454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2800101dc0 msgr2=0x7f280019f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2800101dc0 0x7f280019f800 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009590 tx=0x7f27fc009f50 comp rx=0 tx=0).stop 2024-04-26T20:26:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 -- 172.21.15.70:0/2432481454 shutdown_connections 2024-04-26T20:26:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f27ec0a3cd0 0x7f27ec0a6190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2800107b70 0x7f28001999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2800101dc0 0x7f280019f800 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 --2- 172.21.15.70:0/2432481454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2800102780 0x7f280019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 -- 172.21.15.70:0/2432481454 >> 172.21.15.70:0/2432481454 conn(0x7f2800077640 msgr2=0x7f28000ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:40.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 -- 172.21.15.70:0/2432481454 shutdown_connections 2024-04-26T20:26:40.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:40.296+0000 7f2807ef5700 1 -- 172.21.15.70:0/2432481454 wait complete. 2024-04-26T20:26:40.985 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:40 smithi070 ceph-mon[29124]: pgmap v334: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:26:40.985 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:40 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2432481454' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T20:26:41.013 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-26T20:26:41.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:26:41.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.114+0000 7fc8a9f89640 1 -- 172.21.15.70:0/979155060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8a4102e90 msgr2=0x7fc8a41032b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.114+0000 7fc8a9f89640 1 --2- 172.21.15.70:0/979155060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8a4102e90 0x7fc8a41032b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc894009ca0 tx=0x7fc89402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.114+0000 7fc8a9f89640 1 -- 172.21.15.70:0/979155060 shutdown_connections 2024-04-26T20:26:41.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.114+0000 7fc8a9f89640 1 --2- 172.21.15.70:0/979155060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4102580 0x7fc8a4109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.114+0000 7fc8a9f89640 1 --2- 172.21.15.70:0/979155060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8a4101bc0 0x7fc8a4102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.114+0000 7fc8a9f89640 1 --2- 172.21.15.70:0/979155060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8a4102e90 0x7fc8a41032b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.114+0000 7fc8a9f89640 1 -- 172.21.15.70:0/979155060 >> 172.21.15.70:0/979155060 conn(0x7fc8a40fc5f0 msgr2=0x7fc8a40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:41.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.114+0000 7fc8a9f89640 1 -- 172.21.15.70:0/979155060 shutdown_connections 2024-04-26T20:26:41.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.114+0000 7fc8a9f89640 1 -- 172.21.15.70:0/979155060 wait complete. 2024-04-26T20:26:41.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.114+0000 7fc8a9f89640 1 Processor -- start 2024-04-26T20:26:41.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a9f89640 1 -- start start 2024-04-26T20:26:41.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a9f89640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8a4101bc0 0x7fc8a419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a9f89640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4102580 0x7fc8a419b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a9f89640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8a4102e90 0x7fc8a41a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a9f89640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a410d5e0 con 0x7fc8a4101bc0 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a9f89640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a410d460 con 0x7fc8a4102e90 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a9f89640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a410d760 con 0x7fc8a4102580 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8a4101bc0 0x7fc8a419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8a4101bc0 0x7fc8a419b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52672/0 (socket says 172.21.15.70:52672) 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a37fe640 1 -- 172.21.15.70:0/2220807054 learned_addr learned my addr 172.21.15.70:0/2220807054 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a3fff640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8a4102e90 0x7fc8a41a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a2ffd640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4102580 0x7fc8a419b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a37fe640 1 -- 172.21.15.70:0/2220807054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4102580 msgr2=0x7fc8a419b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a37fe640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4102580 0x7fc8a419b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a37fe640 1 -- 172.21.15.70:0/2220807054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8a4102e90 msgr2=0x7fc8a41a2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a37fe640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8a4102e90 0x7fc8a41a2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a37fe640 1 -- 172.21.15.70:0/2220807054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a41a2ca0 con 0x7fc8a4101bc0 2024-04-26T20:26:41.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.115+0000 7fc8a37fe640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8a4101bc0 0x7fc8a419b080 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8940039f0 tx=0x7fc894003a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:41.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.116+0000 7fc8a0ff9640 1 -- 172.21.15.70:0/2220807054 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc894004040 con 0x7fc8a4101bc0 2024-04-26T20:26:41.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.116+0000 7fc8a0ff9640 1 -- 172.21.15.70:0/2220807054 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc8940046b0 con 0x7fc8a4101bc0 2024-04-26T20:26:41.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.116+0000 7fc8a9f89640 1 -- 172.21.15.70:0/2220807054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a41a2f30 con 0x7fc8a4101bc0 2024-04-26T20:26:41.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.116+0000 7fc8a0ff9640 1 -- 172.21.15.70:0/2220807054 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8940305c0 con 0x7fc8a4101bc0 2024-04-26T20:26:41.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.116+0000 7fc8a9f89640 1 -- 172.21.15.70:0/2220807054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a41a3410 con 0x7fc8a4101bc0 2024-04-26T20:26:41.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.117+0000 7fc8a9f89640 1 -- 172.21.15.70:0/2220807054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a41a3640 con 0x7fc8a4101bc0 2024-04-26T20:26:41.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.118+0000 7fc8a0ff9640 1 -- 172.21.15.70:0/2220807054 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc89402f620 con 0x7fc8a4101bc0 2024-04-26T20:26:41.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.118+0000 7fc8a0ff9640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc88c0a3c40 0x7fc88c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.118+0000 7fc8a2ffd640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc88c0a3c40 0x7fc88c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.118+0000 7fc8a0ff9640 1 -- 172.21.15.70:0/2220807054 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fc8940f1c90 con 0x7fc8a4101bc0 2024-04-26T20:26:41.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.119+0000 7fc8a2ffd640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc88c0a3c40 0x7fc88c0a6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc8a419c590 tx=0x7fc898008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:41.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.123+0000 7fc8a0ff9640 1 -- 172.21.15.70:0/2220807054 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc8940f7020 con 0x7fc8a4101bc0 2024-04-26T20:26:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:40 smithi098 ceph-mon[32591]: pgmap v334: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:26:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:40 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2432481454' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T20:26:41.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:40 smithi080 ceph-mon[32278]: pgmap v334: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:26:41.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:40 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2432481454' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T20:26:41.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.301+0000 7fc8a9f89640 1 -- 172.21.15.70:0/2220807054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8a41a3810 con 0x7fc8a4101bc0 2024-04-26T20:26:41.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.303+0000 7fc8a0ff9640 1 -- 172.21.15.70:0/2220807054 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22646 (secure 0 0 0) 0x7fc8940be610 con 0x7fc8a4101bc0 2024-04-26T20:26:41.304 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:26:41.304 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:26:08.787018+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":6}]},{"pgid":"2.16","mappings":[{"from":2,"to":4},{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:26:41.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 -- 172.21.15.70:0/2220807054 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc88c0a3c40 msgr2=0x7fc88c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc88c0a3c40 0x7fc88c0a6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc8a419c590 tx=0x7fc898008040 comp rx=0 tx=0).stop 2024-04-26T20:26:41.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 -- 172.21.15.70:0/2220807054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8a4101bc0 msgr2=0x7fc8a419b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8a4101bc0 0x7fc8a419b080 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8940039f0 tx=0x7fc894003a20 comp rx=0 tx=0).stop 2024-04-26T20:26:41.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 -- 172.21.15.70:0/2220807054 shutdown_connections 2024-04-26T20:26:41.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc88c0a3c40 0x7fc88c0a6100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8a4102e90 0x7fc8a41a2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4102580 0x7fc8a419b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 --2- 172.21.15.70:0/2220807054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8a4101bc0 0x7fc8a419b080 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 -- 172.21.15.70:0/2220807054 >> 172.21.15.70:0/2220807054 conn(0x7fc8a40fc5f0 msgr2=0x7fc8a4100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:41.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 -- 172.21.15.70:0/2220807054 shutdown_connections 2024-04-26T20:26:41.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.305+0000 7fc8a9f89640 1 -- 172.21.15.70:0/2220807054 wait complete. 2024-04-26T20:26:41.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:20:33.781367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:25:13.606603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:25:14.309945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:26:41.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:26:41.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.417+0000 7fe5e13af640 1 -- 172.21.15.70:0/4017712092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5dc103450 msgr2=0x7fe5dc105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.417+0000 7fe5e13af640 1 --2- 172.21.15.70:0/4017712092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5dc103450 0x7fe5dc105840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009ca0 tx=0x7fe5cc02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.417+0000 7fe5e13af640 1 -- 172.21.15.70:0/4017712092 shutdown_connections 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.417+0000 7fe5e13af640 1 --2- 172.21.15.70:0/4017712092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5dc1086b0 0x7fe5dc10aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.417+0000 7fe5e13af640 1 --2- 172.21.15.70:0/4017712092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5dc105d80 0x7fe5dc108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.417+0000 7fe5e13af640 1 --2- 172.21.15.70:0/4017712092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5dc103450 0x7fe5dc105840 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.417+0000 7fe5e13af640 1 -- 172.21.15.70:0/4017712092 >> 172.21.15.70:0/4017712092 conn(0x7fe5dc0fce00 msgr2=0x7fe5dc0ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.417+0000 7fe5e13af640 1 -- 172.21.15.70:0/4017712092 shutdown_connections 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.417+0000 7fe5e13af640 1 -- 172.21.15.70:0/4017712092 wait complete. 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5e13af640 1 Processor -- start 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5e13af640 1 -- start start 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5e13af640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5dc103450 0x7fe5dc198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5e13af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5dc105d80 0x7fe5dc199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5e13af640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5dc1086b0 0x7fe5dc1a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5e13af640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc10e5f0 con 0x7fe5dc105d80 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5e13af640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc10e470 con 0x7fe5dc1086b0 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5e13af640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc10e770 con 0x7fe5dc103450 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5da7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5dc105d80 0x7fe5dc199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5da7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5dc105d80 0x7fe5dc199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52690/0 (socket says 172.21.15.70:52690) 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5da7fc640 1 -- 172.21.15.70:0/2950654033 learned_addr learned my addr 172.21.15.70:0/2950654033 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5db7fe640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5dc1086b0 0x7fe5dc1a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5daffd640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5dc103450 0x7fe5dc198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5da7fc640 1 -- 172.21.15.70:0/2950654033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5dc103450 msgr2=0x7fe5dc198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5da7fc640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5dc103450 0x7fe5dc198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5da7fc640 1 -- 172.21.15.70:0/2950654033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5dc1086b0 msgr2=0x7fe5dc1a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5da7fc640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5dc1086b0 0x7fe5dc1a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5da7fc640 1 -- 172.21.15.70:0/2950654033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc1a0900 con 0x7fe5dc105d80 2024-04-26T20:26:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5db7fe640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5dc1086b0 0x7fe5dc1a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.418+0000 7fe5da7fc640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5dc105d80 0x7fe5dc199230 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000d770 tx=0x7fe5d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.419+0000 7fe5c3fff640 1 -- 172.21.15.70:0/2950654033 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0017070 con 0x7fe5dc105d80 2024-04-26T20:26:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.419+0000 7fe5e13af640 1 -- 172.21.15.70:0/2950654033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5dc1a0bf0 con 0x7fe5dc105d80 2024-04-26T20:26:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.419+0000 7fe5c3fff640 1 -- 172.21.15.70:0/2950654033 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe5d0009c30 con 0x7fe5dc105d80 2024-04-26T20:26:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.419+0000 7fe5c3fff640 1 -- 172.21.15.70:0/2950654033 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d000f620 con 0x7fe5dc105d80 2024-04-26T20:26:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.419+0000 7fe5e13af640 1 -- 172.21.15.70:0/2950654033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5dc1a1140 con 0x7fe5dc105d80 2024-04-26T20:26:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.420+0000 7fe5e13af640 1 -- 172.21.15.70:0/2950654033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5dc0fe8f0 con 0x7fe5dc105d80 2024-04-26T20:26:41.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.421+0000 7fe5c3fff640 1 -- 172.21.15.70:0/2950654033 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe5d001a070 con 0x7fe5dc105d80 2024-04-26T20:26:41.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.421+0000 7fe5c3fff640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe5c40a3c40 0x7fe5c40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.421+0000 7fe5daffd640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe5c40a3c40 0x7fe5c40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.421+0000 7fe5c3fff640 1 -- 172.21.15.70:0/2950654033 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fe5d00d01a0 con 0x7fe5dc105d80 2024-04-26T20:26:41.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.422+0000 7fe5daffd640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe5c40a3c40 0x7fe5c40a6100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc004af0 tx=0x7fe5cc009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:41.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.425+0000 7fe5c3fff640 1 -- 172.21.15.70:0/2950654033 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fe5d0009de0 con 0x7fe5dc105d80 2024-04-26T20:26:41.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.603+0000 7fe5e13af640 1 -- 172.21.15.70:0/2950654033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe5dc02dc60 con 0x7fe5dc105d80 2024-04-26T20:26:41.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.603+0000 7fe5c3fff640 1 -- 172.21.15.70:0/2950654033 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7fe5d009ca10 con 0x7fe5dc105d80 2024-04-26T20:26:41.604 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-04-26T20:26:41.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 -- 172.21.15.70:0/2950654033 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe5c40a3c40 msgr2=0x7fe5c40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe5c40a3c40 0x7fe5c40a6100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc004af0 tx=0x7fe5cc009360 comp rx=0 tx=0).stop 2024-04-26T20:26:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 -- 172.21.15.70:0/2950654033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5dc105d80 msgr2=0x7fe5dc199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5dc105d80 0x7fe5dc199230 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000d770 tx=0x7fe5d000dc30 comp rx=0 tx=0).stop 2024-04-26T20:26:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 -- 172.21.15.70:0/2950654033 shutdown_connections 2024-04-26T20:26:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fe5c40a3c40 0x7fe5c40a6100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5dc1086b0 0x7fe5dc1a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5dc105d80 0x7fe5dc199230 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 --2- 172.21.15.70:0/2950654033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5dc103450 0x7fe5dc198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 -- 172.21.15.70:0/2950654033 >> 172.21.15.70:0/2950654033 conn(0x7fe5dc0fce00 msgr2=0x7fe5dc103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 -- 172.21.15.70:0/2950654033 shutdown_connections 2024-04-26T20:26:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.605+0000 7fe5e13af640 1 -- 172.21.15.70:0/2950654033 wait complete. 2024-04-26T20:26:41.618 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:26:41.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.718+0000 7f0c5294e640 1 -- 172.21.15.70:0/572067699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c4c105d30 msgr2=0x7f0c4c108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.718+0000 7f0c5294e640 1 --2- 172.21.15.70:0/572067699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c4c105d30 0x7f0c4c108120 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009900 tx=0x7f0c4002a410 comp rx=0 tx=0).stop 2024-04-26T20:26:41.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.718+0000 7f0c5294e640 1 -- 172.21.15.70:0/572067699 shutdown_connections 2024-04-26T20:26:41.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.718+0000 7f0c5294e640 1 --2- 172.21.15.70:0/572067699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c108660 0x7f0c4c10aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.718+0000 7f0c5294e640 1 --2- 172.21.15.70:0/572067699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c4c105d30 0x7f0c4c108120 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.718+0000 7f0c5294e640 1 --2- 172.21.15.70:0/572067699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c4c103400 0x7f0c4c1057f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.718+0000 7f0c5294e640 1 -- 172.21.15.70:0/572067699 >> 172.21.15.70:0/572067699 conn(0x7f0c4c0fce10 msgr2=0x7f0c4c0ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.718+0000 7f0c5294e640 1 -- 172.21.15.70:0/572067699 shutdown_connections 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.718+0000 7f0c5294e640 1 -- 172.21.15.70:0/572067699 wait complete. 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c5294e640 1 Processor -- start 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c5294e640 1 -- start start 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c5294e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c4c103400 0x7f0c4c198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c5294e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c4c105d30 0x7f0c4c199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c5294e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c108660 0x7f0c4c1a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c5294e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c10e5e0 con 0x7f0c4c105d30 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c5294e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c10e460 con 0x7f0c4c103400 2024-04-26T20:26:41.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c5294e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c10e760 con 0x7f0c4c108660 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c4b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c4c105d30 0x7f0c4c199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c4b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c4c105d30 0x7f0c4c199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52698/0 (socket says 172.21.15.70:52698) 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c4b7fe640 1 -- 172.21.15.70:0/1045039324 learned_addr learned my addr 172.21.15.70:0/1045039324 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c50eeb640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c108660 0x7f0c4c1a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c4bfff640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c4c103400 0x7f0c4c198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c4b7fe640 1 -- 172.21.15.70:0/1045039324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c108660 msgr2=0x7f0c4c1a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c4b7fe640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c108660 0x7f0c4c1a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c4b7fe640 1 -- 172.21.15.70:0/1045039324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c4c103400 msgr2=0x7f0c4c198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c4b7fe640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c4c103400 0x7f0c4c198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c4b7fe640 1 -- 172.21.15.70:0/1045039324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c1a0900 con 0x7f0c4c105d30 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.719+0000 7f0c4b7fe640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c4c105d30 0x7f0c4c199200 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0c40006010 tx=0x7f0c400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:41.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.720+0000 7f0c497fa640 1 -- 172.21.15.70:0/1045039324 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4003f030 con 0x7f0c4c105d30 2024-04-26T20:26:41.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.720+0000 7f0c5294e640 1 -- 172.21.15.70:0/1045039324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4c1a0b90 con 0x7f0c4c105d30 2024-04-26T20:26:41.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.720+0000 7f0c497fa640 1 -- 172.21.15.70:0/1045039324 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0c40003cd0 con 0x7f0c4c105d30 2024-04-26T20:26:41.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.720+0000 7f0c497fa640 1 -- 172.21.15.70:0/1045039324 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40035070 con 0x7f0c4c105d30 2024-04-26T20:26:41.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.720+0000 7f0c5294e640 1 -- 172.21.15.70:0/1045039324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c4c1a1080 con 0x7f0c4c105d30 2024-04-26T20:26:41.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.721+0000 7f0c5294e640 1 -- 172.21.15.70:0/1045039324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c4c0fe900 con 0x7f0c4c105d30 2024-04-26T20:26:41.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.722+0000 7f0c497fa640 1 -- 172.21.15.70:0/1045039324 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0c40042030 con 0x7f0c4c105d30 2024-04-26T20:26:41.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.722+0000 7f0c497fa640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c340a3c40 0x7f0c340a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.722+0000 7f0c4bfff640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c340a3c40 0x7f0c340a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.723+0000 7f0c497fa640 1 -- 172.21.15.70:0/1045039324 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f0c400f0c60 con 0x7f0c4c105d30 2024-04-26T20:26:41.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.723+0000 7f0c4bfff640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c340a3c40 0x7f0c340a6100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c005fd0 tx=0x7f0c3c005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:41.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.727+0000 7f0c497fa640 1 -- 172.21.15.70:0/1045039324 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f0c400bd4d0 con 0x7f0c4c105d30 2024-04-26T20:26:41.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.907+0000 7f0c5294e640 1 -- 172.21.15.70:0/1045039324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0c4c02dcd0 con 0x7f0c4c105d30 2024-04-26T20:26:41.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.908+0000 7f0c497fa640 1 -- 172.21.15.70:0/1045039324 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f0c400bcdd0 con 0x7f0c4c105d30 2024-04-26T20:26:41.909 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-04-26T20:26:41.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 -- 172.21.15.70:0/1045039324 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c340a3c40 msgr2=0x7f0c340a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c340a3c40 0x7f0c340a6100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c005fd0 tx=0x7f0c3c005c70 comp rx=0 tx=0).stop 2024-04-26T20:26:41.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 -- 172.21.15.70:0/1045039324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c4c105d30 msgr2=0x7f0c4c199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c4c105d30 0x7f0c4c199200 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0c40006010 tx=0x7f0c400042f0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 -- 172.21.15.70:0/1045039324 shutdown_connections 2024-04-26T20:26:41.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0c340a3c40 0x7f0c340a6100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c108660 0x7f0c4c1a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c4c105d30 0x7f0c4c199200 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 --2- 172.21.15.70:0/1045039324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c4c103400 0x7f0c4c198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 -- 172.21.15.70:0/1045039324 >> 172.21.15.70:0/1045039324 conn(0x7f0c4c0fce10 msgr2=0x7f0c4c103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:41.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 -- 172.21.15.70:0/1045039324 shutdown_connections 2024-04-26T20:26:41.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:41.910+0000 7f0c5294e640 1 -- 172.21.15.70:0/1045039324 wait complete. 2024-04-26T20:26:41.921 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:41 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2220807054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:26:41.921 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:41 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2950654033' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:26:41.922 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:26:42.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.022+0000 7f1448140640 1 -- 172.21.15.70:0/740348658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1440102200 msgr2=0x7f1440102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.022+0000 7f1448140640 1 --2- 172.21.15.70:0/740348658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1440102200 0x7f1440102680 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1434009900 tx=0x7f143402a410 comp rx=0 tx=0).stop 2024-04-26T20:26:42.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.022+0000 7f1448140640 1 -- 172.21.15.70:0/740348658 shutdown_connections 2024-04-26T20:26:42.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.022+0000 7f1448140640 1 --2- 172.21.15.70:0/740348658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1440102bc0 0x7f1440109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.022+0000 7f1448140640 1 --2- 172.21.15.70:0/740348658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1440102200 0x7f1440102680 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.022+0000 7f1448140640 1 --2- 172.21.15.70:0/740348658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1440101010 0x7f1440101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.022+0000 7f1448140640 1 -- 172.21.15.70:0/740348658 >> 172.21.15.70:0/740348658 conn(0x7f14400fc560 msgr2=0x7f14400fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:42.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.022+0000 7f1448140640 1 -- 172.21.15.70:0/740348658 shutdown_connections 2024-04-26T20:26:42.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.022+0000 7f1448140640 1 -- 172.21.15.70:0/740348658 wait complete. 2024-04-26T20:26:42.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f1448140640 1 Processor -- start 2024-04-26T20:26:42.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f1448140640 1 -- start start 2024-04-26T20:26:42.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f1448140640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1440101010 0x7f1440198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f1448140640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1440102200 0x7f1440199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f1448140640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1440102bc0 0x7f14401a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f1448140640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f144010e600 con 0x7f1440102200 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f1448140640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f144010e480 con 0x7f1440102bc0 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f1448140640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f144010e780 con 0x7f1440101010 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f14456db640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1440102200 0x7f1440199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f14456db640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1440102200 0x7f1440199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52710/0 (socket says 172.21.15.70:52710) 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f14456db640 1 -- 172.21.15.70:0/3765698094 learned_addr learned my addr 172.21.15.70:0/3765698094 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f1445edc640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1440101010 0x7f1440198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f14466dd640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1440102bc0 0x7f14401a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f14456db640 1 -- 172.21.15.70:0/3765698094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1440101010 msgr2=0x7f1440198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f14456db640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1440101010 0x7f1440198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f14456db640 1 -- 172.21.15.70:0/3765698094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1440102bc0 msgr2=0x7f14401a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f14456db640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1440102bc0 0x7f14401a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f14456db640 1 -- 172.21.15.70:0/3765698094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14401a0810 con 0x7f1440102200 2024-04-26T20:26:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f14466dd640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1440102bc0 0x7f14401a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.023+0000 7f14456db640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1440102200 0x7f1440199130 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1434005940 tx=0x7f14340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.024+0000 7f143effd640 1 -- 172.21.15.70:0/3765698094 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143403f030 con 0x7f1440102200 2024-04-26T20:26:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.024+0000 7f143effd640 1 -- 172.21.15.70:0/3765698094 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1434003cd0 con 0x7f1440102200 2024-04-26T20:26:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.024+0000 7f143effd640 1 -- 172.21.15.70:0/3765698094 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434035070 con 0x7f1440102200 2024-04-26T20:26:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.024+0000 7f1448140640 1 -- 172.21.15.70:0/3765698094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14401a0aa0 con 0x7f1440102200 2024-04-26T20:26:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.024+0000 7f1448140640 1 -- 172.21.15.70:0/3765698094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14401a0f90 con 0x7f1440102200 2024-04-26T20:26:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.025+0000 7f1448140640 1 -- 172.21.15.70:0/3765698094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1440108330 con 0x7f1440102200 2024-04-26T20:26:42.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.026+0000 7f143effd640 1 -- 172.21.15.70:0/3765698094 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1434042030 con 0x7f1440102200 2024-04-26T20:26:42.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.026+0000 7f143effd640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f14280a3c40 0x7f14280a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.026+0000 7f1445edc640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f14280a3c40 0x7f14280a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.026+0000 7f143effd640 1 -- 172.21.15.70:0/3765698094 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f14340f0d80 con 0x7f1440102200 2024-04-26T20:26:42.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.027+0000 7f1445edc640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f14280a3c40 0x7f14280a6100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1440102060 tx=0x7f1438007600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:42.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.030+0000 7f143effd640 1 -- 172.21.15.70:0/3765698094 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f14340bd5f0 con 0x7f1440102200 2024-04-26T20:26:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.207+0000 7f1448140640 1 -- 172.21.15.70:0/3765698094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f144002dd20 con 0x7f1440102200 2024-04-26T20:26:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.207+0000 7f143effd640 1 -- 172.21.15.70:0/3765698094 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f14340bcef0 con 0x7f1440102200 2024-04-26T20:26:42.208 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-04-26T20:26:42.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:41 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2220807054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:26:42.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:41 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2950654033' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:26:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 -- 172.21.15.70:0/3765698094 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f14280a3c40 msgr2=0x7f14280a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f14280a3c40 0x7f14280a6100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1440102060 tx=0x7f1438007600 comp rx=0 tx=0).stop 2024-04-26T20:26:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 -- 172.21.15.70:0/3765698094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1440102200 msgr2=0x7f1440199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1440102200 0x7f1440199130 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1434005940 tx=0x7f14340042f0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 -- 172.21.15.70:0/3765698094 shutdown_connections 2024-04-26T20:26:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f14280a3c40 0x7f14280a6100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1440102bc0 0x7f14401a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1440102200 0x7f1440199130 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 --2- 172.21.15.70:0/3765698094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1440101010 0x7f1440198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 -- 172.21.15.70:0/3765698094 >> 172.21.15.70:0/3765698094 conn(0x7f14400fc560 msgr2=0x7f1440105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 -- 172.21.15.70:0/3765698094 shutdown_connections 2024-04-26T20:26:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.209+0000 7f1448140640 1 -- 172.21.15.70:0/3765698094 wait complete. 2024-04-26T20:26:42.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:41 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2220807054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:26:42.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:41 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2950654033' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:26:42.221 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:26:42.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.318+0000 7f8122997640 1 -- 172.21.15.70:0/1044679357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f811c1034d0 msgr2=0x7f811c1058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.318+0000 7f8122997640 1 --2- 172.21.15.70:0/1044679357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f811c1034d0 0x7f811c1058c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8110009900 tx=0x7f811002a410 comp rx=0 tx=0).stop 2024-04-26T20:26:42.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.318+0000 7f8122997640 1 -- 172.21.15.70:0/1044679357 shutdown_connections 2024-04-26T20:26:42.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.318+0000 7f8122997640 1 --2- 172.21.15.70:0/1044679357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c108730 0x7f811c10ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.318+0000 7f8122997640 1 --2- 172.21.15.70:0/1044679357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c105e00 0x7f811c1081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.318+0000 7f8122997640 1 --2- 172.21.15.70:0/1044679357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f811c1034d0 0x7f811c1058c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.318+0000 7f8122997640 1 -- 172.21.15.70:0/1044679357 >> 172.21.15.70:0/1044679357 conn(0x7f811c0fce60 msgr2=0x7f811c0ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:42.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.318+0000 7f8122997640 1 -- 172.21.15.70:0/1044679357 shutdown_connections 2024-04-26T20:26:42.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.318+0000 7f8122997640 1 -- 172.21.15.70:0/1044679357 wait complete. 2024-04-26T20:26:42.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.318+0000 7f8122997640 1 Processor -- start 2024-04-26T20:26:42.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.318+0000 7f8122997640 1 -- start start 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f8122997640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1034d0 0x7f811c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f8122997640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f811c105e00 0x7f811c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f8122997640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c108730 0x7f811c1a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f8122997640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f811c10e600 con 0x7f811c105e00 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f8122997640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f811c10e480 con 0x7f811c1034d0 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f8122997640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f811c10e780 con 0x7f811c108730 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f811b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f811c105e00 0x7f811c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f811b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f811c105e00 0x7f811c199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52734/0 (socket says 172.21.15.70:52734) 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f811b7fe640 1 -- 172.21.15.70:0/817933184 learned_addr learned my addr 172.21.15.70:0/817933184 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f811bfff640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1034d0 0x7f811c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f811b7fe640 1 -- 172.21.15.70:0/817933184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c108730 msgr2=0x7f811c1a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f811b7fe640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c108730 0x7f811c1a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f811b7fe640 1 -- 172.21.15.70:0/817933184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1034d0 msgr2=0x7f811c198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f811b7fe640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1034d0 0x7f811c198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f811b7fe640 1 -- 172.21.15.70:0/817933184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c1a0900 con 0x7f811c105e00 2024-04-26T20:26:42.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f811b7fe640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f811c105e00 0x7f811c199250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f810c00d770 tx=0x7f810c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:42.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f81197fa640 1 -- 172.21.15.70:0/817933184 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c017070 con 0x7f811c105e00 2024-04-26T20:26:42.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f81197fa640 1 -- 172.21.15.70:0/817933184 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f810c009c30 con 0x7f811c105e00 2024-04-26T20:26:42.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f8122997640 1 -- 172.21.15.70:0/817933184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c1a0bf0 con 0x7f811c105e00 2024-04-26T20:26:42.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f81197fa640 1 -- 172.21.15.70:0/817933184 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c00f620 con 0x7f811c105e00 2024-04-26T20:26:42.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.319+0000 7f8122997640 1 -- 172.21.15.70:0/817933184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c1a1190 con 0x7f811c105e00 2024-04-26T20:26:42.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.320+0000 7f8122997640 1 -- 172.21.15.70:0/817933184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c0fe950 con 0x7f811c105e00 2024-04-26T20:26:42.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.321+0000 7f81197fa640 1 -- 172.21.15.70:0/817933184 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f810c01a070 con 0x7f811c105e00 2024-04-26T20:26:42.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.322+0000 7f81197fa640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f81040a3cc0 0x7f81040a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.322+0000 7f811bfff640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f81040a3cc0 0x7f81040a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.322+0000 7f81197fa640 1 -- 172.21.15.70:0/817933184 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f810c0d0040 con 0x7f811c105e00 2024-04-26T20:26:42.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.322+0000 7f811bfff640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f81040a3cc0 0x7f81040a6180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8110000c00 tx=0x7f8110031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:42.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.326+0000 7f81197fa640 1 -- 172.21.15.70:0/817933184 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f810c009de0 con 0x7f811c105e00 2024-04-26T20:26:42.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.538+0000 7f8122997640 1 -- 172.21.15.70:0/817933184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f811c02dd20 con 0x7f811c105e00 2024-04-26T20:26:42.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.539+0000 7f81197fa640 1 -- 172.21.15.70:0/817933184 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7f810c09c8f0 con 0x7f811c105e00 2024-04-26T20:26:42.540 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:26:42.540 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:25:15.345214+0000","modified":"2024-04-26T20:25:22.041593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24488,"mds_1":24481,"mds_2":24463,"mds_3":24461,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3333683222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3333683222},{"type":"v1","addr":"172.21.15.70:6841","nonce":3333683222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":3,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":1,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6839/4099319394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4099319394},{"type":"v1","addr":"172.21.15.80:6839","nonce":4099319394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24481,24488,24463,24461,24451]},"id":1}]} 2024-04-26T20:26:42.541 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.541+0000 7f8122997640 1 -- 172.21.15.70:0/817933184 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f81040a3cc0 msgr2=0x7f81040a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.541+0000 7f8122997640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f81040a3cc0 0x7f81040a6180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8110000c00 tx=0x7f8110031510 comp rx=0 tx=0).stop 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.541+0000 7f8122997640 1 -- 172.21.15.70:0/817933184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f811c105e00 msgr2=0x7f811c199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.541+0000 7f8122997640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f811c105e00 0x7f811c199250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f810c00d770 tx=0x7f810c00dc30 comp rx=0 tx=0).stop 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.542+0000 7f8122997640 1 -- 172.21.15.70:0/817933184 shutdown_connections 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.542+0000 7f8122997640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f81040a3cc0 0x7f81040a6180 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.542+0000 7f8122997640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f811c108730 0x7f811c1a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.542+0000 7f8122997640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f811c105e00 0x7f811c199250 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.542+0000 7f8122997640 1 --2- 172.21.15.70:0/817933184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1034d0 0x7f811c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.542+0000 7f8122997640 1 -- 172.21.15.70:0/817933184 >> 172.21.15.70:0/817933184 conn(0x7f811c0fce60 msgr2=0x7f811c103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.542+0000 7f8122997640 1 -- 172.21.15.70:0/817933184 shutdown_connections 2024-04-26T20:26:42.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.542+0000 7f8122997640 1 -- 172.21.15.70:0/817933184 wait complete. 2024-04-26T20:26:42.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:26:42.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.651+0000 7f744894e640 1 -- 172.21.15.70:0/3668023227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444103b90 msgr2=0x7f7444104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.651+0000 7f744894e640 1 --2- 172.21.15.70:0/3668023227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444103b90 0x7f7444104010 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7434009900 tx=0x7f743402a410 comp rx=0 tx=0).stop 2024-04-26T20:26:42.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 -- 172.21.15.70:0/3668023227 shutdown_connections 2024-04-26T20:26:42.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 --2- 172.21.15.70:0/3668023227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7444104550 0x7f744410ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 --2- 172.21.15.70:0/3668023227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444103b90 0x7f7444104010 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 --2- 172.21.15.70:0/3668023227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74441029a0 0x7f7444102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 -- 172.21.15.70:0/3668023227 >> 172.21.15.70:0/3668023227 conn(0x7f74440fdf10 msgr2=0x7f7444100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 -- 172.21.15.70:0/3668023227 shutdown_connections 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 -- 172.21.15.70:0/3668023227 wait complete. 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 Processor -- start 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 -- start start 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74441029a0 0x7f7444198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7444103b90 0x7f74441993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444104550 0x7f74441a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f744410e700 con 0x7f7444104550 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f744410e580 con 0x7f7444103b90 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.652+0000 7f744894e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f744410e880 con 0x7f74441029a0 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f7442d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444104550 0x7f74441a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f7442d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444104550 0x7f74441a03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52746/0 (socket says 172.21.15.70:52746) 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f7442d9d640 1 -- 172.21.15.70:0/453887691 learned_addr learned my addr 172.21.15.70:0/453887691 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f7441d9b640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7444103b90 0x7f74441993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f744259c640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74441029a0 0x7f7444198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f7442d9d640 1 -- 172.21.15.70:0/453887691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74441029a0 msgr2=0x7f7444198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f7442d9d640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74441029a0 0x7f7444198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f7442d9d640 1 -- 172.21.15.70:0/453887691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7444103b90 msgr2=0x7f74441993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f7442d9d640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7444103b90 0x7f74441993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f7442d9d640 1 -- 172.21.15.70:0/453887691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74441a0a20 con 0x7f7444104550 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f7442d9d640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444104550 0x7f74441a03b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f743c00b970 tx=0x7f743c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f74337fe640 1 -- 172.21.15.70:0/453887691 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c019070 con 0x7f7444104550 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f74337fe640 1 -- 172.21.15.70:0/453887691 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f743c00cb40 con 0x7f7444104550 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f744894e640 1 -- 172.21.15.70:0/453887691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74441a0d10 con 0x7f7444104550 2024-04-26T20:26:42.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f74337fe640 1 -- 172.21.15.70:0/453887691 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c007650 con 0x7f7444104550 2024-04-26T20:26:42.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.653+0000 7f744894e640 1 -- 172.21.15.70:0/453887691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74441a12a0 con 0x7f7444104550 2024-04-26T20:26:42.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.654+0000 7f744894e640 1 -- 172.21.15.70:0/453887691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7444109d10 con 0x7f7444104550 2024-04-26T20:26:42.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.655+0000 7f74337fe640 1 -- 172.21.15.70:0/453887691 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f743c01c070 con 0x7f7444104550 2024-04-26T20:26:42.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.656+0000 7f74337fe640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f742c0a3cc0 0x7f742c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.656+0000 7f744259c640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f742c0a3cc0 0x7f742c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.656+0000 7f74337fe640 1 -- 172.21.15.70:0/453887691 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f743c0cfe00 con 0x7f7444104550 2024-04-26T20:26:42.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.657+0000 7f744259c640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f742c0a3cc0 0x7f742c0a6180 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f74441039f0 tx=0x7f7438008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:42.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.660+0000 7f74337fe640 1 -- 172.21.15.70:0/453887691 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f743c09c130 con 0x7f7444104550 2024-04-26T20:26:42.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.840+0000 7f744894e640 1 -- 172.21.15.70:0/453887691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7444063530 con 0x7f7444104550 2024-04-26T20:26:42.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.842+0000 7f74337fe640 1 -- 172.21.15.70:0/453887691 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22646 (secure 0 0 0) 0x7f743c0a0430 con 0x7f7444104550 2024-04-26T20:26:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:26:42.843 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:26:08.787018+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":6}]},{"pgid":"2.16","mappings":[{"from":2,"to":4},{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:26:42.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 -- 172.21.15.70:0/453887691 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f742c0a3cc0 msgr2=0x7f742c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f742c0a3cc0 0x7f742c0a6180 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f74441039f0 tx=0x7f7438008040 comp rx=0 tx=0).stop 2024-04-26T20:26:42.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 -- 172.21.15.70:0/453887691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444104550 msgr2=0x7f74441a03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444104550 0x7f74441a03b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f743c00b970 tx=0x7f743c00be30 comp rx=0 tx=0).stop 2024-04-26T20:26:42.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 -- 172.21.15.70:0/453887691 shutdown_connections 2024-04-26T20:26:42.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f742c0a3cc0 0x7f742c0a6180 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444104550 0x7f74441a03b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7444103b90 0x7f74441993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 --2- 172.21.15.70:0/453887691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74441029a0 0x7f7444198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 -- 172.21.15.70:0/453887691 >> 172.21.15.70:0/453887691 conn(0x7f74440fdf10 msgr2=0x7f7444106ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:42.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 -- 172.21.15.70:0/453887691 shutdown_connections 2024-04-26T20:26:42.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.844+0000 7f744894e640 1 -- 172.21.15.70:0/453887691 wait complete. 2024-04-26T20:26:42.856 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:20:33.781367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:25:13.606603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:25:14.309945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:26:42.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:26:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.957+0000 7f07451a4640 1 -- 172.21.15.70:0/414432873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07401046a0 msgr2=0x7f074010af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.957+0000 7f07451a4640 1 --2- 172.21.15.70:0/414432873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07401046a0 0x7f074010af30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0738009cd0 tx=0x7f073802a8e0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.957+0000 7f07451a4640 1 -- 172.21.15.70:0/414432873 shutdown_connections 2024-04-26T20:26:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.957+0000 7f07451a4640 1 --2- 172.21.15.70:0/414432873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07401046a0 0x7f074010af30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.957+0000 7f07451a4640 1 --2- 172.21.15.70:0/414432873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0740103ce0 0x7f0740104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.957+0000 7f07451a4640 1 --2- 172.21.15.70:0/414432873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0740100c70 0x7f0740101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.957+0000 7f07451a4640 1 -- 172.21.15.70:0/414432873 >> 172.21.15.70:0/414432873 conn(0x7f07400fc560 msgr2=0x7f07400fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.957+0000 7f07451a4640 1 -- 172.21.15.70:0/414432873 shutdown_connections 2024-04-26T20:26:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.957+0000 7f07451a4640 1 -- 172.21.15.70:0/414432873 wait complete. 2024-04-26T20:26:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.957+0000 7f07451a4640 1 Processor -- start 2024-04-26T20:26:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f07451a4640 1 -- start start 2024-04-26T20:26:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f07451a4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0740100c70 0x7f0740198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f07451a4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0740103ce0 0x7f0740199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f07451a4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07401046a0 0x7f07401a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f07451a4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f074010e600 con 0x7f07401046a0 2024-04-26T20:26:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f07451a4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f074010e480 con 0x7f0740100c70 2024-04-26T20:26:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f07451a4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f074010e780 con 0x7f0740103ce0 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073f59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07401046a0 0x7f07401a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073f59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07401046a0 0x7f07401a02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52762/0 (socket says 172.21.15.70:52762) 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073f59e640 1 -- 172.21.15.70:0/2190793331 learned_addr learned my addr 172.21.15.70:0/2190793331 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073ed9d640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0740100c70 0x7f0740198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073e59c640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0740103ce0 0x7f0740199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073f59e640 1 -- 172.21.15.70:0/2190793331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0740103ce0 msgr2=0x7f0740199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073f59e640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0740103ce0 0x7f0740199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073f59e640 1 -- 172.21.15.70:0/2190793331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0740100c70 msgr2=0x7f0740198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073f59e640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0740100c70 0x7f0740198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073f59e640 1 -- 172.21.15.70:0/2190793331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07401a0940 con 0x7f07401046a0 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073ed9d640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0740100c70 0x7f0740198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f073f59e640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07401046a0 0x7f07401a02a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f07380317d0 tx=0x7f0738003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:42.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f0727fff640 1 -- 172.21.15.70:0/2190793331 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738004450 con 0x7f07401046a0 2024-04-26T20:26:42.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f0727fff640 1 -- 172.21.15.70:0/2190793331 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f07380045f0 con 0x7f07401046a0 2024-04-26T20:26:42.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f07451a4640 1 -- 172.21.15.70:0/2190793331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07401a0bd0 con 0x7f07401046a0 2024-04-26T20:26:42.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f0727fff640 1 -- 172.21.15.70:0/2190793331 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738045670 con 0x7f07401046a0 2024-04-26T20:26:42.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.958+0000 7f07451a4640 1 -- 172.21.15.70:0/2190793331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07401a1120 con 0x7f07401046a0 2024-04-26T20:26:42.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.959+0000 7f07451a4640 1 -- 172.21.15.70:0/2190793331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0740109e10 con 0x7f07401046a0 2024-04-26T20:26:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.960+0000 7f0727fff640 1 -- 172.21.15.70:0/2190793331 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0738043020 con 0x7f07401046a0 2024-04-26T20:26:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.961+0000 7f0727fff640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f07280a3c40 0x7f07280a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.961+0000 7f073ed9d640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f07280a3c40 0x7f07280a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.961+0000 7f0727fff640 1 -- 172.21.15.70:0/2190793331 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f073802e030 con 0x7f07401046a0 2024-04-26T20:26:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.961+0000 7f073ed9d640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f07280a3c40 0x7f07280a6100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f074019a200 tx=0x7f073000b6b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:42.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:42.965+0000 7f0727fff640 1 -- 172.21.15.70:0/2190793331 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f073804a060 con 0x7f07401046a0 2024-04-26T20:26:43.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.148+0000 7f07451a4640 1 -- 172.21.15.70:0/2190793331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f074002dd20 con 0x7f07401046a0 2024-04-26T20:26:43.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.149+0000 7f0727fff640 1 -- 172.21.15.70:0/2190793331 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f07380be170 con 0x7f07401046a0 2024-04-26T20:26:43.150 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-04-26T20:26:43.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 -- 172.21.15.70:0/2190793331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f07280a3c40 msgr2=0x7f07280a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f07280a3c40 0x7f07280a6100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f074019a200 tx=0x7f073000b6b0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 -- 172.21.15.70:0/2190793331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07401046a0 msgr2=0x7f07401a02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07401046a0 0x7f07401a02a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f07380317d0 tx=0x7f0738003ce0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 -- 172.21.15.70:0/2190793331 shutdown_connections 2024-04-26T20:26:43.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f07280a3c40 0x7f07280a6100 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07401046a0 0x7f07401a02a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0740103ce0 0x7f0740199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 --2- 172.21.15.70:0/2190793331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0740100c70 0x7f0740198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 -- 172.21.15.70:0/2190793331 >> 172.21.15.70:0/2190793331 conn(0x7f07400fc560 msgr2=0x7f0740106fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:43.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 -- 172.21.15.70:0/2190793331 shutdown_connections 2024-04-26T20:26:43.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.151+0000 7f07451a4640 1 -- 172.21.15.70:0/2190793331 wait complete. 2024-04-26T20:26:43.162 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:42 smithi070 ceph-mon[29124]: pgmap v335: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:26:43.162 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:42 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1045039324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:26:43.162 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:42 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3765698094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:26:43.162 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:42 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/817933184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:43.163 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:42 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/453887691' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:26:43.163 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:26:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:42 smithi098 ceph-mon[32591]: pgmap v335: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:26:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:42 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1045039324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:26:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:42 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3765698094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:26:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:42 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/817933184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:43.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:42 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/453887691' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:26:43.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:42 smithi080 ceph-mon[32278]: pgmap v335: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:26:43.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:42 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1045039324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:26:43.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:42 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3765698094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:26:43.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:42 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/817933184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:43.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:42 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/453887691' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:26:43.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.263+0000 7efef8787640 1 -- 172.21.15.70:0/3707668217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efef0100c50 msgr2=0x7efef0101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.263+0000 7efef8787640 1 --2- 172.21.15.70:0/3707668217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efef0100c50 0x7efef0101070 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efeec009cd0 tx=0x7efeec02a8e0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.263+0000 7efef8787640 1 -- 172.21.15.70:0/3707668217 shutdown_connections 2024-04-26T20:26:43.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.263+0000 7efef8787640 1 --2- 172.21.15.70:0/3707668217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efef01045e0 0x7efef010ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.263+0000 7efef8787640 1 --2- 172.21.15.70:0/3707668217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efef0103c20 0x7efef01040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.263+0000 7efef8787640 1 --2- 172.21.15.70:0/3707668217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efef0100c50 0x7efef0101070 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.263+0000 7efef8787640 1 -- 172.21.15.70:0/3707668217 >> 172.21.15.70:0/3707668217 conn(0x7efef00fc560 msgr2=0x7efef00fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.263+0000 7efef8787640 1 -- 172.21.15.70:0/3707668217 shutdown_connections 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.263+0000 7efef8787640 1 -- 172.21.15.70:0/3707668217 wait complete. 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef8787640 1 Processor -- start 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef8787640 1 -- start start 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef8787640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efef0100c50 0x7efef0198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef8787640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efef0103c20 0x7efef0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef8787640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efef01045e0 0x7efef01a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef8787640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efef010e610 con 0x7efef01045e0 2024-04-26T20:26:43.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef8787640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efef010e490 con 0x7efef0100c50 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef8787640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efef010e790 con 0x7efef0103c20 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef6d24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efef01045e0 0x7efef01a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef6d24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efef01045e0 0x7efef01a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52788/0 (socket says 172.21.15.70:52788) 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef6d24640 1 -- 172.21.15.70:0/3074667032 learned_addr learned my addr 172.21.15.70:0/3074667032 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef6523640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efef0100c50 0x7efef0198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef6d24640 1 -- 172.21.15.70:0/3074667032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efef0103c20 msgr2=0x7efef0199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef6d24640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efef0103c20 0x7efef0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef6d24640 1 -- 172.21.15.70:0/3074667032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efef0100c50 msgr2=0x7efef0198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef6d24640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efef0100c50 0x7efef0198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.264+0000 7efef6d24640 1 -- 172.21.15.70:0/3074667032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef01a0920 con 0x7efef01045e0 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.265+0000 7efef6d24640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efef01045e0 0x7efef01a0280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efee800c970 tx=0x7efee800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.265+0000 7efee77fe640 1 -- 172.21.15.70:0/3074667032 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8007bb0 con 0x7efef01045e0 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.265+0000 7efee77fe640 1 -- 172.21.15.70:0/3074667032 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efee8007d50 con 0x7efef01045e0 2024-04-26T20:26:43.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.265+0000 7efef8787640 1 -- 172.21.15.70:0/3074667032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef01a0c10 con 0x7efef01045e0 2024-04-26T20:26:43.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.265+0000 7efee77fe640 1 -- 172.21.15.70:0/3074667032 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee800f450 con 0x7efef01045e0 2024-04-26T20:26:43.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.265+0000 7efef8787640 1 -- 172.21.15.70:0/3074667032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef01a11b0 con 0x7efef01045e0 2024-04-26T20:26:43.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.266+0000 7efef8787640 1 -- 172.21.15.70:0/3074667032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef0109dd0 con 0x7efef01045e0 2024-04-26T20:26:43.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.267+0000 7efee77fe640 1 -- 172.21.15.70:0/3074667032 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7efee8004f20 con 0x7efef01045e0 2024-04-26T20:26:43.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.267+0000 7efee77fe640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efedc0a3cc0 0x7efedc0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.267+0000 7efef6523640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efedc0a3cc0 0x7efedc0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:43.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.267+0000 7efee77fe640 1 -- 172.21.15.70:0/3074667032 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7efee80d0250 con 0x7efef01045e0 2024-04-26T20:26:43.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.268+0000 7efef6523640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efedc0a3cc0 0x7efedc0a6180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efeec02ae00 tx=0x7efeec009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:43.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.272+0000 7efee77fe640 1 -- 172.21.15.70:0/3074667032 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7efee8014030 con 0x7efef01045e0 2024-04-26T20:26:43.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.452+0000 7efef8787640 1 -- 172.21.15.70:0/3074667032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efef002dd10 con 0x7efef01045e0 2024-04-26T20:26:43.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.453+0000 7efee77fe640 1 -- 172.21.15.70:0/3074667032 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7efee809cac0 con 0x7efef01045e0 2024-04-26T20:26:43.454 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-04-26T20:26:43.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 -- 172.21.15.70:0/3074667032 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efedc0a3cc0 msgr2=0x7efedc0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efedc0a3cc0 0x7efedc0a6180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efeec02ae00 tx=0x7efeec009360 comp rx=0 tx=0).stop 2024-04-26T20:26:43.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 -- 172.21.15.70:0/3074667032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efef01045e0 msgr2=0x7efef01a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efef01045e0 0x7efef01a0280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efee800c970 tx=0x7efee800ce30 comp rx=0 tx=0).stop 2024-04-26T20:26:43.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 -- 172.21.15.70:0/3074667032 shutdown_connections 2024-04-26T20:26:43.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efedc0a3cc0 0x7efedc0a6180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efef01045e0 0x7efef01a0280 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efef0103c20 0x7efef0199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 --2- 172.21.15.70:0/3074667032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efef0100c50 0x7efef0198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 -- 172.21.15.70:0/3074667032 >> 172.21.15.70:0/3074667032 conn(0x7efef00fc560 msgr2=0x7efef0106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:43.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 -- 172.21.15.70:0/3074667032 shutdown_connections 2024-04-26T20:26:43.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.455+0000 7efef8787640 1 -- 172.21.15.70:0/3074667032 wait complete. 2024-04-26T20:26:43.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:26:43.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 -- 172.21.15.70:0/3102906695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b0102990 msgr2=0x7f86b0102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 --2- 172.21.15.70:0/3102906695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b0102990 0x7f86b0102db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009900 tx=0x7f86ac02a410 comp rx=0 tx=0).stop 2024-04-26T20:26:43.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 -- 172.21.15.70:0/3102906695 shutdown_connections 2024-04-26T20:26:43.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 --2- 172.21.15.70:0/3102906695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86b0104540 0x7f86b010add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 --2- 172.21.15.70:0/3102906695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86b0103b80 0x7f86b0104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 --2- 172.21.15.70:0/3102906695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b0102990 0x7f86b0102db0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 -- 172.21.15.70:0/3102906695 >> 172.21.15.70:0/3102906695 conn(0x7f86b00fdf00 msgr2=0x7f86b0100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 -- 172.21.15.70:0/3102906695 shutdown_connections 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 -- 172.21.15.70:0/3102906695 wait complete. 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 Processor -- start 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 -- start start 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b0102990 0x7f86b0198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86b0103b80 0x7f86b0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86b0104540 0x7f86b01a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f86b010e5f0 con 0x7f86b0102990 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f86b010e470 con 0x7f86b0103b80 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.568+0000 7f86b72bd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f86b010e770 con 0x7f86b0104540 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86b5059640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b0102990 0x7f86b0198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:43.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86b5059640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b0102990 0x7f86b0198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52808/0 (socket says 172.21.15.70:52808) 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86b5059640 1 -- 172.21.15.70:0/243747322 learned_addr learned my addr 172.21.15.70:0/243747322 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86b5059640 1 -- 172.21.15.70:0/243747322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86b0104540 msgr2=0x7f86b01a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86b5059640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86b0104540 0x7f86b01a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86b5059640 1 -- 172.21.15.70:0/243747322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86b0103b80 msgr2=0x7f86b0199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86b5059640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86b0103b80 0x7f86b0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86b5059640 1 -- 172.21.15.70:0/243747322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b01a0950 con 0x7f86b0102990 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86b5059640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b0102990 0x7f86b0198d40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f86ac006010 tx=0x7f86ac0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86a67fc640 1 -- 172.21.15.70:0/243747322 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac03f030 con 0x7f86b0102990 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86b72bd640 1 -- 172.21.15.70:0/243747322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b01a0be0 con 0x7f86b0102990 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86a67fc640 1 -- 172.21.15.70:0/243747322 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86ac003cd0 con 0x7f86b0102990 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86a67fc640 1 -- 172.21.15.70:0/243747322 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac035070 con 0x7f86b0102990 2024-04-26T20:26:43.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.569+0000 7f86b72bd640 1 -- 172.21.15.70:0/243747322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b01a1120 con 0x7f86b0102990 2024-04-26T20:26:43.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.570+0000 7f86b72bd640 1 -- 172.21.15.70:0/243747322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b0109e20 con 0x7f86b0102990 2024-04-26T20:26:43.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.572+0000 7f86a67fc640 1 -- 172.21.15.70:0/243747322 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f86ac042030 con 0x7f86b0102990 2024-04-26T20:26:43.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.572+0000 7f86a67fc640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f869c0a3c40 0x7f869c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.572+0000 7f86b4858640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f869c0a3c40 0x7f869c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:43.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.572+0000 7f86a67fc640 1 -- 172.21.15.70:0/243747322 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f86ac0f1290 con 0x7f86b0102990 2024-04-26T20:26:43.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.573+0000 7f86b4858640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f869c0a3c40 0x7f869c0a6100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f86a000a8f0 tx=0x7f86a0005bf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:43.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.576+0000 7f86a67fc640 1 -- 172.21.15.70:0/243747322 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f86ac0bdb00 con 0x7f86b0102990 2024-04-26T20:26:43.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.753+0000 7f86b72bd640 1 -- 172.21.15.70:0/243747322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f86b002dd20 con 0x7f86b0102990 2024-04-26T20:26:43.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.753+0000 7f86a67fc640 1 -- 172.21.15.70:0/243747322 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f86ac0bd400 con 0x7f86b0102990 2024-04-26T20:26:43.754 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-04-26T20:26:43.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 -- 172.21.15.70:0/243747322 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f869c0a3c40 msgr2=0x7f869c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f869c0a3c40 0x7f869c0a6100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f86a000a8f0 tx=0x7f86a0005bf0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 -- 172.21.15.70:0/243747322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b0102990 msgr2=0x7f86b0198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b0102990 0x7f86b0198d40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f86ac006010 tx=0x7f86ac0043b0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 -- 172.21.15.70:0/243747322 shutdown_connections 2024-04-26T20:26:43.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f869c0a3c40 0x7f869c0a6100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86b0104540 0x7f86b01a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86b0103b80 0x7f86b0199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 --2- 172.21.15.70:0/243747322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b0102990 0x7f86b0198d40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 -- 172.21.15.70:0/243747322 >> 172.21.15.70:0/243747322 conn(0x7f86b00fdf00 msgr2=0x7f86b0106ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:43.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 -- 172.21.15.70:0/243747322 shutdown_connections 2024-04-26T20:26:43.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.755+0000 7f86b72bd640 1 -- 172.21.15.70:0/243747322 wait complete. 2024-04-26T20:26:43.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:26:43.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.866+0000 7efd904a0640 1 -- 172.21.15.70:0/766023725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd88108670 msgr2=0x7efd8810aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.866+0000 7efd904a0640 1 --2- 172.21.15.70:0/766023725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd88108670 0x7efd8810aac0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd80009900 tx=0x7efd8002a410 comp rx=0 tx=0).stop 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.866+0000 7efd904a0640 1 -- 172.21.15.70:0/766023725 shutdown_connections 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.866+0000 7efd904a0640 1 --2- 172.21.15.70:0/766023725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd88108670 0x7efd8810aac0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.866+0000 7efd904a0640 1 --2- 172.21.15.70:0/766023725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd88105d40 0x7efd88108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.866+0000 7efd904a0640 1 --2- 172.21.15.70:0/766023725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88103410 0x7efd88105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.866+0000 7efd904a0640 1 -- 172.21.15.70:0/766023725 >> 172.21.15.70:0/766023725 conn(0x7efd880fce00 msgr2=0x7efd880ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.866+0000 7efd904a0640 1 -- 172.21.15.70:0/766023725 shutdown_connections 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.866+0000 7efd904a0640 1 -- 172.21.15.70:0/766023725 wait complete. 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.866+0000 7efd904a0640 1 Processor -- start 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.866+0000 7efd904a0640 1 -- start start 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd904a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd88103410 0x7efd88198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd904a0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88105d40 0x7efd88199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd904a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd88108670 0x7efd881a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd904a0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd8810e660 con 0x7efd88108670 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd904a0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efd8810e4e0 con 0x7efd88103410 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd904a0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd8810e7e0 con 0x7efd88105d40 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8ea3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd88108670 0x7efd881a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8ea3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd88108670 0x7efd881a01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52830/0 (socket says 172.21.15.70:52830) 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8ea3d640 1 -- 172.21.15.70:0/3778793666 learned_addr learned my addr 172.21.15.70:0/3778793666 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8e23c640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd88103410 0x7efd88198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8da3b640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88105d40 0x7efd88199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8ea3d640 1 -- 172.21.15.70:0/3778793666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88105d40 msgr2=0x7efd88199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8ea3d640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88105d40 0x7efd88199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8ea3d640 1 -- 172.21.15.70:0/3778793666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd88103410 msgr2=0x7efd88198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8ea3d640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd88103410 0x7efd88198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:43.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8ea3d640 1 -- 172.21.15.70:0/3778793666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd881a0840 con 0x7efd88108670 2024-04-26T20:26:43.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8da3b640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88105d40 0x7efd88199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:43.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd8ea3d640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd88108670 0x7efd881a01a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efd80005ab0 tx=0x7efd80032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:43.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd7f7fe640 1 -- 172.21.15.70:0/3778793666 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8003f030 con 0x7efd88108670 2024-04-26T20:26:43.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd904a0640 1 -- 172.21.15.70:0/3778793666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd881a0ad0 con 0x7efd88108670 2024-04-26T20:26:43.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd7f7fe640 1 -- 172.21.15.70:0/3778793666 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efd80003ac0 con 0x7efd88108670 2024-04-26T20:26:43.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd7f7fe640 1 -- 172.21.15.70:0/3778793666 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80035070 con 0x7efd88108670 2024-04-26T20:26:43.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.867+0000 7efd904a0640 1 -- 172.21.15.70:0/3778793666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd881a0fc0 con 0x7efd88108670 2024-04-26T20:26:43.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.868+0000 7efd904a0640 1 -- 172.21.15.70:0/3778793666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd880fe8f0 con 0x7efd88108670 2024-04-26T20:26:43.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.869+0000 7efd7f7fe640 1 -- 172.21.15.70:0/3778793666 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7efd80042030 con 0x7efd88108670 2024-04-26T20:26:43.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.870+0000 7efd7f7fe640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efd740a3c40 0x7efd740a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:43.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.870+0000 7efd8e23c640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efd740a3c40 0x7efd740a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:43.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.870+0000 7efd7f7fe640 1 -- 172.21.15.70:0/3778793666 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7efd800f0aa0 con 0x7efd88108670 2024-04-26T20:26:43.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.871+0000 7efd8e23c640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efd740a3c40 0x7efd740a6100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efd8819a100 tx=0x7efd84009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:43.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:43.875+0000 7efd7f7fe640 1 -- 172.21.15.70:0/3778793666 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7efd800bd310 con 0x7efd88108670 2024-04-26T20:26:44.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:43 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2190793331' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:26:44.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:43 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3074667032' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:26:44.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:43 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/243747322' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:26:44.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.093+0000 7efd904a0640 1 -- 172.21.15.70:0/3778793666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd8802dd20 con 0x7efd88108670 2024-04-26T20:26:44.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.093+0000 7efd7f7fe640 1 -- 172.21.15.70:0/3778793666 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7efd800bcc10 con 0x7efd88108670 2024-04-26T20:26:44.094 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:26:44.095 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:25:15.345214+0000","modified":"2024-04-26T20:25:22.041593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24488,"mds_1":24481,"mds_2":24463,"mds_3":24461,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3333683222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3333683222},{"type":"v1","addr":"172.21.15.70:6841","nonce":3333683222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":3,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":1,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6839/4099319394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4099319394},{"type":"v1","addr":"172.21.15.80:6839","nonce":4099319394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24481,24488,24463,24461,24451]},"id":1}]} 2024-04-26T20:26:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2024-04-26T20:26:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.095+0000 7efd904a0640 1 -- 172.21.15.70:0/3778793666 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efd740a3c40 msgr2=0x7efd740a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.095+0000 7efd904a0640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efd740a3c40 0x7efd740a6100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efd8819a100 tx=0x7efd84009500 comp rx=0 tx=0).stop 2024-04-26T20:26:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.095+0000 7efd904a0640 1 -- 172.21.15.70:0/3778793666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd88108670 msgr2=0x7efd881a01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.095+0000 7efd904a0640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd88108670 0x7efd881a01a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efd80005ab0 tx=0x7efd80032bc0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.096+0000 7efd904a0640 1 -- 172.21.15.70:0/3778793666 shutdown_connections 2024-04-26T20:26:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.096+0000 7efd904a0640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efd740a3c40 0x7efd740a6100 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.096+0000 7efd904a0640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd88108670 0x7efd881a01a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.096+0000 7efd904a0640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd88105d40 0x7efd88199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.096+0000 7efd904a0640 1 --2- 172.21.15.70:0/3778793666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd88103410 0x7efd88198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.096+0000 7efd904a0640 1 -- 172.21.15.70:0/3778793666 >> 172.21.15.70:0/3778793666 conn(0x7efd880fce00 msgr2=0x7efd88103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.096+0000 7efd904a0640 1 -- 172.21.15.70:0/3778793666 shutdown_connections 2024-04-26T20:26:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.096+0000 7efd904a0640 1 -- 172.21.15.70:0/3778793666 wait complete. 2024-04-26T20:26:44.108 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:26:44.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.205+0000 7f9cecebd640 1 -- 172.21.15.70:0/656605927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ce8102ae0 msgr2=0x7f9ce8102f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.205+0000 7f9cecebd640 1 --2- 172.21.15.70:0/656605927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ce8102ae0 0x7f9ce8102f60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009900 tx=0x7f9cd002a410 comp rx=0 tx=0).stop 2024-04-26T20:26:44.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.205+0000 7f9cecebd640 1 -- 172.21.15.70:0/656605927 shutdown_connections 2024-04-26T20:26:44.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.205+0000 7f9cecebd640 1 --2- 172.21.15.70:0/656605927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ce81034a0 0x7f9ce8109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.205+0000 7f9cecebd640 1 --2- 172.21.15.70:0/656605927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ce8102ae0 0x7f9ce8102f60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.205+0000 7f9cecebd640 1 --2- 172.21.15.70:0/656605927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ce81018f0 0x7f9ce8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.205+0000 7f9cecebd640 1 -- 172.21.15.70:0/656605927 >> 172.21.15.70:0/656605927 conn(0x7f9ce80fce60 msgr2=0x7f9ce80ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.205+0000 7f9cecebd640 1 -- 172.21.15.70:0/656605927 shutdown_connections 2024-04-26T20:26:44.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.205+0000 7f9cecebd640 1 -- 172.21.15.70:0/656605927 wait complete. 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cecebd640 1 Processor -- start 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cecebd640 1 -- start start 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cecebd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ce81018f0 0x7f9ce806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cecebd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ce8102ae0 0x7f9ce819db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cecebd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ce81034a0 0x7f9ce81a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cecebd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce810d5e0 con 0x7f9ce8102ae0 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cecebd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce810d460 con 0x7f9ce81034a0 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cecebd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce810d760 con 0x7f9ce81018f0 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ce8102ae0 0x7f9ce819db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ce8102ae0 0x7f9ce819db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52848/0 (socket says 172.21.15.70:52848) 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cdffff640 1 -- 172.21.15.70:0/1006255185 learned_addr learned my addr 172.21.15.70:0/1006255185 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:44.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9ce659c640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ce81018f0 0x7f9ce806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9ce6d9d640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ce81034a0 0x7f9ce81a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cdffff640 1 -- 172.21.15.70:0/1006255185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ce81018f0 msgr2=0x7f9ce806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cdffff640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ce81018f0 0x7f9ce806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cdffff640 1 -- 172.21.15.70:0/1006255185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ce81034a0 msgr2=0x7f9ce81a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cdffff640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ce81034a0 0x7f9ce81a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cdffff640 1 -- 172.21.15.70:0/1006255185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce81a0a20 con 0x7f9ce8102ae0 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cdffff640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ce8102ae0 0x7f9ce819db20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0031570 tx=0x7f9cd0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.206+0000 7f9cdf7fe640 1 -- 172.21.15.70:0/1006255185 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd003f030 con 0x7f9ce8102ae0 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.207+0000 7f9cdf7fe640 1 -- 172.21.15.70:0/1006255185 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9cd0003cd0 con 0x7f9ce8102ae0 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.207+0000 7f9cecebd640 1 -- 172.21.15.70:0/1006255185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce81a0cb0 con 0x7f9ce8102ae0 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.207+0000 7f9cdf7fe640 1 -- 172.21.15.70:0/1006255185 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0035070 con 0x7f9ce8102ae0 2024-04-26T20:26:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.207+0000 7f9cecebd640 1 -- 172.21.15.70:0/1006255185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce81a11a0 con 0x7f9ce8102ae0 2024-04-26T20:26:44.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:43 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2190793331' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:26:44.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:43 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3074667032' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:26:44.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:43 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/243747322' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:26:44.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.208+0000 7f9cecebd640 1 -- 172.21.15.70:0/1006255185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce8108c60 con 0x7f9ce8102ae0 2024-04-26T20:26:44.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.208+0000 7f9cdf7fe640 1 -- 172.21.15.70:0/1006255185 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9cd0003800 con 0x7f9ce8102ae0 2024-04-26T20:26:44.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.209+0000 7f9cdf7fe640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9cd40a3c40 0x7f9cd40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.209+0000 7f9ce659c640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9cd40a3c40 0x7f9cd40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.209+0000 7f9cdf7fe640 1 -- 172.21.15.70:0/1006255185 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f9cd00f10c0 con 0x7f9ce8102ae0 2024-04-26T20:26:44.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.209+0000 7f9ce659c640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9cd40a3c40 0x7f9cd40a6100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8102940 tx=0x7f9cd8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.213+0000 7f9cdf7fe640 1 -- 172.21.15.70:0/1006255185 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f9cd0003af0 con 0x7f9ce8102ae0 2024-04-26T20:26:44.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:43 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2190793331' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:26:44.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:43 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3074667032' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:26:44.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:43 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/243747322' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:26:44.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.392+0000 7f9cecebd640 1 -- 172.21.15.70:0/1006255185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ce802dc80 con 0x7f9ce8102ae0 2024-04-26T20:26:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.393+0000 7f9cdf7fe640 1 -- 172.21.15.70:0/1006255185 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22646 (secure 0 0 0) 0x7f9cd00bd930 con 0x7f9ce8102ae0 2024-04-26T20:26:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:26:44.394 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:26:08.787018+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":6}]},{"pgid":"2.16","mappings":[{"from":2,"to":4},{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:26:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 -- 172.21.15.70:0/1006255185 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9cd40a3c40 msgr2=0x7f9cd40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9cd40a3c40 0x7f9cd40a6100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8102940 tx=0x7f9cd8008040 comp rx=0 tx=0).stop 2024-04-26T20:26:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 -- 172.21.15.70:0/1006255185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ce8102ae0 msgr2=0x7f9ce819db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ce8102ae0 0x7f9ce819db20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0031570 tx=0x7f9cd0004430 comp rx=0 tx=0).stop 2024-04-26T20:26:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 -- 172.21.15.70:0/1006255185 shutdown_connections 2024-04-26T20:26:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9cd40a3c40 0x7f9cd40a6100 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ce81034a0 0x7f9ce81a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ce8102ae0 0x7f9ce819db20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 --2- 172.21.15.70:0/1006255185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ce81018f0 0x7f9ce806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 -- 172.21.15.70:0/1006255185 >> 172.21.15.70:0/1006255185 conn(0x7f9ce80fce60 msgr2=0x7f9ce8105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 -- 172.21.15.70:0/1006255185 shutdown_connections 2024-04-26T20:26:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.395+0000 7f9cecebd640 1 -- 172.21.15.70:0/1006255185 wait complete. 2024-04-26T20:26:44.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:26:44.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.510+0000 7fc21eb12640 1 -- 172.21.15.70:0/3492260477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc218103fc0 msgr2=0x7fc2181043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.510+0000 7fc21eb12640 1 --2- 172.21.15.70:0/3492260477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc218103fc0 0x7fc2181043e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc214009900 tx=0x7fc21402a410 comp rx=0 tx=0).stop 2024-04-26T20:26:44.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.510+0000 7fc21eb12640 1 -- 172.21.15.70:0/3492260477 shutdown_connections 2024-04-26T20:26:44.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.510+0000 7fc21eb12640 1 --2- 172.21.15.70:0/3492260477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2181013f0 0x7fc21810afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.510+0000 7fc21eb12640 1 --2- 172.21.15.70:0/3492260477 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc218100a30 0x7fc218100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.510+0000 7fc21eb12640 1 --2- 172.21.15.70:0/3492260477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc218103fc0 0x7fc2181043e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.510+0000 7fc21eb12640 1 -- 172.21.15.70:0/3492260477 >> 172.21.15.70:0/3492260477 conn(0x7fc2180fc590 msgr2=0x7fc2180fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.510+0000 7fc21eb12640 1 -- 172.21.15.70:0/3492260477 shutdown_connections 2024-04-26T20:26:44.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.510+0000 7fc21eb12640 1 -- 172.21.15.70:0/3492260477 wait complete. 2024-04-26T20:26:44.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.510+0000 7fc21eb12640 1 Processor -- start 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21eb12640 1 -- start start 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21eb12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc218100a30 0x7fc218198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21eb12640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2181013f0 0x7fc2181991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21eb12640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc218103fc0 0x7fc2181a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21eb12640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc21810e660 con 0x7fc218100a30 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21eb12640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc21810e4e0 con 0x7fc218103fc0 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21eb12640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc21810e7e0 con 0x7fc2181013f0 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21c8ae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc218100a30 0x7fc218198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21c8ae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc218100a30 0x7fc218198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52878/0 (socket says 172.21.15.70:52878) 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21c8ae640 1 -- 172.21.15.70:0/1242288360 learned_addr learned my addr 172.21.15.70:0/1242288360 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21c8ae640 1 -- 172.21.15.70:0/1242288360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2181013f0 msgr2=0x7fc2181991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21c8ae640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2181013f0 0x7fc2181991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21c8ae640 1 -- 172.21.15.70:0/1242288360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc218103fc0 msgr2=0x7fc2181a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21c8ae640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc218103fc0 0x7fc2181a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21c8ae640 1 -- 172.21.15.70:0/1242288360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2181a08b0 con 0x7fc218100a30 2024-04-26T20:26:44.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21c8ae640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc218100a30 0x7fc218198c70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc214006010 tx=0x7fc2140043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc20dffb640 1 -- 172.21.15.70:0/1242288360 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21403f030 con 0x7fc218100a30 2024-04-26T20:26:44.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc20dffb640 1 -- 172.21.15.70:0/1242288360 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc214003cd0 con 0x7fc218100a30 2024-04-26T20:26:44.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc21eb12640 1 -- 172.21.15.70:0/1242288360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2181a0b40 con 0x7fc218100a30 2024-04-26T20:26:44.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.511+0000 7fc20dffb640 1 -- 172.21.15.70:0/1242288360 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214035070 con 0x7fc218100a30 2024-04-26T20:26:44.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.512+0000 7fc21eb12640 1 -- 172.21.15.70:0/1242288360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2181a1100 con 0x7fc218100a30 2024-04-26T20:26:44.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.513+0000 7fc21eb12640 1 -- 172.21.15.70:0/1242288360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc218109e80 con 0x7fc218100a30 2024-04-26T20:26:44.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.514+0000 7fc20dffb640 1 -- 172.21.15.70:0/1242288360 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc214042030 con 0x7fc218100a30 2024-04-26T20:26:44.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.514+0000 7fc20dffb640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc2000a3cc0 0x7fc2000a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.514+0000 7fc20ffff640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc2000a3cc0 0x7fc2000a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.514+0000 7fc20dffb640 1 -- 172.21.15.70:0/1242288360 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fc2140f0d40 con 0x7fc218100a30 2024-04-26T20:26:44.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.515+0000 7fc20ffff640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc2000a3cc0 0x7fc2000a6180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc21819a170 tx=0x7fc208005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.519+0000 7fc20dffb640 1 -- 172.21.15.70:0/1242288360 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc2140bd5b0 con 0x7fc218100a30 2024-04-26T20:26:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.734+0000 7fc21eb12640 1 -- 172.21.15.70:0/1242288360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc21802dad0 con 0x7fc218100a30 2024-04-26T20:26:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.734+0000 7fc20dffb640 1 -- 172.21.15.70:0/1242288360 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7fc2140bceb0 con 0x7fc218100a30 2024-04-26T20:26:44.735 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:26:44.735 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:25:15.345214+0000","modified":"2024-04-26T20:25:22.041593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24488,"mds_1":24481,"mds_2":24463,"mds_3":24461,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3333683222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3333683222},{"type":"v1","addr":"172.21.15.70:6841","nonce":3333683222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":3,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":1,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6839/4099319394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4099319394},{"type":"v1","addr":"172.21.15.80:6839","nonce":4099319394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24481,24488,24463,24461,24451]},"id":1}]} 2024-04-26T20:26:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2024-04-26T20:26:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.736+0000 7fc21eb12640 1 -- 172.21.15.70:0/1242288360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc2000a3cc0 msgr2=0x7fc2000a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.736+0000 7fc21eb12640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc2000a3cc0 0x7fc2000a6180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc21819a170 tx=0x7fc208005c70 comp rx=0 tx=0).stop 2024-04-26T20:26:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.736+0000 7fc21eb12640 1 -- 172.21.15.70:0/1242288360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc218100a30 msgr2=0x7fc218198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.736+0000 7fc21eb12640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc218100a30 0x7fc218198c70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc214006010 tx=0x7fc2140043b0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.737+0000 7fc21eb12640 1 -- 172.21.15.70:0/1242288360 shutdown_connections 2024-04-26T20:26:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.737+0000 7fc21eb12640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fc2000a3cc0 0x7fc2000a6180 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.737+0000 7fc21eb12640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc218103fc0 0x7fc2181a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.737+0000 7fc21eb12640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2181013f0 0x7fc2181991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.737+0000 7fc21eb12640 1 --2- 172.21.15.70:0/1242288360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc218100a30 0x7fc218198c70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.737+0000 7fc21eb12640 1 -- 172.21.15.70:0/1242288360 >> 172.21.15.70:0/1242288360 conn(0x7fc2180fc590 msgr2=0x7fc218107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.737+0000 7fc21eb12640 1 -- 172.21.15.70:0/1242288360 shutdown_connections 2024-04-26T20:26:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.737+0000 7fc21eb12640 1 -- 172.21.15.70:0/1242288360 wait complete. 2024-04-26T20:26:44.749 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T20:25:15.345214+0000', 'modified': '2024-04-26T20:25:22.041593+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24488, 'mds_1': 24481, 'mds_2': 24463, 'mds_3': 24461, 'mds_4': 24451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14595': {'gid': 14595, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6839/2998426471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 2998426471}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 2998426471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14607': {'gid': 14607, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6841/3333683222', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6840', 'nonce': 3333683222}, {'type': 'v1', 'addr': '172.21.15.70:6841', 'nonce': 3333683222}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.80:6833/20228697', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6832', 'nonce': 20228697}, {'type': 'v1', 'addr': '172.21.15.80:6833', 'nonce': 20228697}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24409': {'gid': 24409, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6833/699509756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6832', 'nonce': 699509756}, {'type': 'v1', 'addr': '172.21.15.98:6833', 'nonce': 699509756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.80:6835/857349607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6834', 'nonce': 857349607}, {'type': 'v1', 'addr': '172.21.15.80:6835', 'nonce': 857349607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 4, 'incarnation': 22, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.98:6835/2812509799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 2812509799}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 2812509799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 3, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.80:6837/3487724503', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6836', 'nonce': 3487724503}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 3487724503}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 2, 'incarnation': 18, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.98:6837/3751464822', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 3751464822}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 3751464822}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'i', 'rank': 1, 'incarnation': 16, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.98:6839/4073846722', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 4073846722}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 4073846722}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6839/4099319394', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6838', 'nonce': 4099319394}, {'type': 'v1', 'addr': '172.21.15.80:6839', 'nonce': 4099319394}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24488, 'qdb_cluster': [24481, 24488, 24463, 24461, 24451]} 2024-04-26T20:26:44.749 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-26T20:26:44.749 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-26T20:26:44.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.847+0000 7fa6426bd640 1 -- 172.21.15.70:0/3565174118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa63c104520 msgr2=0x7fa63c10adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.847+0000 7fa6426bd640 1 --2- 172.21.15.70:0/3565174118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa63c104520 0x7fa63c10adb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa634009ca0 tx=0x7fa63402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.847+0000 7fa6426bd640 1 -- 172.21.15.70:0/3565174118 shutdown_connections 2024-04-26T20:26:44.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.847+0000 7fa6426bd640 1 --2- 172.21.15.70:0/3565174118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa63c104520 0x7fa63c10adb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.847+0000 7fa6426bd640 1 --2- 172.21.15.70:0/3565174118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa63c103b60 0x7fa63c103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.847+0000 7fa6426bd640 1 --2- 172.21.15.70:0/3565174118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa63c102970 0x7fa63c102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.847+0000 7fa6426bd640 1 -- 172.21.15.70:0/3565174118 >> 172.21.15.70:0/3565174118 conn(0x7fa63c0fdec0 msgr2=0x7fa63c100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.847+0000 7fa6426bd640 1 -- 172.21.15.70:0/3565174118 shutdown_connections 2024-04-26T20:26:44.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.847+0000 7fa6426bd640 1 -- 172.21.15.70:0/3565174118 wait complete. 2024-04-26T20:26:44.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa6426bd640 1 Processor -- start 2024-04-26T20:26:44.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa6426bd640 1 -- start start 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa6426bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa63c102970 0x7fa63c198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa6426bd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa63c103b60 0x7fa63c1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa6426bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa63c104520 0x7fa63c1a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa6426bd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c10e5d0 con 0x7fa63c104520 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa6426bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c10e450 con 0x7fa63c102970 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa6426bd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c10e750 con 0x7fa63c103b60 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa640c5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa63c104520 0x7fa63c1a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa640c5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa63c104520 0x7fa63c1a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52894/0 (socket says 172.21.15.70:52894) 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa640c5a640 1 -- 172.21.15.70:0/49603134 learned_addr learned my addr 172.21.15.70:0/49603134 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa63c103b60 0x7fa63c1990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa63bfff640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa63c102970 0x7fa63c198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa640c5a640 1 -- 172.21.15.70:0/49603134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa63c103b60 msgr2=0x7fa63c1990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa640c5a640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa63c103b60 0x7fa63c1990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa640c5a640 1 -- 172.21.15.70:0/49603134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa63c102970 msgr2=0x7fa63c198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa640c5a640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa63c102970 0x7fa63c198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa640c5a640 1 -- 172.21.15.70:0/49603134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63c1a07d0 con 0x7fa63c104520 2024-04-26T20:26:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa63bfff640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa63c102970 0x7fa63c198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.848+0000 7fa640c5a640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa63c104520 0x7fa63c1a0160 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa634009dc0 tx=0x7fa63402f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.849+0000 7fa6397fa640 1 -- 172.21.15.70:0/49603134 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa634003cf0 con 0x7fa63c104520 2024-04-26T20:26:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.849+0000 7fa6397fa640 1 -- 172.21.15.70:0/49603134 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa634004510 con 0x7fa63c104520 2024-04-26T20:26:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.849+0000 7fa6426bd640 1 -- 172.21.15.70:0/49603134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa63c1a0a60 con 0x7fa63c104520 2024-04-26T20:26:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.849+0000 7fa6397fa640 1 -- 172.21.15.70:0/49603134 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63402fdb0 con 0x7fa63c104520 2024-04-26T20:26:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.849+0000 7fa6426bd640 1 -- 172.21.15.70:0/49603134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa63c1a0fb0 con 0x7fa63c104520 2024-04-26T20:26:44.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa6397fa640 1 -- 172.21.15.70:0/49603134 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa6340046c0 con 0x7fa63c104520 2024-04-26T20:26:44.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa6453d1740 1 Processor -- start 2024-04-26T20:26:44.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa6453d1740 1 -- start start 2024-04-26T20:26:44.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf508cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf508d080 0x564cf5091b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf50921f0 0x564cf5094680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa6453d1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564cf4ff1740 con 0x564cf508c690 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa6453d1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564cf4f8d3a0 con 0x564cf50921f0 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa6453d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564cf4fed700 con 0x564cf508d080 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa63b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf508cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa6397fa640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa6240a3c40 0x7fa6240a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa63b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf508cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52896/0 (socket says 172.21.15.70:52896) 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa63b7fe640 1 -- 172.21.15.70:0/2661162943 learned_addr learned my addr 172.21.15.70:0/2661162943 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa640c5a640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa6240a3c40 0x7fa6240a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa63bfff640 1 --2- 172.21.15.70:0/2661162943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf508d080 0x564cf5091b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa63b7fe640 1 -- 172.21.15.70:0/2661162943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf508d080 msgr2=0x564cf5091b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/2661162943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf508d080 0x564cf5091b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa63b7fe640 1 -- 172.21.15.70:0/2661162943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf50921f0 msgr2=0x564cf5094680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/2661162943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf50921f0 0x564cf5094680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa63b7fe640 1 -- 172.21.15.70:0/2661162943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf4fa9750 con 0x564cf508c690 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.851+0000 7fa63bfff640 1 --2- 172.21.15.70:0/2661162943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf508d080 0x564cf5091b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.852+0000 7fa6397fa640 1 -- 172.21.15.70:0/49603134 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fa6340f1bc0 con 0x7fa63c104520 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.852+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/2661162943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf508cab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa63000b7c0 tx=0x7fa63000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a19d18381ad9968 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.852+0000 7fa6227fc640 1 -- 172.21.15.70:0/2661162943 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630003dd0 con 0x564cf508c690 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.852+0000 7fa640c5a640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa6240a3c40 0x7fa6240a6100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa6340ba2a0 tx=0x7fa634090980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.852+0000 7fa6227fc640 1 -- 172.21.15.70:0/2661162943 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa630016030 con 0x564cf508c690 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.852+0000 7fa6227fc640 1 -- 172.21.15.70:0/2661162943 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630004d90 con 0x564cf508c690 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.852+0000 7fa6453d1740 1 -- 172.21.15.70:0/2661162943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 msgr2=0x564cf508cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.852+0000 7fa6453d1740 1 --2- 172.21.15.70:0/2661162943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf508cab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa63000b7c0 tx=0x7fa63000bc80 comp rx=0 tx=0).stop 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 -- 172.21.15.70:0/2661162943 shutdown_connections 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 --2- 172.21.15.70:0/2661162943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf50921f0 0x564cf5094680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 --2- 172.21.15.70:0/2661162943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf508d080 0x564cf5091b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 --2- 172.21.15.70:0/2661162943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf508cab0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 -- 172.21.15.70:0/2661162943 >> 172.21.15.70:0/2661162943 conn(0x564cf5087d00 msgr2=0x564cf5088100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 -- 172.21.15.70:0/2661162943 shutdown_connections 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 -- 172.21.15.70:0/2661162943 wait complete. 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 -- start start 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 Processor -- start 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508c690 0x564cf5096ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508d080 0x564cf5096ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf50921f0 0x564cf509e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564cf5095140 con 0x564cf508d080 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564cf4f78fe0 con 0x564cf508c690 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564cf50952c0 con 0x564cf50921f0 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa6453d1740 10 client.0 _ll_register_callbacks cb 0x564cf4f8f150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa63bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508d080 0x564cf5096ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa63bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508d080 0x564cf5096ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52900/0 (socket says 172.21.15.70:52900) 2024-04-26T20:26:44.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.853+0000 7fa63bfff640 1 -- 172.21.15.70:0/817167638 learned_addr learned my addr 172.21.15.70:0/817167638 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508c690 0x564cf5096ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa63bfff640 1 -- 172.21.15.70:0/817167638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf50921f0 msgr2=0x564cf509e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa63bfff640 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf50921f0 0x564cf509e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa63bfff640 1 -- 172.21.15.70:0/817167638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508c690 msgr2=0x564cf5096ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa63bfff640 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508c690 0x564cf5096ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa63bfff640 1 -- 172.21.15.70:0/817167638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cf4d032d0 con 0x564cf508d080 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa63bfff640 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508d080 0x564cf5096ff0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00f480 tx=0x7fa62c00f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10378b269c433eea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa61b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa61b7fe640 1 -- 172.21.15.70:0/817167638 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62c005220 con 0x564cf508d080 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa61b7fe640 1 -- 172.21.15.70:0/817167638 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fa62c0053c0 con 0x564cf508d080 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa6453d1740 1 -- 172.21.15.70:0/817167638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa630016030 con 0x564cf508d080 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa61b7fe640 1 -- 172.21.15.70:0/817167638 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa62c0055c0 con 0x564cf508d080 2024-04-26T20:26:44.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa6453d1740 10 client.15033 fetch_fsmap learned FSMap version 24 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa6453d1740 1 -- 172.21.15.70:0/817167638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564cf4dcd6b0 con 0x564cf508d080 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa61b7fe640 1 -- 172.21.15.70:0/817167638 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa630016030 con 0x564cf508d080 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa61b7fe640 1 -- 172.21.15.70:0/817167638 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fa62c022050 con 0x564cf508d080 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa6453d1740 10 client.15033 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa6453d1740 10 client.15033 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.854+0000 7fa6453d1740 20 client.15033 populate_metadata read hostname 'smithi070' 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.855+0000 7fa6453d1740 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x564cf50a35a0 0x564cf50a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.855+0000 7fa6453d1740 4 client.15033 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.855+0000 7fa6453d1740 1 -- 172.21.15.70:0/817167638 --> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cf4fff350 con 0x564cf50a35a0 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.855+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x564cf50a35a0 0x564cf50a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.855+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x564cf50a35a0 0x564cf50a4a10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3a45dbd117ae7e22 server_cookie=d974d36ea3fa5aa2 in_seq=0 out_seq=0 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.855+0000 7fa61b7fe640 10 client.15033 ms_handle_connect on v2:172.21.15.98:6834/2812509799 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa61b7fe640 1 -- 172.21.15.70:0/817167638 <== mds.4 v2:172.21.15.98:6834/2812509799 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564cf4fff350 con 0x564cf50a35a0 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa61b7fe640 10 client.15033 handle_command_reply: tid=0 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 1 client.15033 shutdown 2024-04-26T20:26:44.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 1 -- 172.21.15.70:0/817167638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508d080 msgr2=0x564cf5096ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508d080 0x564cf5096ff0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00f480 tx=0x7fa62c00f940 comp rx=0 tx=0).stop 2024-04-26T20:26:44.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 1 -- 172.21.15.70:0/817167638 shutdown_connections 2024-04-26T20:26:44.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x564cf50a35a0 0x564cf50a4a10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf50921f0 0x564cf509e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508d080 0x564cf5096ff0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 1 --2- 172.21.15.70:0/817167638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508c690 0x564cf5096ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 1 -- 172.21.15.70:0/817167638 >> 172.21.15.70:0/817167638 conn(0x564cf5087d00 msgr2=0x564cf5086f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa61b7fe640 0 client.15033 ms_handle_reset on v2:172.21.15.98:6834/2812509799 2024-04-26T20:26:44.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 1 -- 172.21.15.70:0/817167638 shutdown_connections 2024-04-26T20:26:44.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 1 -- 172.21.15.70:0/817167638 wait complete. 2024-04-26T20:26:44.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.856+0000 7fa6453d1740 20 client.15033 trim_cache size 0 max 16384 2024-04-26T20:26:44.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.874+0000 7fa6453d1740 1 Processor -- start 2024-04-26T20:26:44.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.874+0000 7fa6453d1740 1 -- start start 2024-04-26T20:26:44.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf5095080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508d080 0x564cf509dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf50921f0 0x564cf5091ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa6453d1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564cf50a2d50 con 0x564cf508c690 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa6453d1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564cf50a3420 con 0x564cf508d080 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa6453d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564cf50a3af0 con 0x564cf50921f0 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa63b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf5095080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa63b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf5095080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52902/0 (socket says 172.21.15.70:52902) 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa63b7fe640 1 -- 172.21.15.70:0/3479605707 learned_addr learned my addr 172.21.15.70:0/3479605707 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa63bfff640 1 --2- 172.21.15.70:0/3479605707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508d080 0x564cf509dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa63b7fe640 1 -- 172.21.15.70:0/3479605707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf50921f0 msgr2=0x564cf5091ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/3479605707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf50921f0 0x564cf5091ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa63b7fe640 1 -- 172.21.15.70:0/3479605707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508d080 msgr2=0x564cf509dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/3479605707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508d080 0x564cf509dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa63b7fe640 1 -- 172.21.15.70:0/3479605707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf5088a70 con 0x564cf508c690 2024-04-26T20:26:44.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/3479605707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf5095080 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa6300039c0 tx=0x7fa630003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd766464d99b83ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa621ffb640 1 -- 172.21.15.70:0/3479605707 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63002c070 con 0x564cf508c690 2024-04-26T20:26:44.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa621ffb640 1 -- 172.21.15.70:0/3479605707 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa630016040 con 0x564cf508c690 2024-04-26T20:26:44.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.875+0000 7fa621ffb640 1 -- 172.21.15.70:0/3479605707 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63001bda0 con 0x564cf508c690 2024-04-26T20:26:44.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.876+0000 7fa6453d1740 1 -- 172.21.15.70:0/3479605707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 msgr2=0x564cf5095080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.876+0000 7fa6453d1740 1 --2- 172.21.15.70:0/3479605707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf5095080 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa6300039c0 tx=0x7fa630003d50 comp rx=0 tx=0).stop 2024-04-26T20:26:44.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.876+0000 7fa6453d1740 1 -- 172.21.15.70:0/3479605707 shutdown_connections 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.876+0000 7fa6453d1740 1 --2- 172.21.15.70:0/3479605707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf50921f0 0x564cf5091ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.876+0000 7fa6453d1740 1 --2- 172.21.15.70:0/3479605707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508d080 0x564cf509dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.876+0000 7fa6453d1740 1 --2- 172.21.15.70:0/3479605707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf508c690 0x564cf5095080 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.876+0000 7fa6453d1740 1 -- 172.21.15.70:0/3479605707 >> 172.21.15.70:0/3479605707 conn(0x564cf5087d00 msgr2=0x564cf50880e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.876+0000 7fa6453d1740 1 -- 172.21.15.70:0/3479605707 shutdown_connections 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.876+0000 7fa6453d1740 1 -- 172.21.15.70:0/3479605707 wait complete. 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.876+0000 7fa6453d1740 1 -- start start 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa6453d1740 1 Processor -- start 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf508c690 0x564cf5099880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508d080 0x564cf5099dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa6453d1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf50921f0 0x564cf509cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa6453d1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564cf50a4890 con 0x564cf50921f0 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa6453d1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564cf50a41c0 con 0x564cf508d080 2024-04-26T20:26:44.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa6453d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564cf50a4f60 con 0x564cf508c690 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa6453d1740 10 client.0 _ll_register_callbacks cb 0x7fa62c00a430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa63b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf50921f0 0x564cf509cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa63b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf50921f0 0x564cf509cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52914/0 (socket says 172.21.15.70:52914) 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa63b7fe640 1 -- 172.21.15.70:0/3888017806 learned_addr learned my addr 172.21.15.70:0/3888017806 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf508c690 0x564cf5099880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa63b7fe640 1 -- 172.21.15.70:0/3888017806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf508c690 msgr2=0x564cf5099880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf508c690 0x564cf5099880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa63b7fe640 1 -- 172.21.15.70:0/3888017806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508d080 msgr2=0x564cf5099dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508d080 0x564cf5099dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa63b7fe640 1 -- 172.21.15.70:0/3888017806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cf50a2b80 con 0x564cf50921f0 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa63b7fe640 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf50921f0 0x564cf509cbf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa630004310 tx=0x7fa630012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f1e75f2153dd37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa61b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:26:44.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa61b7fe640 1 -- 172.21.15.70:0/3888017806 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630039060 con 0x564cf50921f0 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa61b7fe640 1 -- 172.21.15.70:0/3888017806 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fa63001bd20 con 0x564cf50921f0 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.877+0000 7fa6453d1740 1 -- 172.21.15.70:0/3888017806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa630016040 con 0x564cf50921f0 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa61b7fe640 1 -- 172.21.15.70:0/3888017806 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa63002c040 con 0x564cf50921f0 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa6453d1740 10 client.15039 fetch_fsmap learned FSMap version 24 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa6453d1740 1 -- 172.21.15.70:0/3888017806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564cf5109550 con 0x564cf50921f0 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa61b7fe640 1 -- 172.21.15.70:0/3888017806 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa630016040 con 0x564cf50921f0 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa61b7fe640 1 -- 172.21.15.70:0/3888017806 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fa630026030 con 0x564cf50921f0 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa6453d1740 10 client.15039 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa6453d1740 10 client.15039 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa6453d1740 20 client.15039 populate_metadata read hostname 'smithi070' 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa6453d1740 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x564cf510d8a0 0x564cf510c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa6453d1740 4 client.15039 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:26:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa6453d1740 1 -- 172.21.15.70:0/3888017806 --> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] -- command(tid 0: {"prefix": "status"}) -- 0x564cf4ff91c0 con 0x564cf510d8a0 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.878+0000 7fa63bfff640 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x564cf510d8a0 0x564cf510c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa61b7fe640 10 client.15039 ms_handle_connect on v2:172.21.15.98:6834/2812509799 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa63bfff640 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x564cf510d8a0 0x564cf510c5b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b5b515b5b0773030 server_cookie=5e54d6952e55ef13 in_seq=0 out_seq=0 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa61b7fe640 1 -- 172.21.15.70:0/3888017806 <== mds.4 v2:172.21.15.98:6834/2812509799 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564cf4ff91c0 con 0x564cf510d8a0 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa61b7fe640 10 client.15039 handle_command_reply: tid=0 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 1 client.15039 shutdown 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 1 -- 172.21.15.70:0/3888017806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf50921f0 msgr2=0x564cf509cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf50921f0 0x564cf509cbf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa630004310 tx=0x7fa630012040 comp rx=0 tx=0).stop 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 1 -- 172.21.15.70:0/3888017806 shutdown_connections 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x564cf510d8a0 0x564cf510c5b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564cf50921f0 0x564cf509cbf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa61b7fe640 0 client.15039 ms_handle_reset on v2:172.21.15.98:6834/2812509799 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564cf508d080 0x564cf5099dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 1 --2- 172.21.15.70:0/3888017806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564cf508c690 0x564cf5099880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 1 -- 172.21.15.70:0/3888017806 >> 172.21.15.70:0/3888017806 conn(0x564cf5087d00 msgr2=0x564cf508e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 1 -- 172.21.15.70:0/3888017806 shutdown_connections 2024-04-26T20:26:44.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 1 -- 172.21.15.70:0/3888017806 wait complete. 2024-04-26T20:26:44.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.879+0000 7fa6453d1740 20 client.15039 trim_cache size 0 max 16384 2024-04-26T20:26:44.887 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:26:44.887 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:26:44.887 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 4, 2024-04-26T20:26:44.887 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24451, 2024-04-26T20:26:44.887 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-04-26T20:26:44.887 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-04-26T20:26:44.887 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-04-26T20:26:44.888 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 83.854424867999995, 2024-04-26T20:26:44.888 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 24, 2024-04-26T20:26:44.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2024-04-26T20:26:44.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2024-04-26T20:26:44.888 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 112.438114872 2024-04-26T20:26:44.888 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:26:44.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 -- 172.21.15.70:0/49603134 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa6240a3c40 msgr2=0x7fa6240a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa6240a3c40 0x7fa6240a6100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa6340ba2a0 tx=0x7fa634090980 comp rx=0 tx=0).stop 2024-04-26T20:26:44.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 -- 172.21.15.70:0/49603134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa63c104520 msgr2=0x7fa63c1a0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa63c104520 0x7fa63c1a0160 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa634009dc0 tx=0x7fa63402f460 comp rx=0 tx=0).stop 2024-04-26T20:26:44.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 -- 172.21.15.70:0/49603134 shutdown_connections 2024-04-26T20:26:44.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fa6240a3c40 0x7fa6240a6100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa63c104520 0x7fa63c1a0160 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa63c103b60 0x7fa63c1990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 --2- 172.21.15.70:0/49603134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa63c102970 0x7fa63c198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 -- 172.21.15.70:0/49603134 >> 172.21.15.70:0/49603134 conn(0x7fa63c0fdec0 msgr2=0x7fa63c106d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 -- 172.21.15.70:0/49603134 shutdown_connections 2024-04-26T20:26:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.880+0000 7fa6426bd640 1 -- 172.21.15.70:0/49603134 wait complete. 2024-04-26T20:26:44.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-26T20:26:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.989+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3825320619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2c8100c50 msgr2=0x7fb2c8101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.989+0000 7fb2cf59e640 1 --2- 172.21.15.70:0/3825320619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2c8100c50 0x7fb2c8101070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009930 tx=0x7fb2c402a420 comp rx=0 tx=0).stop 2024-04-26T20:26:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.989+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3825320619 shutdown_connections 2024-04-26T20:26:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.989+0000 7fb2cf59e640 1 --2- 172.21.15.70:0/3825320619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c81045e0 0x7fb2c810ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.989+0000 7fb2cf59e640 1 --2- 172.21.15.70:0/3825320619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8103c20 0x7fb2c81040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.989+0000 7fb2cf59e640 1 --2- 172.21.15.70:0/3825320619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2c8100c50 0x7fb2c8101070 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.989+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3825320619 >> 172.21.15.70:0/3825320619 conn(0x7fb2c80fc560 msgr2=0x7fb2c80fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.989+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3825320619 shutdown_connections 2024-04-26T20:26:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.989+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3825320619 wait complete. 2024-04-26T20:26:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.989+0000 7fb2cf59e640 1 Processor -- start 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2cf59e640 1 -- start start 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2cf59e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8100c50 0x7fb2c8198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2cf59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2c8103c20 0x7fb2c8199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2cf59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c81045e0 0x7fb2c81a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2cf59e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c810e6f0 con 0x7fb2c8103c20 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2cf59e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c810e570 con 0x7fb2c81045e0 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2cf59e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c810e870 con 0x7fb2c8100c50 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2ccb39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2c8103c20 0x7fb2c8199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2ccb39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2c8103c20 0x7fb2c8199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52932/0 (socket says 172.21.15.70:52932) 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2ccb39640 1 -- 172.21.15.70:0/3857691653 learned_addr learned my addr 172.21.15.70:0/3857691653 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2cdb3b640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c81045e0 0x7fb2c81a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2cd33a640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8100c50 0x7fb2c8198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2ccb39640 1 -- 172.21.15.70:0/3857691653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8100c50 msgr2=0x7fb2c8198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8100c50 0x7fb2c8198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2ccb39640 1 -- 172.21.15.70:0/3857691653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c81045e0 msgr2=0x7fb2c81a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c81045e0 0x7fb2c81a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2ccb39640 1 -- 172.21.15.70:0/3857691653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c81a0a60 con 0x7fb2c8103c20 2024-04-26T20:26:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2c8103c20 0x7fb2c8199380 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800b4a0 tx=0x7fb2b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2be7fc640 1 -- 172.21.15.70:0/3857691653 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8014070 con 0x7fb2c8103c20 2024-04-26T20:26:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3857691653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c81a0d50 con 0x7fb2c8103c20 2024-04-26T20:26:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2be7fc640 1 -- 172.21.15.70:0/3857691653 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2b8010ae0 con 0x7fb2c8103c20 2024-04-26T20:26:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2be7fc640 1 -- 172.21.15.70:0/3857691653 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8017ce0 con 0x7fb2c8103c20 2024-04-26T20:26:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.990+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3857691653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c81a1270 con 0x7fb2c8103c20 2024-04-26T20:26:45.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2be7fc640 1 -- 172.21.15.70:0/3857691653 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb2b8017070 con 0x7fb2c8103c20 2024-04-26T20:26:45.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2d238b740 1 Processor -- start 2024-04-26T20:26:45.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2d238b740 1 -- start start 2024-04-26T20:26:45.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f0690 0x5641c45f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c45f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f61f0 0x5641c45f8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2d238b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641c4555740 con 0x5641c45f61f0 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2d238b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5641c44f13a0 con 0x5641c45f0690 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2d238b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5641c4551700 con 0x5641c45f1080 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2ccb39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f61f0 0x5641c45f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2ccb39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f61f0 0x5641c45f8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52944/0 (socket says 172.21.15.70:52944) 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2ccb39640 1 -- 172.21.15.70:0/240818092 learned_addr learned my addr 172.21.15.70:0/240818092 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2be7fc640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2b40a3c40 0x7fb2b40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2cd33a640 1 --2- 172.21.15.70:0/240818092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c45f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2ccb39640 1 -- 172.21.15.70:0/240818092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 msgr2=0x5641c45f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2cdb3b640 1 --2- 172.21.15.70:0/240818092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f0690 0x5641c45f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/240818092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c45f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2ccb39640 1 -- 172.21.15.70:0/240818092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f0690 msgr2=0x5641c45f0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/240818092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f0690 0x5641c45f0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2ccb39640 1 -- 172.21.15.70:0/240818092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c450d750 con 0x5641c45f61f0 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.993+0000 7fb2cd33a640 1 --2- 172.21.15.70:0/240818092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c45f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.994+0000 7fb2cdb3b640 1 --2- 172.21.15.70:0/240818092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f0690 0x5641c45f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.994+0000 7fb2cdb3b640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2b40a3c40 0x7fb2b40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.994+0000 7fb2be7fc640 1 -- 172.21.15.70:0/3857691653 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fb2b80cf8e0 con 0x7fb2c8103c20 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.994+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/240818092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f61f0 0x5641c45f8680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80cd2d0 tx=0x7fb2b800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589e9623c4ad33e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.994+0000 7fb2b37fe640 1 -- 172.21.15.70:0/240818092 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b809b6a0 con 0x5641c45f61f0 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.994+0000 7fb2cdb3b640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2b40a3c40 0x7fb2b40a6100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00070b0 tx=0x7fb2c000c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.994+0000 7fb2b37fe640 1 -- 172.21.15.70:0/240818092 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2b809c260 con 0x5641c45f61f0 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.994+0000 7fb2b37fe640 1 -- 172.21.15.70:0/240818092 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b809b4c0 con 0x5641c45f61f0 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 -- 172.21.15.70:0/240818092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f61f0 msgr2=0x5641c45f8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 --2- 172.21.15.70:0/240818092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f61f0 0x5641c45f8680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80cd2d0 tx=0x7fb2b800bf90 comp rx=0 tx=0).stop 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 -- 172.21.15.70:0/240818092 shutdown_connections 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 --2- 172.21.15.70:0/240818092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f61f0 0x5641c45f8680 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 --2- 172.21.15.70:0/240818092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c45f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 --2- 172.21.15.70:0/240818092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f0690 0x5641c45f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 -- 172.21.15.70:0/240818092 >> 172.21.15.70:0/240818092 conn(0x5641c45ebd00 msgr2=0x5641c45ec100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 -- 172.21.15.70:0/240818092 shutdown_connections 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 -- 172.21.15.70:0/240818092 wait complete. 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 -- start start 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 Processor -- start 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45fa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c45faf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c4601f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641c45f9140 con 0x5641c45f0690 2024-04-26T20:26:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5641c44dcfe0 con 0x5641c45f61f0 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5641c45f92c0 con 0x5641c45f1080 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2d238b740 10 client.0 _ll_register_callbacks cb 0x5641c44f3150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.995+0000 7fb2cd33a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45fa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2cd33a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45fa9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52946/0 (socket says 172.21.15.70:52946) 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2cd33a640 1 -- 172.21.15.70:0/3665359246 learned_addr learned my addr 172.21.15.70:0/3665359246 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2cdb3b640 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c4601f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c45faf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2cd33a640 1 -- 172.21.15.70:0/3665359246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 msgr2=0x5641c45faf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2cd33a640 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c45faf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2cd33a640 1 -- 172.21.15.70:0/3665359246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 msgr2=0x5641c4601f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2cd33a640 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c4601f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2cd33a640 1 -- 172.21.15.70:0/3665359246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c42672d0 con 0x5641c45f0690 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2cd33a640 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45fa9c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4006010 tx=0x7fb2c4032b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138c9ebd9be130fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/3665359246 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c403f070 con 0x5641c45f0690 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/3665359246 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fb2c4004240 con 0x5641c45f0690 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2d238b740 1 -- 172.21.15.70:0/3665359246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2b809c260 con 0x5641c45f0690 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/3665359246 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb2c404b050 con 0x5641c45f0690 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2d238b740 10 client.15051 fetch_fsmap learned FSMap version 24 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2d238b740 1 -- 172.21.15.70:0/3665359246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5641c43316b0 con 0x5641c45f0690 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.996+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/3665359246 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2b809c260 con 0x5641c45f0690 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.997+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/3665359246 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fb2c4004a70 con 0x5641c45f0690 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.997+0000 7fb2d238b740 10 client.15051 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.997+0000 7fb2d238b740 10 client.15051 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.997+0000 7fb2d238b740 20 client.15051 populate_metadata read hostname 'smithi070' 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.997+0000 7fb2d238b740 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x5641c4607410 0x5641c4608880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.997+0000 7fb2d238b740 4 client.15051 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.997+0000 7fb2d238b740 1 -- 172.21.15.70:0/3665359246 --> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641c4563350 con 0x5641c4607410 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.997+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x5641c4607410 0x5641c4608880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.997+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x5641c4607410 0x5641c4608880 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=36ee938bf679901 server_cookie=9decd6f8d879fc83 in_seq=0 out_seq=0 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.997+0000 7fb2b0ff9640 10 client.15051 ms_handle_connect on v2:172.21.15.80:6836/3487724503 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/3665359246 <== mds.3 v2:172.21.15.80:6836/3487724503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5641c4563350 con 0x5641c4607410 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2b0ff9640 10 client.15051 handle_command_reply: tid=0 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2d238b740 1 client.15051 shutdown 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2d238b740 1 -- 172.21.15.70:0/3665359246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 msgr2=0x5641c45fa9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2d238b740 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45fa9c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4006010 tx=0x7fb2c4032b10 comp rx=0 tx=0).stop 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2d238b740 1 -- 172.21.15.70:0/3665359246 shutdown_connections 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2d238b740 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x5641c4607410 0x5641c4608880 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2d238b740 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c4601f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2d238b740 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c45faf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2b0ff9640 0 client.15051 ms_handle_reset on v2:172.21.15.80:6836/3487724503 2024-04-26T20:26:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2d238b740 1 --2- 172.21.15.70:0/3665359246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45fa9c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2d238b740 1 -- 172.21.15.70:0/3665359246 >> 172.21.15.70:0/3665359246 conn(0x5641c45ebd00 msgr2=0x5641c45eaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2d238b740 1 -- 172.21.15.70:0/3665359246 shutdown_connections 2024-04-26T20:26:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.998+0000 7fb2d238b740 1 -- 172.21.15.70:0/3665359246 wait complete. 2024-04-26T20:26:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:44.999+0000 7fb2d238b740 20 client.15051 trim_cache size 0 max 16384 2024-04-26T20:26:45.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.016+0000 7fb2d238b740 1 Processor -- start 2024-04-26T20:26:45.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2d238b740 1 -- start start 2024-04-26T20:26:45.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45ec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c4601f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c45ea670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2d238b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641c4606bc0 con 0x5641c45f0690 2024-04-26T20:26:45.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2d238b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5641c4607290 con 0x5641c45f61f0 2024-04-26T20:26:45.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2d238b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5641c4607960 con 0x5641c45f1080 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2cd33a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45ec0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2cd33a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45ec0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52956/0 (socket says 172.21.15.70:52956) 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2cd33a640 1 -- 172.21.15.70:0/2713505332 learned_addr learned my addr 172.21.15.70:0/2713505332 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2cdb3b640 1 --2- 172.21.15.70:0/2713505332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c45ea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2cd33a640 1 -- 172.21.15.70:0/2713505332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 msgr2=0x5641c4601f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2cd33a640 1 --2- 172.21.15.70:0/2713505332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c4601f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2cd33a640 1 -- 172.21.15.70:0/2713505332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 msgr2=0x5641c45ea670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2cd33a640 1 --2- 172.21.15.70:0/2713505332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c45ea670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2cd33a640 1 -- 172.21.15.70:0/2713505332 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c45f1460 con 0x5641c45f0690 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2cd33a640 1 --2- 172.21.15.70:0/2713505332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45ec0e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb2c402a940 tx=0x7fb2c4003850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c59f2873930d7a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2b2ffd640 1 -- 172.21.15.70:0/2713505332 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c403f070 con 0x5641c45f0690 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2b2ffd640 1 -- 172.21.15.70:0/2713505332 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2c4004b90 con 0x5641c45f0690 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.017+0000 7fb2b2ffd640 1 -- 172.21.15.70:0/2713505332 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4035070 con 0x5641c45f0690 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.018+0000 7fb2d238b740 1 -- 172.21.15.70:0/2713505332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 msgr2=0x5641c45ec0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.018+0000 7fb2d238b740 1 --2- 172.21.15.70:0/2713505332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45ec0e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb2c402a940 tx=0x7fb2c4003850 comp rx=0 tx=0).stop 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.018+0000 7fb2d238b740 1 -- 172.21.15.70:0/2713505332 shutdown_connections 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.018+0000 7fb2d238b740 1 --2- 172.21.15.70:0/2713505332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c45ea670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.018+0000 7fb2d238b740 1 --2- 172.21.15.70:0/2713505332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f1080 0x5641c4601f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.018+0000 7fb2d238b740 1 --2- 172.21.15.70:0/2713505332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f0690 0x5641c45ec0e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.018+0000 7fb2d238b740 1 -- 172.21.15.70:0/2713505332 >> 172.21.15.70:0/2713505332 conn(0x5641c45ebd00 msgr2=0x5641c45f1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.018+0000 7fb2d238b740 1 -- 172.21.15.70:0/2713505332 shutdown_connections 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.018+0000 7fb2d238b740 1 -- 172.21.15.70:0/2713505332 wait complete. 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.018+0000 7fb2d238b740 1 -- start start 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.018+0000 7fb2d238b740 1 Processor -- start 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f0690 0x5641c45fdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f1080 0x5641c45fe270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2d238b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c4601290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2d238b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641c4608700 con 0x5641c45f1080 2024-04-26T20:26:45.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2d238b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5641c4608030 con 0x5641c45f61f0 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2d238b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5641c4608dd0 con 0x5641c45f0690 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2d238b740 10 client.0 _ll_register_callbacks cb 0x7fb2c4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2ccb39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f1080 0x5641c45fe270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2ccb39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f1080 0x5641c45fe270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52964/0 (socket says 172.21.15.70:52964) 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2ccb39640 1 -- 172.21.15.70:0/756219320 learned_addr learned my addr 172.21.15.70:0/756219320 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2cdb3b640 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c4601290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2ccb39640 1 -- 172.21.15.70:0/756219320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f0690 msgr2=0x5641c45fdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f0690 0x5641c45fdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2ccb39640 1 -- 172.21.15.70:0/756219320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 msgr2=0x5641c4601290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c4601290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2ccb39640 1 -- 172.21.15.70:0/756219320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c4601880 con 0x5641c45f1080 2024-04-26T20:26:45.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2ccb39640 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f1080 0x5641c45fe270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8097fc0 tx=0x7fb2b8017700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5557309ac914bbf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/756219320 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b809b6a0 con 0x5641c45f1080 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/756219320 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fb2b80bc0b0 con 0x5641c45f1080 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2d238b740 1 -- 172.21.15.70:0/756219320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2c4004b90 con 0x5641c45f1080 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/756219320 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb2b809c260 con 0x5641c45f1080 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2d238b740 10 client.15057 fetch_fsmap learned FSMap version 24 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2d238b740 1 -- 172.21.15.70:0/756219320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5641c466dae0 con 0x5641c45f1080 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.019+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/756219320 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2c4004b90 con 0x5641c45f1080 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/756219320 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fb2b8017360 con 0x5641c45f1080 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2d238b740 10 client.15057 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2d238b740 10 client.15057 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2d238b740 20 client.15057 populate_metadata read hostname 'smithi070' 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2d238b740 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x5641c4672270 0x5641c4670f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2d238b740 4 client.15057 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2d238b740 1 -- 172.21.15.70:0/756219320 --> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] -- command(tid 0: {"prefix": "status"}) -- 0x5641c455d1c0 con 0x5641c4672270 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2cd33a640 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x5641c4672270 0x5641c4670f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2b0ff9640 10 client.15057 ms_handle_connect on v2:172.21.15.80:6836/3487724503 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2cd33a640 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x5641c4672270 0x5641c4670f80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e39259072be00c97 server_cookie=d407a11d31aa1502 in_seq=0 out_seq=0 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2b0ff9640 1 -- 172.21.15.70:0/756219320 <== mds.3 v2:172.21.15.80:6836/3487724503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5641c455d1c0 con 0x5641c4672270 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2b0ff9640 10 client.15057 handle_command_reply: tid=0 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.020+0000 7fb2d238b740 1 client.15057 shutdown 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2d238b740 1 -- 172.21.15.70:0/756219320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f1080 msgr2=0x5641c45fe270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2d238b740 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f1080 0x5641c45fe270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8097fc0 tx=0x7fb2b8017700 comp rx=0 tx=0).stop 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2d238b740 1 -- 172.21.15.70:0/756219320 shutdown_connections 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2d238b740 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x5641c4672270 0x5641c4670f80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2d238b740 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5641c45f61f0 0x5641c4601290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2d238b740 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641c45f1080 0x5641c45fe270 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2b0ff9640 0 client.15057 ms_handle_reset on v2:172.21.15.80:6836/3487724503 2024-04-26T20:26:45.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2d238b740 1 --2- 172.21.15.70:0/756219320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5641c45f0690 0x5641c45fdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2d238b740 1 -- 172.21.15.70:0/756219320 >> 172.21.15.70:0/756219320 conn(0x5641c45ebd00 msgr2=0x5641c45ec0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2d238b740 1 -- 172.21.15.70:0/756219320 shutdown_connections 2024-04-26T20:26:45.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2d238b740 1 -- 172.21.15.70:0/756219320 wait complete. 2024-04-26T20:26:45.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2d238b740 20 client.15057 trim_cache size 0 max 16384 2024-04-26T20:26:45.029 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:26:45.029 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:26:45.029 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 3, 2024-04-26T20:26:45.029 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24461, 2024-04-26T20:26:45.029 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-04-26T20:26:45.029 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-04-26T20:26:45.030 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-04-26T20:26:45.030 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 85.005528749999996, 2024-04-26T20:26:45.030 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 24, 2024-04-26T20:26:45.030 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2024-04-26T20:26:45.030 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2024-04-26T20:26:45.030 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 106.578516804 2024-04-26T20:26:45.030 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:26:45.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3857691653 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2b40a3c40 msgr2=0x7fb2b40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2b40a3c40 0x7fb2b40a6100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00070b0 tx=0x7fb2c000c040 comp rx=0 tx=0).stop 2024-04-26T20:26:45.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3857691653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2c8103c20 msgr2=0x7fb2c8199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2c8103c20 0x7fb2c8199380 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800b4a0 tx=0x7fb2b800b960 comp rx=0 tx=0).stop 2024-04-26T20:26:45.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3857691653 shutdown_connections 2024-04-26T20:26:45.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2b40a3c40 0x7fb2b40a6100 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2c81045e0 0x7fb2c81a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2c8103c20 0x7fb2c8199380 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 --2- 172.21.15.70:0/3857691653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8100c50 0x7fb2c8198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3857691653 >> 172.21.15.70:0/3857691653 conn(0x7fb2c80fc560 msgr2=0x7fb2c8106ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3857691653 shutdown_connections 2024-04-26T20:26:45.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.021+0000 7fb2cf59e640 1 -- 172.21.15.70:0/3857691653 wait complete. 2024-04-26T20:26:45.032 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:44 smithi070 ceph-mon[29124]: pgmap v336: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:26:45.032 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:44 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3778793666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:45.032 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:44 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1006255185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:26:45.032 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:44 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1242288360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:45.033 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T20:26:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.131+0000 7f80afb71640 1 -- 172.21.15.70:0/4250671581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a8102a60 msgr2=0x7f80a8102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.131+0000 7f80afb71640 1 --2- 172.21.15.70:0/4250671581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a8102a60 0x7f80a8102ee0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8098009900 tx=0x7f809802a410 comp rx=0 tx=0).stop 2024-04-26T20:26:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.131+0000 7f80afb71640 1 -- 172.21.15.70:0/4250671581 shutdown_connections 2024-04-26T20:26:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.131+0000 7f80afb71640 1 --2- 172.21.15.70:0/4250671581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a8103420 0x7f80a8109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.131+0000 7f80afb71640 1 --2- 172.21.15.70:0/4250671581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a8102a60 0x7f80a8102ee0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.131+0000 7f80afb71640 1 --2- 172.21.15.70:0/4250671581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80a8101870 0x7f80a8101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.131+0000 7f80afb71640 1 -- 172.21.15.70:0/4250671581 >> 172.21.15.70:0/4250671581 conn(0x7f80a80fce00 msgr2=0x7f80a80ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80afb71640 1 -- 172.21.15.70:0/4250671581 shutdown_connections 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80afb71640 1 -- 172.21.15.70:0/4250671581 wait complete. 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80afb71640 1 Processor -- start 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80afb71640 1 -- start start 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80afb71640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a8101870 0x7f80a8198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80afb71640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80a8102a60 0x7f80a8199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80afb71640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a8103420 0x7f80a81a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80afb71640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f80a810d4d0 con 0x7f80a8103420 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80afb71640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f80a810d350 con 0x7f80a8101870 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80afb71640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f80a810d650 con 0x7f80a8102a60 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80ae10e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a8103420 0x7f80a81a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80ae10e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a8103420 0x7f80a81a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52984/0 (socket says 172.21.15.70:52984) 2024-04-26T20:26:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.132+0000 7f80ae10e640 1 -- 172.21.15.70:0/3091329367 learned_addr learned my addr 172.21.15.70:0/3091329367 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f80ad90d640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a8101870 0x7f80a8198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f80ae10e640 1 -- 172.21.15.70:0/3091329367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80a8102a60 msgr2=0x7f80a8199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f80ae10e640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80a8102a60 0x7f80a8199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f80ae10e640 1 -- 172.21.15.70:0/3091329367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a8101870 msgr2=0x7f80a8198cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f80ae10e640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a8101870 0x7f80a8198cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f80ae10e640 1 -- 172.21.15.70:0/3091329367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a81a0890 con 0x7f80a8103420 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f80ae10e640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a8103420 0x7f80a81a01f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f80a000cce0 tx=0x7f80a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f809effd640 1 -- 172.21.15.70:0/3091329367 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a000f450 con 0x7f80a8103420 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f809effd640 1 -- 172.21.15.70:0/3091329367 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80a000fac0 con 0x7f80a8103420 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f80afb71640 1 -- 172.21.15.70:0/3091329367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a81a0b80 con 0x7f80a8103420 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f809effd640 1 -- 172.21.15.70:0/3091329367 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a0018be0 con 0x7f80a8103420 2024-04-26T20:26:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.133+0000 7f80afb71640 1 -- 172.21.15.70:0/3091329367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a81a1080 con 0x7f80a8103420 2024-04-26T20:26:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.135+0000 7f809effd640 1 -- 172.21.15.70:0/3091329367 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f80a000fc70 con 0x7f80a8103420 2024-04-26T20:26:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80b2964740 1 Processor -- start 2024-04-26T20:26:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80b2964740 1 -- start start 2024-04-26T20:26:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80b2964740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1403690 0x561ab1403ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80b2964740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1404080 0x561ab1408b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80b2964740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab140b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80b2964740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561ab1368740 con 0x561ab14091f0 2024-04-26T20:26:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80b2964740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x561ab13043a0 con 0x561ab1404080 2024-04-26T20:26:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80b2964740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561ab1364700 con 0x561ab1403690 2024-04-26T20:26:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f809effd640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80940a3c40 0x7f80940a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80ad10c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab140b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80ad10c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab140b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52994/0 (socket says 172.21.15.70:52994) 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80ad10c640 1 -- 172.21.15.70:0/661748356 learned_addr learned my addr 172.21.15.70:0/661748356 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80ad10c640 1 --2- 172.21.15.70:0/661748356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1403690 0x561ab1403ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80ad90d640 1 --2- 172.21.15.70:0/661748356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1404080 0x561ab1408b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80ae10e640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80940a3c40 0x7f80940a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f809effd640 1 -- 172.21.15.70:0/3091329367 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f80a00d0db0 con 0x7f80a8103420 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80ad10c640 1 -- 172.21.15.70:0/661748356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1403690 msgr2=0x561ab1403ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.136+0000 7f80ad10c640 1 --2- 172.21.15.70:0/661748356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1403690 0x561ab1403ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.137+0000 7f80ad10c640 1 -- 172.21.15.70:0/661748356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1404080 msgr2=0x561ab1408b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.137+0000 7f80ad10c640 1 --2- 172.21.15.70:0/661748356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1404080 0x561ab1408b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.137+0000 7f80ad10c640 1 -- 172.21.15.70:0/661748356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ab1320750 con 0x561ab14091f0 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.137+0000 7f80ad90d640 1 --2- 172.21.15.70:0/661748356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1404080 0x561ab1408b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.137+0000 7f80ad10c640 1 --2- 172.21.15.70:0/661748356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab140b680 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8098005ec0 tx=0x7f8098005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f99e5f303298bf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.137+0000 7f80ae10e640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80940a3c40 0x7f80940a6100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f80a009cc20 tx=0x7f80a006b890 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.137+0000 7f8093fff640 1 -- 172.21.15.70:0/661748356 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098035070 con 0x561ab14091f0 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.137+0000 7f8093fff640 1 -- 172.21.15.70:0/661748356 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80980035f0 con 0x561ab14091f0 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.137+0000 7f8093fff640 1 -- 172.21.15.70:0/661748356 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809803c610 con 0x561ab14091f0 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 -- 172.21.15.70:0/661748356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 msgr2=0x561ab140b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 --2- 172.21.15.70:0/661748356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab140b680 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8098005ec0 tx=0x7f8098005a20 comp rx=0 tx=0).stop 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 -- 172.21.15.70:0/661748356 shutdown_connections 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 --2- 172.21.15.70:0/661748356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab140b680 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 --2- 172.21.15.70:0/661748356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1404080 0x561ab1408b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 --2- 172.21.15.70:0/661748356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1403690 0x561ab1403ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 -- 172.21.15.70:0/661748356 >> 172.21.15.70:0/661748356 conn(0x561ab13fed00 msgr2=0x561ab13ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 -- 172.21.15.70:0/661748356 shutdown_connections 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 -- 172.21.15.70:0/661748356 wait complete. 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 -- start start 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 Processor -- start 2024-04-26T20:26:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1403690 0x561ab140dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1404080 0x561ab140dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.138+0000 7f80b2964740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab14091f0 0x561ab1415030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80b2964740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561ab140c140 con 0x561ab1404080 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80b2964740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x561ab12effe0 con 0x561ab1403690 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80b2964740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561ab140c2c0 con 0x561ab14091f0 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80b2964740 10 client.0 _ll_register_callbacks cb 0x561ab1306150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80ad90d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1404080 0x561ab140dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80ad90d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1404080 0x561ab140dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53004/0 (socket says 172.21.15.70:53004) 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80ad90d640 1 -- 172.21.15.70:0/459092527 learned_addr learned my addr 172.21.15.70:0/459092527 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80ad10c640 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1403690 0x561ab140dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80ad10c640 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab14091f0 0x561ab1415030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80ad90d640 1 -- 172.21.15.70:0/459092527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab14091f0 msgr2=0x561ab1415030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80ad90d640 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab14091f0 0x561ab1415030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80ad90d640 1 -- 172.21.15.70:0/459092527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1403690 msgr2=0x561ab140dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80ad90d640 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1403690 0x561ab140dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80ad90d640 1 -- 172.21.15.70:0/459092527 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ab107a2d0 con 0x561ab1404080 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80ad90d640 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1404080 0x561ab140dff0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f80a400be80 tx=0x7f80a40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64e2179adb9e375 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80917fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80917fa640 1 -- 172.21.15.70:0/459092527 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4004440 con 0x561ab1404080 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80917fa640 1 -- 172.21.15.70:0/459092527 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f80a40035f0 con 0x561ab1404080 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80b2964740 1 -- 172.21.15.70:0/459092527 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80980035f0 con 0x561ab1404080 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80917fa640 1 -- 172.21.15.70:0/459092527 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f80a40037f0 con 0x561ab1404080 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80b2964740 10 client.15069 fetch_fsmap learned FSMap version 24 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.139+0000 7f80b2964740 1 -- 172.21.15.70:0/459092527 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561ab11446b0 con 0x561ab1404080 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.140+0000 7f80917fa640 1 -- 172.21.15.70:0/459092527 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80980035f0 con 0x561ab1404080 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.140+0000 7f80917fa640 1 -- 172.21.15.70:0/459092527 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f80a401bbb0 con 0x561ab1404080 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.140+0000 7f80b2964740 10 client.15069 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.140+0000 7f80b2964740 10 client.15069 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T20:26:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.140+0000 7f80b2964740 20 client.15069 populate_metadata read hostname 'smithi070' 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.140+0000 7f80b2964740 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x561ab141a520 0x561ab141b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.140+0000 7f80b2964740 4 client.15069 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.140+0000 7f80b2964740 1 -- 172.21.15.70:0/459092527 --> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ab1376350 con 0x561ab141a520 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.140+0000 7f80ad10c640 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x561ab141a520 0x561ab141b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.140+0000 7f80917fa640 10 client.15069 ms_handle_connect on v2:172.21.15.98:6836/3751464822 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.140+0000 7f80ad10c640 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x561ab141a520 0x561ab141b990 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=943f5b0c45ea1ab9 server_cookie=938367de622544ac in_seq=0 out_seq=0 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.141+0000 7f80917fa640 1 -- 172.21.15.70:0/459092527 <== mds.2 v2:172.21.15.98:6836/3751464822 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561ab1376350 con 0x561ab141a520 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.141+0000 7f80917fa640 10 client.15069 handle_command_reply: tid=0 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.141+0000 7f80b2964740 1 client.15069 shutdown 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.141+0000 7f80b2964740 1 -- 172.21.15.70:0/459092527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1404080 msgr2=0x561ab140dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.141+0000 7f80b2964740 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1404080 0x561ab140dff0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f80a400be80 tx=0x7f80a40117b0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.142+0000 7f80b2964740 1 -- 172.21.15.70:0/459092527 shutdown_connections 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.142+0000 7f80b2964740 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x561ab141a520 0x561ab141b990 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.142+0000 7f80b2964740 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab14091f0 0x561ab1415030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.142+0000 7f80b2964740 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1404080 0x561ab140dff0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.142+0000 7f80917fa640 0 client.15069 ms_handle_reset on v2:172.21.15.98:6836/3751464822 2024-04-26T20:26:45.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.142+0000 7f80b2964740 1 --2- 172.21.15.70:0/459092527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1403690 0x561ab140dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.142+0000 7f80b2964740 1 -- 172.21.15.70:0/459092527 >> 172.21.15.70:0/459092527 conn(0x561ab13fed00 msgr2=0x561ab13fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.142+0000 7f80b2964740 1 -- 172.21.15.70:0/459092527 shutdown_connections 2024-04-26T20:26:45.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.142+0000 7f80b2964740 1 -- 172.21.15.70:0/459092527 wait complete. 2024-04-26T20:26:45.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.142+0000 7f80b2964740 20 client.15069 trim_cache size 0 max 16384 2024-04-26T20:26:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80b2964740 1 Processor -- start 2024-04-26T20:26:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80b2964740 1 -- start start 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80b2964740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1403690 0x561ab140d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80b2964740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1404080 0x561ab140dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80b2964740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab14091f0 0x561ab1401c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80b2964740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561ab1419cd0 con 0x561ab1403690 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80b2964740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x561ab141a3a0 con 0x561ab14091f0 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80b2964740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561ab141aa70 con 0x561ab1404080 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80ad10c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1403690 0x561ab140d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80ad10c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1403690 0x561ab140d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53020/0 (socket says 172.21.15.70:53020) 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80ad10c640 1 -- 172.21.15.70:0/579726842 learned_addr learned my addr 172.21.15.70:0/579726842 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80ad10c640 1 -- 172.21.15.70:0/579726842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1404080 msgr2=0x561ab140dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80ad10c640 1 --2- 172.21.15.70:0/579726842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1404080 0x561ab140dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80ad10c640 1 -- 172.21.15.70:0/579726842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab14091f0 msgr2=0x561ab1401c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80ad10c640 1 --2- 172.21.15.70:0/579726842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab14091f0 0x561ab1401c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80ad10c640 1 -- 172.21.15.70:0/579726842 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ab140ebe0 con 0x561ab1403690 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80ad10c640 1 --2- 172.21.15.70:0/579726842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1403690 0x561ab140d6c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8098000c00 tx=0x7f8098031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e090c530fff845 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80937fe640 1 -- 172.21.15.70:0/579726842 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098035040 con 0x561ab1403690 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80937fe640 1 -- 172.21.15.70:0/579726842 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8098053030 con 0x561ab1403690 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.160+0000 7f80937fe640 1 -- 172.21.15.70:0/579726842 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098003d00 con 0x561ab1403690 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.161+0000 7f80b2964740 1 -- 172.21.15.70:0/579726842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1403690 msgr2=0x561ab140d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.161+0000 7f80b2964740 1 --2- 172.21.15.70:0/579726842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1403690 0x561ab140d6c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8098000c00 tx=0x7f8098031a60 comp rx=0 tx=0).stop 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.161+0000 7f80b2964740 1 -- 172.21.15.70:0/579726842 shutdown_connections 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.161+0000 7f80b2964740 1 --2- 172.21.15.70:0/579726842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab14091f0 0x561ab1401c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.161+0000 7f80b2964740 1 --2- 172.21.15.70:0/579726842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1404080 0x561ab140dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.161+0000 7f80b2964740 1 --2- 172.21.15.70:0/579726842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab1403690 0x561ab140d6c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.161+0000 7f80b2964740 1 -- 172.21.15.70:0/579726842 >> 172.21.15.70:0/579726842 conn(0x561ab13fed00 msgr2=0x561ab14054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.161+0000 7f80b2964740 1 -- 172.21.15.70:0/579726842 shutdown_connections 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.161+0000 7f80b2964740 1 -- 172.21.15.70:0/579726842 wait complete. 2024-04-26T20:26:45.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.161+0000 7f80b2964740 1 -- start start 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.161+0000 7f80b2964740 1 Processor -- start 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80b2964740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1403690 0x561ab147e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80b2964740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1404080 0x561ab1480c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80b2964740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab1483190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80b2964740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561ab141b810 con 0x561ab14091f0 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80b2964740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x561ab141b140 con 0x561ab1403690 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80b2964740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561ab141bee0 con 0x561ab1404080 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80b2964740 10 client.0 _ll_register_callbacks cb 0x7f80a400b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad10c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab1483190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad10c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab1483190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53026/0 (socket says 172.21.15.70:53026) 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad10c640 1 -- 172.21.15.70:0/3700776780 learned_addr learned my addr 172.21.15.70:0/3700776780 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad10c640 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1403690 0x561ab147e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad90d640 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1404080 0x561ab1480c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad10c640 1 -- 172.21.15.70:0/3700776780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1404080 msgr2=0x561ab1480c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad10c640 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1404080 0x561ab1480c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad10c640 1 -- 172.21.15.70:0/3700776780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1403690 msgr2=0x561ab147e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad10c640 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1403690 0x561ab147e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad10c640 1 -- 172.21.15.70:0/3700776780 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ab14839c0 con 0x561ab14091f0 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad90d640 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1404080 0x561ab1480c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80ad10c640 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab1483190 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f809802ac00 tx=0x7f809805a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247988973c07695c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80917fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80917fa640 1 -- 172.21.15.70:0/3700776780 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098004280 con 0x561ab14091f0 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80917fa640 1 -- 172.21.15.70:0/3700776780 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f8098005050 con 0x561ab14091f0 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.162+0000 7f80b2964740 1 -- 172.21.15.70:0/3700776780 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8098053030 con 0x561ab14091f0 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80917fa640 1 -- 172.21.15.70:0/3700776780 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8098005250 con 0x561ab14091f0 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80b2964740 10 client.15075 fetch_fsmap learned FSMap version 24 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80b2964740 1 -- 172.21.15.70:0/3700776780 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561ab1484cc0 con 0x561ab14091f0 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80917fa640 1 -- 172.21.15.70:0/3700776780 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8098053030 con 0x561ab14091f0 2024-04-26T20:26:45.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80917fa640 1 -- 172.21.15.70:0/3700776780 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f809803a040 con 0x561ab14091f0 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80b2964740 10 client.15075 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80b2964740 10 client.15075 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80b2964740 20 client.15075 populate_metadata read hostname 'smithi070' 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80b2964740 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x561ab1489160 0x561ab1487e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80b2964740 4 client.15075 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80b2964740 1 -- 172.21.15.70:0/3700776780 --> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] -- command(tid 0: {"prefix": "status"}) -- 0x561ab13701c0 con 0x561ab1489160 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.163+0000 7f80ad90d640 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x561ab1489160 0x561ab1487e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80917fa640 10 client.15075 ms_handle_connect on v2:172.21.15.98:6836/3751464822 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80ad90d640 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x561ab1489160 0x561ab1487e70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=18d3ecf39f85814 server_cookie=c6332186f4f321d1 in_seq=0 out_seq=0 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80917fa640 1 -- 172.21.15.70:0/3700776780 <== mds.2 v2:172.21.15.98:6836/3751464822 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561ab13701c0 con 0x561ab1489160 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80917fa640 10 client.15075 handle_command_reply: tid=0 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 1 client.15075 shutdown 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 1 -- 172.21.15.70:0/3700776780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 msgr2=0x561ab1483190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab1483190 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f809802ac00 tx=0x7f809805a040 comp rx=0 tx=0).stop 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 1 -- 172.21.15.70:0/3700776780 shutdown_connections 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x561ab1489160 0x561ab1487e70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80917fa640 0 client.15075 ms_handle_reset on v2:172.21.15.98:6836/3751464822 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ab14091f0 0x561ab1483190 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ab1404080 0x561ab1480c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 1 --2- 172.21.15.70:0/3700776780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561ab1403690 0x561ab147e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 1 -- 172.21.15.70:0/3700776780 >> 172.21.15.70:0/3700776780 conn(0x561ab13fed00 msgr2=0x561ab14054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 1 -- 172.21.15.70:0/3700776780 shutdown_connections 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 1 -- 172.21.15.70:0/3700776780 wait complete. 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.164+0000 7f80b2964740 20 client.15075 trim_cache size 0 max 16384 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:26:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:26:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-04-26T20:26:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24463, 2024-04-26T20:26:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-04-26T20:26:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-04-26T20:26:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-04-26T20:26:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 86.157028198000006, 2024-04-26T20:26:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 24, 2024-04-26T20:26:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2024-04-26T20:26:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2024-04-26T20:26:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 109.841840436 2024-04-26T20:26:45.172 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:26:45.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 -- 172.21.15.70:0/3091329367 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80940a3c40 msgr2=0x7f80940a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80940a3c40 0x7f80940a6100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f80a009cc20 tx=0x7f80a006b890 comp rx=0 tx=0).stop 2024-04-26T20:26:45.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 -- 172.21.15.70:0/3091329367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a8103420 msgr2=0x7f80a81a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a8103420 0x7f80a81a01f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f80a000cce0 tx=0x7f80a000a620 comp rx=0 tx=0).stop 2024-04-26T20:26:45.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 -- 172.21.15.70:0/3091329367 shutdown_connections 2024-04-26T20:26:45.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f80940a3c40 0x7f80940a6100 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a8103420 0x7f80a81a01f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80a8102a60 0x7f80a8199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 --2- 172.21.15.70:0/3091329367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a8101870 0x7f80a8198cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 -- 172.21.15.70:0/3091329367 >> 172.21.15.70:0/3091329367 conn(0x7f80a80fce00 msgr2=0x7f80a8069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 -- 172.21.15.70:0/3091329367 shutdown_connections 2024-04-26T20:26:45.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.165+0000 7f80afb71640 1 -- 172.21.15.70:0/3091329367 wait complete. 2024-04-26T20:26:45.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-26T20:26:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:44 smithi098 ceph-mon[32591]: pgmap v336: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:26:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:44 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3778793666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:44 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1006255185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:26:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:44 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1242288360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:44 smithi080 ceph-mon[32278]: pgmap v336: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:26:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:44 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3778793666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:44 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1006255185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:26:45.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:44 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1242288360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:45.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.274+0000 7f52b04b0640 1 -- 172.21.15.70:0/234749483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52a8102a60 msgr2=0x7f52a8102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.274+0000 7f52b04b0640 1 --2- 172.21.15.70:0/234749483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52a8102a60 0x7f52a8102ee0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5298009900 tx=0x7f529802a410 comp rx=0 tx=0).stop 2024-04-26T20:26:45.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.274+0000 7f52b04b0640 1 -- 172.21.15.70:0/234749483 shutdown_connections 2024-04-26T20:26:45.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.274+0000 7f52b04b0640 1 --2- 172.21.15.70:0/234749483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52a8103420 0x7f52a8109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.274+0000 7f52b04b0640 1 --2- 172.21.15.70:0/234749483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52a8102a60 0x7f52a8102ee0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.274+0000 7f52b04b0640 1 --2- 172.21.15.70:0/234749483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a8101870 0x7f52a8101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.274+0000 7f52b04b0640 1 -- 172.21.15.70:0/234749483 >> 172.21.15.70:0/234749483 conn(0x7f52a80fce00 msgr2=0x7f52a80ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52b04b0640 1 -- 172.21.15.70:0/234749483 shutdown_connections 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52b04b0640 1 -- 172.21.15.70:0/234749483 wait complete. 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52b04b0640 1 Processor -- start 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52b04b0640 1 -- start start 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52b04b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52a8101870 0x7f52a8105800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52b04b0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52a8102a60 0x7f52a8103e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52b04b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a8103420 0x7f52a8104380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52b04b0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f52a810d550 con 0x7f52a8102a60 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52b04b0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f52a810d3d0 con 0x7f52a8101870 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52b04b0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f52a810d6d0 con 0x7f52a8103420 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52ada4b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52a8102a60 0x7f52a8103e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52ada4b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52a8102a60 0x7f52a8103e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53032/0 (socket says 172.21.15.70:53032) 2024-04-26T20:26:45.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.275+0000 7f52ada4b640 1 -- 172.21.15.70:0/1963794956 learned_addr learned my addr 172.21.15.70:0/1963794956 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f52ada4b640 1 -- 172.21.15.70:0/1963794956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a8103420 msgr2=0x7f52a8104380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f52ada4b640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a8103420 0x7f52a8104380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f52ada4b640 1 -- 172.21.15.70:0/1963794956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52a8101870 msgr2=0x7f52a8105800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f52ae24c640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52a8101870 0x7f52a8105800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f52ada4b640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52a8101870 0x7f52a8105800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f52ada4b640 1 -- 172.21.15.70:0/1963794956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a8104c10 con 0x7f52a8102a60 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f52ae24c640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52a8101870 0x7f52a8105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f52ada4b640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52a8102a60 0x7f52a8103e40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5298006010 tx=0x7f5298004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f529f7fe640 1 -- 172.21.15.70:0/1963794956 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529803f030 con 0x7f52a8102a60 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f529f7fe640 1 -- 172.21.15.70:0/1963794956 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5298003cd0 con 0x7f52a8102a60 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f52b04b0640 1 -- 172.21.15.70:0/1963794956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a81a2ea0 con 0x7f52a8102a60 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f529f7fe640 1 -- 172.21.15.70:0/1963794956 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5298035070 con 0x7f52a8102a60 2024-04-26T20:26:45.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.276+0000 7f52b04b0640 1 -- 172.21.15.70:0/1963794956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a81a3380 con 0x7f52a8102a60 2024-04-26T20:26:45.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.278+0000 7f529f7fe640 1 -- 172.21.15.70:0/1963794956 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5298042030 con 0x7f52a8102a60 2024-04-26T20:26:45.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52b31c8740 1 Processor -- start 2024-04-26T20:26:45.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52b31c8740 1 -- start start 2024-04-26T20:26:45.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb01690 0x55acdfb01ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb02080 0x55acdfb06b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb071f0 0x55acdfb09680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52b31c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55acdfa66740 con 0x55acdfb02080 2024-04-26T20:26:45.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52b31c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55acdfa023a0 con 0x55acdfb071f0 2024-04-26T20:26:45.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52b31c8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55acdfa62700 con 0x55acdfb01690 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f529f7fe640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f52940a3c40 0x7f52940a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52ae24c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb02080 0x55acdfb06b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52aea4d640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f52940a3c40 0x7f52940a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52ae24c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb02080 0x55acdfb06b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53034/0 (socket says 172.21.15.70:53034) 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52ae24c640 1 -- 172.21.15.70:0/1290808592 learned_addr learned my addr 172.21.15.70:0/1290808592 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f529f7fe640 1 -- 172.21.15.70:0/1963794956 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f52980f0ce0 con 0x7f52a8102a60 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52aea4d640 1 --2- 172.21.15.70:0/1290808592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb01690 0x55acdfb01ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52ada4b640 1 --2- 172.21.15.70:0/1290808592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb071f0 0x55acdfb09680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52ae24c640 1 -- 172.21.15.70:0/1290808592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb01690 msgr2=0x55acdfb01ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52ae24c640 1 --2- 172.21.15.70:0/1290808592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb01690 0x55acdfb01ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52ae24c640 1 -- 172.21.15.70:0/1290808592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb071f0 msgr2=0x55acdfb09680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52ae24c640 1 --2- 172.21.15.70:0/1290808592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb071f0 0x55acdfb09680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.279+0000 7f52ae24c640 1 -- 172.21.15.70:0/1290808592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdfa1e750 con 0x55acdfb02080 2024-04-26T20:26:45.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.280+0000 7f52aea4d640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f52940a3c40 0x7f52940a6100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52a00133e0 tx=0x7f52a00137e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.280+0000 7f52ae24c640 1 --2- 172.21.15.70:0/1290808592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb02080 0x55acdfb06b80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009c30 tx=0x7f52a400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9ec1a32efc69c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.280+0000 7f529cbfe640 1 -- 172.21.15.70:0/1290808592 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4016070 con 0x55acdfb02080 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.280+0000 7f529cbfe640 1 -- 172.21.15.70:0/1290808592 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52a40054f0 con 0x55acdfb02080 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.280+0000 7f529cbfe640 1 -- 172.21.15.70:0/1290808592 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4011470 con 0x55acdfb02080 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.280+0000 7f52b31c8740 1 -- 172.21.15.70:0/1290808592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb02080 msgr2=0x55acdfb06b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.280+0000 7f52b31c8740 1 --2- 172.21.15.70:0/1290808592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb02080 0x55acdfb06b80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009c30 tx=0x7f52a400e6c0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 -- 172.21.15.70:0/1290808592 shutdown_connections 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 --2- 172.21.15.70:0/1290808592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb071f0 0x55acdfb09680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 --2- 172.21.15.70:0/1290808592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb02080 0x55acdfb06b80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 --2- 172.21.15.70:0/1290808592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb01690 0x55acdfb01ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 -- 172.21.15.70:0/1290808592 >> 172.21.15.70:0/1290808592 conn(0x55acdfafcd00 msgr2=0x55acdfafd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 -- 172.21.15.70:0/1290808592 shutdown_connections 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 -- 172.21.15.70:0/1290808592 wait complete. 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 -- start start 2024-04-26T20:26:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 Processor -- start 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb01690 0x55acdfb0bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb02080 0x55acdfb0c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb071f0 0x55acdfb13090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55acdfb0a1a0 con 0x55acdfb01690 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55acdf9edfe0 con 0x55acdfb02080 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55acdfb0a320 con 0x55acdfb071f0 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52b31c8740 10 client.0 _ll_register_callbacks cb 0x55acdfa04150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52ae24c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb01690 0x55acdfb0bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52ae24c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb01690 0x55acdfb0bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53048/0 (socket says 172.21.15.70:53048) 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52ae24c640 1 -- 172.21.15.70:0/3699925300 learned_addr learned my addr 172.21.15.70:0/3699925300 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52aea4d640 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb071f0 0x55acdfb13090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52ae24c640 1 -- 172.21.15.70:0/3699925300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb071f0 msgr2=0x55acdfb13090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52ae24c640 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb071f0 0x55acdfb13090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52ae24c640 1 -- 172.21.15.70:0/3699925300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb02080 msgr2=0x55acdfb0c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.281+0000 7f52ae24c640 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb02080 0x55acdfb0c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52ae24c640 1 -- 172.21.15.70:0/3699925300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acdf7782d0 con 0x55acdfb01690 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52aea4d640 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb071f0 0x55acdfb13090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52ae24c640 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb01690 0x55acdfb0bb10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f52a4005e70 tx=0x7f52a4009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bb8e79b621b264 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f5291ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f5291ffb640 1 -- 172.21.15.70:0/3699925300 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4028060 con 0x55acdfb01690 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f5291ffb640 1 -- 172.21.15.70:0/3699925300 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f52a4004f10 con 0x55acdfb01690 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52b31c8740 1 -- 172.21.15.70:0/3699925300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52a40054f0 con 0x55acdfb01690 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f5291ffb640 1 -- 172.21.15.70:0/3699925300 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f52a4016040 con 0x55acdfb01690 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52b31c8740 10 client.15087 fetch_fsmap learned FSMap version 24 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52b31c8740 1 -- 172.21.15.70:0/3699925300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55acdf8426b0 con 0x55acdfb01690 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f5291ffb640 1 -- 172.21.15.70:0/3699925300 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52a40054f0 con 0x55acdfb01690 2024-04-26T20:26:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f5291ffb640 1 -- 172.21.15.70:0/3699925300 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f52a400f040 con 0x55acdfb01690 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52b31c8740 10 client.15087 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52b31c8740 10 client.15087 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52b31c8740 20 client.15087 populate_metadata read hostname 'smithi070' 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x55acdfb18160 0x55acdfb195d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52b31c8740 4 client.15087 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.282+0000 7f52b31c8740 1 -- 172.21.15.70:0/3699925300 --> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acdfa74350 con 0x55acdfb18160 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.283+0000 7f52ada4b640 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x55acdfb18160 0x55acdfb195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.283+0000 7f52ada4b640 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x55acdfb18160 0x55acdfb195d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ff3a8d263d2b5891 server_cookie=cbc052e0d00437e1 in_seq=0 out_seq=0 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.283+0000 7f5291ffb640 10 client.15087 ms_handle_connect on v2:172.21.15.98:6838/4073846722 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f5291ffb640 1 -- 172.21.15.70:0/3699925300 <== mds.1 v2:172.21.15.98:6838/4073846722 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55acdfa74350 con 0x55acdfb18160 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f5291ffb640 10 client.15087 handle_command_reply: tid=0 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 1 client.15087 shutdown 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 1 -- 172.21.15.70:0/3699925300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb01690 msgr2=0x55acdfb0bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb01690 0x55acdfb0bb10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f52a4005e70 tx=0x7f52a4009740 comp rx=0 tx=0).stop 2024-04-26T20:26:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 1 -- 172.21.15.70:0/3699925300 shutdown_connections 2024-04-26T20:26:45.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x55acdfb18160 0x55acdfb195d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb071f0 0x55acdfb13090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb02080 0x55acdfb0c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f5291ffb640 0 client.15087 ms_handle_reset on v2:172.21.15.98:6838/4073846722 2024-04-26T20:26:45.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3699925300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb01690 0x55acdfb0bb10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 1 -- 172.21.15.70:0/3699925300 >> 172.21.15.70:0/3699925300 conn(0x55acdfafcd00 msgr2=0x55acdfafbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 1 -- 172.21.15.70:0/3699925300 shutdown_connections 2024-04-26T20:26:45.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 1 -- 172.21.15.70:0/3699925300 wait complete. 2024-04-26T20:26:45.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.284+0000 7f52b31c8740 20 client.15087 trim_cache size 0 max 16384 2024-04-26T20:26:45.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52b31c8740 1 Processor -- start 2024-04-26T20:26:45.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52b31c8740 1 -- start start 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb01690 0x55acdfafbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb02080 0x55acdfafc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb13050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52b31c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55acdfb17910 con 0x55acdfb071f0 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52b31c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55acdfb17fe0 con 0x55acdfb02080 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52b31c8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55acdfb186b0 con 0x55acdfb01690 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52aea4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb13050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52aea4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb13050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53064/0 (socket says 172.21.15.70:53064) 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52aea4d640 1 -- 172.21.15.70:0/198419820 learned_addr learned my addr 172.21.15.70:0/198419820 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52ae24c640 1 --2- 172.21.15.70:0/198419820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb01690 0x55acdfafbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52aea4d640 1 -- 172.21.15.70:0/198419820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb01690 msgr2=0x55acdfafbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52aea4d640 1 --2- 172.21.15.70:0/198419820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb01690 0x55acdfafbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52aea4d640 1 -- 172.21.15.70:0/198419820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb02080 msgr2=0x55acdfafc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52aea4d640 1 --2- 172.21.15.70:0/198419820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb02080 0x55acdfafc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.302+0000 7f52aea4d640 1 -- 172.21.15.70:0/198419820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdfb0cc40 con 0x55acdfb071f0 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f52aea4d640 1 --2- 172.21.15.70:0/198419820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb13050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f52a0004c30 tx=0x7f52a0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d9ae90634526b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f5293fff640 1 -- 172.21.15.70:0/198419820 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0028070 con 0x55acdfb071f0 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f5293fff640 1 -- 172.21.15.70:0/198419820 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52a00198f0 con 0x55acdfb071f0 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f5293fff640 1 -- 172.21.15.70:0/198419820 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0017850 con 0x55acdfb071f0 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f52b31c8740 1 -- 172.21.15.70:0/198419820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 msgr2=0x55acdfb13050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f52b31c8740 1 --2- 172.21.15.70:0/198419820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb13050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f52a0004c30 tx=0x7f52a0019000 comp rx=0 tx=0).stop 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f52b31c8740 1 -- 172.21.15.70:0/198419820 shutdown_connections 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f52b31c8740 1 --2- 172.21.15.70:0/198419820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb13050 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f52b31c8740 1 --2- 172.21.15.70:0/198419820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb02080 0x55acdfafc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f52b31c8740 1 --2- 172.21.15.70:0/198419820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb01690 0x55acdfafbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f52b31c8740 1 -- 172.21.15.70:0/198419820 >> 172.21.15.70:0/198419820 conn(0x55acdfafcd00 msgr2=0x55acdfafb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.303+0000 7f52b31c8740 1 -- 172.21.15.70:0/198419820 shutdown_connections 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52b31c8740 1 -- 172.21.15.70:0/198419820 wait complete. 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52b31c8740 1 -- start start 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52b31c8740 1 Processor -- start 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb01690 0x55acdfb0ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb02080 0x55acdfb0f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52b31c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb123f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52b31c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55acdfb19450 con 0x55acdfb071f0 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52b31c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55acdfb18d80 con 0x55acdfb01690 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52b31c8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55acdfb19b20 con 0x55acdfb02080 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52b31c8740 10 client.0 _ll_register_callbacks cb 0x7f52a4009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52aea4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52aea4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb123f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53078/0 (socket says 172.21.15.70:53078) 2024-04-26T20:26:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52aea4d640 1 -- 172.21.15.70:0/3767039649 learned_addr learned my addr 172.21.15.70:0/3767039649 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52ae24c640 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb01690 0x55acdfb0ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52aea4d640 1 -- 172.21.15.70:0/3767039649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb02080 msgr2=0x55acdfb0f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52ada4b640 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb02080 0x55acdfb0f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52aea4d640 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb02080 0x55acdfb0f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52aea4d640 1 -- 172.21.15.70:0/3767039649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb01690 msgr2=0x55acdfb0ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52aea4d640 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb01690 0x55acdfb0ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52aea4d640 1 -- 172.21.15.70:0/3767039649 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acdfb129e0 con 0x55acdfb071f0 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52ae24c640 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb01690 0x55acdfb0ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.304+0000 7f52aea4d640 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb123f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f52a0007b50 tx=0x7f52a0019cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1897f3d2df9325 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f5291ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f5291ffb640 1 -- 172.21.15.70:0/3767039649 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0028030 con 0x55acdfb071f0 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f5291ffb640 1 -- 172.21.15.70:0/3767039649 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f52a00177a0 con 0x55acdfb071f0 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f52b31c8740 1 -- 172.21.15.70:0/3767039649 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52a00198f0 con 0x55acdfb071f0 2024-04-26T20:26:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f5291ffb640 1 -- 172.21.15.70:0/3767039649 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f52a00179a0 con 0x55acdfb071f0 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f52b31c8740 10 client.15093 fetch_fsmap learned FSMap version 24 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f52b31c8740 1 -- 172.21.15.70:0/3767039649 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55acdfb7e870 con 0x55acdfb071f0 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f5291ffb640 1 -- 172.21.15.70:0/3767039649 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52a00198f0 con 0x55acdfb071f0 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f5291ffb640 1 -- 172.21.15.70:0/3767039649 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f52a0022070 con 0x55acdfb071f0 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f52b31c8740 10 client.15093 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f52b31c8740 10 client.15093 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f52b31c8740 20 client.15093 populate_metadata read hostname 'smithi070' 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x55acdfb83170 0x55acdfb81e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f52b31c8740 4 client.15093 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.305+0000 7f52b31c8740 1 -- 172.21.15.70:0/3767039649 --> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] -- command(tid 0: {"prefix": "status"}) -- 0x55acdfa6e1c0 con 0x55acdfb83170 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.306+0000 7f52ae24c640 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x55acdfb83170 0x55acdfb81e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.306+0000 7f5291ffb640 10 client.15093 ms_handle_connect on v2:172.21.15.98:6838/4073846722 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.306+0000 7f52ae24c640 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x55acdfb83170 0x55acdfb81e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=33a23441eda19957 server_cookie=99bb94cc6d6011d9 in_seq=0 out_seq=0 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.306+0000 7f5291ffb640 1 -- 172.21.15.70:0/3767039649 <== mds.1 v2:172.21.15.98:6838/4073846722 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55acdfa6e1c0 con 0x55acdfb83170 2024-04-26T20:26:45.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.306+0000 7f5291ffb640 10 client.15093 handle_command_reply: tid=0 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.306+0000 7f52b31c8740 1 client.15093 shutdown 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.306+0000 7f52b31c8740 1 -- 172.21.15.70:0/3767039649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 msgr2=0x55acdfb123f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.306+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb123f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f52a0007b50 tx=0x7f52a0019cd0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.306+0000 7f52b31c8740 1 -- 172.21.15.70:0/3767039649 shutdown_connections 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.306+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x55acdfb83170 0x55acdfb81e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acdfb071f0 0x55acdfb123f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f5291ffb640 0 client.15093 ms_handle_reset on v2:172.21.15.98:6838/4073846722 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55acdfb02080 0x55acdfb0f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b31c8740 1 --2- 172.21.15.70:0/3767039649 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55acdfb01690 0x55acdfb0ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b31c8740 1 -- 172.21.15.70:0/3767039649 >> 172.21.15.70:0/3767039649 conn(0x55acdfafcd00 msgr2=0x55acdfafbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b31c8740 1 -- 172.21.15.70:0/3767039649 shutdown_connections 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b31c8740 1 -- 172.21.15.70:0/3767039649 wait complete. 2024-04-26T20:26:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b31c8740 20 client.15093 trim_cache size 0 max 16384 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24481, 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 87.319819683999995, 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 24, 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2024-04-26T20:26:45.315 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 104.060938564 2024-04-26T20:26:45.316 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:26:45.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 -- 172.21.15.70:0/1963794956 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f52940a3c40 msgr2=0x7f52940a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f52940a3c40 0x7f52940a6100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52a00133e0 tx=0x7f52a00137e0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 -- 172.21.15.70:0/1963794956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52a8102a60 msgr2=0x7f52a8103e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52a8102a60 0x7f52a8103e40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5298006010 tx=0x7f5298004430 comp rx=0 tx=0).stop 2024-04-26T20:26:45.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 -- 172.21.15.70:0/1963794956 shutdown_connections 2024-04-26T20:26:45.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f52940a3c40 0x7f52940a6100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52a8103420 0x7f52a8104380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52a8102a60 0x7f52a8103e40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 --2- 172.21.15.70:0/1963794956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52a8101870 0x7f52a8105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 -- 172.21.15.70:0/1963794956 >> 172.21.15.70:0/1963794956 conn(0x7f52a80fce00 msgr2=0x7f52a80fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 -- 172.21.15.70:0/1963794956 shutdown_connections 2024-04-26T20:26:45.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.307+0000 7f52b04b0640 1 -- 172.21.15.70:0/1963794956 wait complete. 2024-04-26T20:26:45.319 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T20:26:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.416+0000 7ffa16119640 1 -- 172.21.15.70:0/235097387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10103b80 msgr2=0x7ffa10104000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.416+0000 7ffa16119640 1 --2- 172.21.15.70:0/235097387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10103b80 0x7ffa10104000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009900 tx=0x7ffa0402a410 comp rx=0 tx=0).stop 2024-04-26T20:26:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.416+0000 7ffa16119640 1 -- 172.21.15.70:0/235097387 shutdown_connections 2024-04-26T20:26:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.416+0000 7ffa16119640 1 --2- 172.21.15.70:0/235097387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa10104540 0x7ffa1010add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.416+0000 7ffa16119640 1 --2- 172.21.15.70:0/235097387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10103b80 0x7ffa10104000 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.416+0000 7ffa16119640 1 --2- 172.21.15.70:0/235097387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa10102990 0x7ffa10102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.416+0000 7ffa16119640 1 -- 172.21.15.70:0/235097387 >> 172.21.15.70:0/235097387 conn(0x7ffa100fdf00 msgr2=0x7ffa10100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.416+0000 7ffa16119640 1 -- 172.21.15.70:0/235097387 shutdown_connections 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.416+0000 7ffa16119640 1 -- 172.21.15.70:0/235097387 wait complete. 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa16119640 1 Processor -- start 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa16119640 1 -- start start 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa16119640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa10102990 0x7ffa1019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa16119640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa10103b80 0x7ffa1019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa16119640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10104540 0x7ffa101a2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa16119640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1010e5f0 con 0x7ffa10104540 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa16119640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1010e470 con 0x7ffa10102990 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa16119640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1010e770 con 0x7ffa10103b80 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa0ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10104540 0x7ffa101a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa0ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10104540 0x7ffa101a2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53106/0 (socket says 172.21.15.70:53106) 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa0ffff640 1 -- 172.21.15.70:0/2256785238 learned_addr learned my addr 172.21.15.70:0/2256785238 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa0effd640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa10103b80 0x7ffa1019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa0ffff640 1 -- 172.21.15.70:0/2256785238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa10103b80 msgr2=0x7ffa1019b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa0ffff640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa10103b80 0x7ffa1019b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa0ffff640 1 -- 172.21.15.70:0/2256785238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa10102990 msgr2=0x7ffa1019ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa0ffff640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa10102990 0x7ffa1019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.417+0000 7ffa0ffff640 1 -- 172.21.15.70:0/2256785238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa101a2a70 con 0x7ffa10104540 2024-04-26T20:26:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.418+0000 7ffa0ffff640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10104540 0x7ffa101a2400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800eaa0 tx=0x7ffa0800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.418+0000 7ffa0cff9640 1 -- 172.21.15.70:0/2256785238 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800cdb0 con 0x7ffa10104540 2024-04-26T20:26:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.418+0000 7ffa0cff9640 1 -- 172.21.15.70:0/2256785238 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffa08005020 con 0x7ffa10104540 2024-04-26T20:26:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.418+0000 7ffa16119640 1 -- 172.21.15.70:0/2256785238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa101a2d60 con 0x7ffa10104540 2024-04-26T20:26:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.418+0000 7ffa0cff9640 1 -- 172.21.15.70:0/2256785238 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa080116b0 con 0x7ffa10104540 2024-04-26T20:26:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.418+0000 7ffa16119640 1 -- 172.21.15.70:0/2256785238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa101a3250 con 0x7ffa10104540 2024-04-26T20:26:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa0cff9640 1 -- 172.21.15.70:0/2256785238 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ffa080051d0 con 0x7ffa10104540 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa18e38740 1 Processor -- start 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa18e38740 1 -- start start 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7e1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e2080 0x56402f7e6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e71f0 0x56402f7e9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa18e38740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56402f746740 con 0x56402f7e1690 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa18e38740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56402f6e23a0 con 0x56402f7e71f0 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa18e38740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56402f742700 con 0x56402f7e2080 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa0cff9640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff9f80a3c40 0x7ff9f80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7e1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7e1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53116/0 (socket says 172.21.15.70:53116) 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa0effd640 1 -- 172.21.15.70:0/1139399351 learned_addr learned my addr 172.21.15.70:0/1139399351 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.420+0000 7ffa0ffff640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff9f80a3c40 0x7ff9f80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ffa0f7fe640 1 --2- 172.21.15.70:0/1139399351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e2080 0x56402f7e6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ffa0cff9640 1 -- 172.21.15.70:0/2256785238 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7ffa080d0890 con 0x7ffa10104540 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ffa0effd640 1 -- 172.21.15.70:0/1139399351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e2080 msgr2=0x56402f7e6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ffa0effd640 1 --2- 172.21.15.70:0/1139399351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e2080 0x56402f7e6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ffa0effd640 1 -- 172.21.15.70:0/1139399351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e71f0 msgr2=0x56402f7e9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ffa0effd640 1 --2- 172.21.15.70:0/1139399351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e71f0 0x56402f7e9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ffa0effd640 1 -- 172.21.15.70:0/1139399351 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56402f6fe750 con 0x56402f7e1690 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ffa0ffff640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff9f80a3c40 0x7ff9f80a6100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffa08062240 tx=0x7ffa080621b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ffa0effd640 1 --2- 172.21.15.70:0/1139399351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7e1ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffa04006010 tx=0x7ffa04032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b89bb14b093c1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ff9f5ffb640 1 -- 172.21.15.70:0/1139399351 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04035050 con 0x56402f7e1690 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ff9f5ffb640 1 -- 172.21.15.70:0/1139399351 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffa04031810 con 0x56402f7e1690 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.421+0000 7ff9f5ffb640 1 -- 172.21.15.70:0/1139399351 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa040046c0 con 0x56402f7e1690 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 -- 172.21.15.70:0/1139399351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 msgr2=0x56402f7e1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 --2- 172.21.15.70:0/1139399351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7e1ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffa04006010 tx=0x7ffa04032c00 comp rx=0 tx=0).stop 2024-04-26T20:26:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 -- 172.21.15.70:0/1139399351 shutdown_connections 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 --2- 172.21.15.70:0/1139399351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e71f0 0x56402f7e9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 --2- 172.21.15.70:0/1139399351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e2080 0x56402f7e6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 --2- 172.21.15.70:0/1139399351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7e1ab0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 -- 172.21.15.70:0/1139399351 >> 172.21.15.70:0/1139399351 conn(0x56402f7dcd00 msgr2=0x56402f7dd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 -- 172.21.15.70:0/1139399351 shutdown_connections 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 -- 172.21.15.70:0/1139399351 wait complete. 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 -- start start 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 Processor -- start 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e1690 0x56402f7ebb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e2080 0x56402f7ec050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e71f0 0x56402f7f3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56402f7ea140 con 0x56402f7e71f0 2024-04-26T20:26:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56402f6cdfe0 con 0x56402f7e2080 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.422+0000 7ffa18e38740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56402f7ea2c0 con 0x56402f7e1690 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa18e38740 10 client.0 _ll_register_callbacks cb 0x56402f6e4150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e71f0 0x56402f7f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e71f0 0x56402f7f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53130/0 (socket says 172.21.15.70:53130) 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa0effd640 1 -- 172.21.15.70:0/2978746492 learned_addr learned my addr 172.21.15.70:0/2978746492 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa0effd640 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e1690 0x56402f7ebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa0f7fe640 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e2080 0x56402f7ec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa0effd640 1 -- 172.21.15.70:0/2978746492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e1690 msgr2=0x56402f7ebb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa0effd640 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e1690 0x56402f7ebb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa0effd640 1 -- 172.21.15.70:0/2978746492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e2080 msgr2=0x56402f7ec050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa0effd640 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e2080 0x56402f7ec050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa0effd640 1 -- 172.21.15.70:0/2978746492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56402f4582d0 con 0x56402f7e71f0 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa0effd640 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e71f0 0x56402f7f3090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffa04031ac0 tx=0x7ffa04005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6102fcac962b33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ff9eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ff9eeffd640 1 -- 172.21.15.70:0/2978746492 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04035070 con 0x56402f7e71f0 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ff9eeffd640 1 -- 172.21.15.70:0/2978746492 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7ffa04004b00 con 0x56402f7e71f0 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa18e38740 1 -- 172.21.15.70:0/2978746492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa04031810 con 0x56402f7e71f0 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ff9eeffd640 1 -- 172.21.15.70:0/2978746492 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffa04004d00 con 0x56402f7e71f0 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa18e38740 10 client.15105 fetch_fsmap learned FSMap version 24 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ffa18e38740 1 -- 172.21.15.70:0/2978746492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56402f5226b0 con 0x56402f7e71f0 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.423+0000 7ff9eeffd640 1 -- 172.21.15.70:0/2978746492 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffa04031810 con 0x56402f7e71f0 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.424+0000 7ff9eeffd640 1 -- 172.21.15.70:0/2978746492 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7ffa04051480 con 0x56402f7e71f0 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.424+0000 7ffa18e38740 10 client.15105 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.424+0000 7ffa18e38740 10 client.15105 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.424+0000 7ffa18e38740 20 client.15105 populate_metadata read hostname 'smithi070' 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.424+0000 7ffa18e38740 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56402f7f80e0 0x56402f7f9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.424+0000 7ffa18e38740 4 client.15105 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.424+0000 7ffa18e38740 1 -- 172.21.15.70:0/2978746492 --> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56402f754350 con 0x56402f7f80e0 2024-04-26T20:26:45.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.424+0000 7ffa0f7fe640 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56402f7f80e0 0x56402f7f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.424+0000 7ff9eeffd640 10 client.15105 ms_handle_connect on v2:172.21.15.80:6838/4099319394 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.424+0000 7ffa0f7fe640 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56402f7f80e0 0x56402f7f9550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b09160c1ee8c0062 server_cookie=6a2f84920294bd5e in_seq=0 out_seq=0 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.425+0000 7ff9eeffd640 1 -- 172.21.15.70:0/2978746492 <== mds.0 v2:172.21.15.80:6838/4099319394 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56402f754350 con 0x56402f7f80e0 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.425+0000 7ff9eeffd640 10 client.15105 handle_command_reply: tid=0 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.425+0000 7ffa18e38740 1 client.15105 shutdown 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.425+0000 7ffa18e38740 1 -- 172.21.15.70:0/2978746492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e71f0 msgr2=0x56402f7f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.425+0000 7ffa18e38740 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e71f0 0x56402f7f3090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffa04031ac0 tx=0x7ffa04005bd0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.425+0000 7ffa18e38740 1 -- 172.21.15.70:0/2978746492 shutdown_connections 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.425+0000 7ffa18e38740 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56402f7f80e0 0x56402f7f9550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.425+0000 7ffa18e38740 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e71f0 0x56402f7f3090 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.425+0000 7ffa18e38740 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e2080 0x56402f7ec050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.426+0000 7ffa18e38740 1 --2- 172.21.15.70:0/2978746492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e1690 0x56402f7ebb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.426+0000 7ffa18e38740 1 -- 172.21.15.70:0/2978746492 >> 172.21.15.70:0/2978746492 conn(0x56402f7dcd00 msgr2=0x56402f7dbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.426+0000 7ff9eeffd640 0 client.15105 ms_handle_reset on v2:172.21.15.80:6838/4099319394 2024-04-26T20:26:45.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.426+0000 7ffa18e38740 1 -- 172.21.15.70:0/2978746492 shutdown_connections 2024-04-26T20:26:45.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.426+0000 7ffa18e38740 1 -- 172.21.15.70:0/2978746492 wait complete. 2024-04-26T20:26:45.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.426+0000 7ffa18e38740 20 client.15105 trim_cache size 0 max 16384 2024-04-26T20:26:45.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.443+0000 7ffa18e38740 1 Processor -- start 2024-04-26T20:26:45.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.443+0000 7ffa18e38740 1 -- start start 2024-04-26T20:26:45.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.443+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e1690 0x56402f7d7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.443+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e2080 0x56402f7f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e71f0 0x56402f7eb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa18e38740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56402f7f7890 con 0x56402f7e2080 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa18e38740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56402f7f7f60 con 0x56402f7e1690 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa18e38740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56402f7f8630 con 0x56402f7e71f0 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa0f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e2080 0x56402f7f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa0f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e2080 0x56402f7f2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53134/0 (socket says 172.21.15.70:53134) 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa0f7fe640 1 -- 172.21.15.70:0/1102360100 learned_addr learned my addr 172.21.15.70:0/1102360100 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa0effd640 1 --2- 172.21.15.70:0/1102360100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e1690 0x56402f7d7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa0f7fe640 1 -- 172.21.15.70:0/1102360100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e71f0 msgr2=0x56402f7eb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa0f7fe640 1 --2- 172.21.15.70:0/1102360100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e71f0 0x56402f7eb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa0f7fe640 1 -- 172.21.15.70:0/1102360100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e1690 msgr2=0x56402f7d7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa0f7fe640 1 --2- 172.21.15.70:0/1102360100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e1690 0x56402f7d7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa0f7fe640 1 -- 172.21.15.70:0/1102360100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56402f7d7270 con 0x56402f7e2080 2024-04-26T20:26:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ffa0f7fe640 1 --2- 172.21.15.70:0/1102360100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e2080 0x56402f7f2fb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffa00005f00 tx=0x7ffa00005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5149787517e20acc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ff9f57fa640 1 -- 172.21.15.70:0/1102360100 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0001d070 con 0x56402f7e2080 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ff9f57fa640 1 -- 172.21.15.70:0/1102360100 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffa0000be50 con 0x56402f7e2080 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.444+0000 7ff9f57fa640 1 -- 172.21.15.70:0/1102360100 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00011640 con 0x56402f7e2080 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 -- 172.21.15.70:0/1102360100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e2080 msgr2=0x56402f7f2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 --2- 172.21.15.70:0/1102360100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e2080 0x56402f7f2fb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffa00005f00 tx=0x7ffa00005f30 comp rx=0 tx=0).stop 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 -- 172.21.15.70:0/1102360100 shutdown_connections 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 --2- 172.21.15.70:0/1102360100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e71f0 0x56402f7eb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 --2- 172.21.15.70:0/1102360100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e2080 0x56402f7f2fb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 --2- 172.21.15.70:0/1102360100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e1690 0x56402f7d7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 -- 172.21.15.70:0/1102360100 >> 172.21.15.70:0/1102360100 conn(0x56402f7dcd00 msgr2=0x56402f7dd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 -- 172.21.15.70:0/1102360100 shutdown_connections 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 -- 172.21.15.70:0/1102360100 wait complete. 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 -- start start 2024-04-26T20:26:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 Processor -- start 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e2080 0x56402f85a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e71f0 0x56402f85c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56402f7f93d0 con 0x56402f7e1690 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56402f7f8d00 con 0x56402f7e2080 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56402f7f9aa0 con 0x56402f7e71f0 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa18e38740 10 client.0 _ll_register_callbacks cb 0x7ffa04032b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.445+0000 7ffa0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53136/0 (socket says 172.21.15.70:53136) 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa0effd640 1 -- 172.21.15.70:0/3774035956 learned_addr learned my addr 172.21.15.70:0/3774035956 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa0f7fe640 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e2080 0x56402f85a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa0effd640 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e71f0 0x56402f85c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa0effd640 1 -- 172.21.15.70:0/3774035956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e71f0 msgr2=0x56402f85c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa0effd640 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e71f0 0x56402f85c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa0effd640 1 -- 172.21.15.70:0/3774035956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e2080 msgr2=0x56402f85a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa0effd640 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e2080 0x56402f85a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa0effd640 1 -- 172.21.15.70:0/3774035956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56402f85cd70 con 0x56402f7e1690 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa0effd640 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7f0fa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffa04005c40 tx=0x7ffa04005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281c52f296a2be0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ff9eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ff9eeffd640 1 -- 172.21.15.70:0/3774035956 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04035040 con 0x56402f7e1690 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ff9eeffd640 1 -- 172.21.15.70:0/3774035956 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7ffa04004b00 con 0x56402f7e1690 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa18e38740 1 -- 172.21.15.70:0/3774035956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa0000be50 con 0x56402f7e1690 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ff9eeffd640 1 -- 172.21.15.70:0/3774035956 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffa04005300 con 0x56402f7e1690 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa18e38740 10 client.15111 fetch_fsmap learned FSMap version 24 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ffa18e38740 1 -- 172.21.15.70:0/3774035956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56402f85e070 con 0x56402f7e1690 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ff9eeffd640 1 -- 172.21.15.70:0/3774035956 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffa0000be50 con 0x56402f7e1690 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.446+0000 7ff9eeffd640 1 -- 172.21.15.70:0/3774035956 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7ffa0406a9d0 con 0x56402f7e1690 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.447+0000 7ffa18e38740 10 client.15111 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.447+0000 7ffa18e38740 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:26:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.447+0000 7ffa18e38740 20 client.15111 populate_metadata read hostname 'smithi070' 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.447+0000 7ffa18e38740 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56402f862c80 0x56402f861990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.447+0000 7ffa18e38740 4 client.15111 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.447+0000 7ffa18e38740 1 -- 172.21.15.70:0/3774035956 --> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] -- command(tid 0: {"prefix": "status"}) -- 0x56402f74e1c0 con 0x56402f862c80 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.447+0000 7ffa0f7fe640 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56402f862c80 0x56402f861990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.447+0000 7ffa0f7fe640 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56402f862c80 0x56402f861990 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba91dfae93a3c081 server_cookie=b5beaa9e9a6f34ee in_seq=0 out_seq=0 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.447+0000 7ff9eeffd640 10 client.15111 ms_handle_connect on v2:172.21.15.80:6838/4099319394 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.447+0000 7ff9eeffd640 1 -- 172.21.15.70:0/3774035956 <== mds.0 v2:172.21.15.80:6838/4099319394 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56402f74e1c0 con 0x56402f862c80 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.447+0000 7ff9eeffd640 10 client.15111 handle_command_reply: tid=0 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 1 client.15111 shutdown 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 1 -- 172.21.15.70:0/3774035956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 msgr2=0x56402f7f0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7f0fa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffa04005c40 tx=0x7ffa04005970 comp rx=0 tx=0).stop 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 1 -- 172.21.15.70:0/3774035956 shutdown_connections 2024-04-26T20:26:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56402f7e71f0 0x56402f85c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56402f7e2080 0x56402f85a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56402f862c80 0x56402f861990 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 1 --2- 172.21.15.70:0/3774035956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56402f7e1690 0x56402f7f0fa0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 1 -- 172.21.15.70:0/3774035956 >> 172.21.15.70:0/3774035956 conn(0x56402f7dcd00 msgr2=0x56402f7eb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ff9eeffd640 0 client.15111 ms_handle_reset on v2:172.21.15.80:6838/4099319394 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 1 -- 172.21.15.70:0/3774035956 shutdown_connections 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 1 -- 172.21.15.70:0/3774035956 wait complete. 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa18e38740 20 client.15111 trim_cache size 0 max 16384 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-04-26T20:26:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24488, 2024-04-26T20:26:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-04-26T20:26:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-04-26T20:26:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-04-26T20:26:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 89.449151853999993, 2024-04-26T20:26:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 24, 2024-04-26T20:26:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2024-04-26T20:26:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2024-04-26T20:26:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 95.243071575000002 2024-04-26T20:26:45.456 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:26:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa16119640 1 -- 172.21.15.70:0/2256785238 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff9f80a3c40 msgr2=0x7ff9f80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa16119640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff9f80a3c40 0x7ff9f80a6100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffa08062240 tx=0x7ffa080621b0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa16119640 1 -- 172.21.15.70:0/2256785238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10104540 msgr2=0x7ffa101a2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa16119640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10104540 0x7ffa101a2400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800eaa0 tx=0x7ffa0800ef60 comp rx=0 tx=0).stop 2024-04-26T20:26:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa16119640 1 -- 172.21.15.70:0/2256785238 shutdown_connections 2024-04-26T20:26:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa16119640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff9f80a3c40 0x7ff9f80a6100 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa16119640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10104540 0x7ffa101a2400 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa16119640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa10103b80 0x7ffa1019b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa16119640 1 --2- 172.21.15.70:0/2256785238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa10102990 0x7ffa1019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.448+0000 7ffa16119640 1 -- 172.21.15.70:0/2256785238 >> 172.21.15.70:0/2256785238 conn(0x7ffa100fdf00 msgr2=0x7ffa10074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.449+0000 7ffa16119640 1 -- 172.21.15.70:0/2256785238 shutdown_connections 2024-04-26T20:26:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:45.449+0000 7ffa16119640 1 -- 172.21.15.70:0/2256785238 wait complete. 2024-04-26T20:26:45.460 INFO:tasks.cephadm:Setup complete, yielding 2024-04-26T20:26:45.461 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T20:26:45.470 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T20:26:45.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-26T20:26:45.705 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:46 smithi070 ceph-mon[29124]: pgmap v337: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:26:47.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:46 smithi098 ceph-mon[32591]: pgmap v337: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:26:47.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:46 smithi080 ceph-mon[32278]: pgmap v337: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:26:47.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.464+0000 7f6c0c23c700 1 -- 172.21.15.70:0/1995579738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04103f00 msgr2=0x7f6c041062f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.464+0000 7f6c0c23c700 1 --2- 172.21.15.70:0/1995579738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04103f00 0x7f6c041062f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009990 tx=0x7f6c00009ca0 comp rx=0 tx=0).stop 2024-04-26T20:26:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.464+0000 7f6c0c23c700 1 -- 172.21.15.70:0/1995579738 shutdown_connections 2024-04-26T20:26:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.464+0000 7f6c0c23c700 1 --2- 172.21.15.70:0/1995579738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04109160 0x7f6c0410b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.464+0000 7f6c0c23c700 1 --2- 172.21.15.70:0/1995579738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04103f00 0x7f6c041062f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.464+0000 7f6c0c23c700 1 --2- 172.21.15.70:0/1995579738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c04106830 0x7f6c04108c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.464+0000 7f6c0c23c700 1 -- 172.21.15.70:0/1995579738 >> 172.21.15.70:0/1995579738 conn(0x7f6c040fd910 msgr2=0x7f6c040ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.464+0000 7f6c0c23c700 1 -- 172.21.15.70:0/1995579738 shutdown_connections 2024-04-26T20:26:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.464+0000 7f6c0c23c700 1 -- 172.21.15.70:0/1995579738 wait complete. 2024-04-26T20:26:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.464+0000 7f6c0c23c700 1 Processor -- start 2024-04-26T20:26:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c0c23c700 1 -- start start 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c0c23c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04103f00 0x7f6c04199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c0c23c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04106830 0x7f6c04199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c0c23c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c04109160 0x7f6c041a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c0c23c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0410f130 con 0x7f6c04103f00 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c0c23c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0410efb0 con 0x7f6c04109160 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c0c23c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0410f2b0 con 0x7f6c04106830 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c09fd8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04103f00 0x7f6c04199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c09fd8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04103f00 0x7f6c04199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53156/0 (socket says 172.21.15.70:53156) 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c09fd8700 1 -- 172.21.15.70:0/732972197 learned_addr learned my addr 172.21.15.70:0/732972197 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c097d7700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04106830 0x7f6c04199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c0a7d9700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c04109160 0x7f6c041a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c09fd8700 1 -- 172.21.15.70:0/732972197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04106830 msgr2=0x7f6c04199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:47.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c09fd8700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04106830 0x7f6c04199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:47.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c09fd8700 1 -- 172.21.15.70:0/732972197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c04109160 msgr2=0x7f6c041a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:47.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c09fd8700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c04109160 0x7f6c041a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:47.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c09fd8700 1 -- 172.21.15.70:0/732972197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c041a1420 con 0x7f6c04103f00 2024-04-26T20:26:47.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c097d7700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04106830 0x7f6c04199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:47.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.465+0000 7f6c09fd8700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04103f00 0x7f6c04199810 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6c000059d0 tx=0x7f6c00009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:47.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.466+0000 7f6bfaffd700 1 -- 172.21.15.70:0/732972197 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00027070 con 0x7f6c04103f00 2024-04-26T20:26:47.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.466+0000 7f6c0c23c700 1 -- 172.21.15.70:0/732972197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c041a16b0 con 0x7f6c04103f00 2024-04-26T20:26:47.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.466+0000 7f6bfaffd700 1 -- 172.21.15.70:0/732972197 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6c00022470 con 0x7f6c04103f00 2024-04-26T20:26:47.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.466+0000 7f6bfaffd700 1 -- 172.21.15.70:0/732972197 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000f6e0 con 0x7f6c04103f00 2024-04-26T20:26:47.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.466+0000 7f6c0c23c700 1 -- 172.21.15.70:0/732972197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c041a1be0 con 0x7f6c04103f00 2024-04-26T20:26:47.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.467+0000 7f6c0c23c700 1 -- 172.21.15.70:0/732972197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c0406a110 con 0x7f6c04103f00 2024-04-26T20:26:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.469+0000 7f6bfaffd700 1 -- 172.21.15.70:0/732972197 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6c0002a070 con 0x7f6c04103f00 2024-04-26T20:26:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.469+0000 7f6bfaffd700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bf00a3cd0 0x7f6bf00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.469+0000 7f6c097d7700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bf00a3cd0 0x7f6bf00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.469+0000 7f6bfaffd700 1 -- 172.21.15.70:0/732972197 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f6c000d1970 con 0x7f6c04103f00 2024-04-26T20:26:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.470+0000 7f6c097d7700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bf00a3cd0 0x7f6bf00a6190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40099d0 tx=0x7f6bf4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:47.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.473+0000 7f6bfaffd700 1 -- 172.21.15.70:0/732972197 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f6c00013070 con 0x7f6c04103f00 2024-04-26T20:26:47.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.689+0000 7f6c0c23c700 1 -- 172.21.15.70:0/732972197 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f6c04063860 con 0x7f6bf00a3cd0 2024-04-26T20:26:47.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.690+0000 7f6bfaffd700 1 -- 172.21.15.70:0/732972197 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f6c04063860 con 0x7f6bf00a3cd0 2024-04-26T20:26:47.691 INFO:teuthology.orchestra.run.smithi070.stdout:Backend: cephadm 2024-04-26T20:26:47.691 INFO:teuthology.orchestra.run.smithi070.stdout:Available: Yes 2024-04-26T20:26:47.691 INFO:teuthology.orchestra.run.smithi070.stdout:Paused: No 2024-04-26T20:26:47.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 -- 172.21.15.70:0/732972197 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bf00a3cd0 msgr2=0x7f6bf00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:47.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bf00a3cd0 0x7f6bf00a6190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40099d0 tx=0x7f6bf4008040 comp rx=0 tx=0).stop 2024-04-26T20:26:47.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 -- 172.21.15.70:0/732972197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04103f00 msgr2=0x7f6c04199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:47.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04103f00 0x7f6c04199810 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6c000059d0 tx=0x7f6c00009f90 comp rx=0 tx=0).stop 2024-04-26T20:26:47.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 -- 172.21.15.70:0/732972197 shutdown_connections 2024-04-26T20:26:47.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bf00a3cd0 0x7f6bf00a6190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:47.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c04109160 0x7f6c041a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:47.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04103f00 0x7f6c04199810 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:47.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 --2- 172.21.15.70:0/732972197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04106830 0x7f6c04199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:47.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 -- 172.21.15.70:0/732972197 >> 172.21.15.70:0/732972197 conn(0x7f6c040fd910 msgr2=0x7f6c04104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:47.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 -- 172.21.15.70:0/732972197 shutdown_connections 2024-04-26T20:26:47.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:47.692+0000 7f6c0c23c700 1 -- 172.21.15.70:0/732972197 wait complete. 2024-04-26T20:26:48.535 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-26T20:26:48.778 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:49.139 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:48 smithi070 ceph-mon[29124]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:49.140 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:48 smithi070 ceph-mon[29124]: pgmap v338: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-04-26T20:26:49.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:48 smithi098 ceph-mon[32591]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:49.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:48 smithi098 ceph-mon[32591]: pgmap v338: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-04-26T20:26:49.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:48 smithi080 ceph-mon[32278]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:49.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:48 smithi080 ceph-mon[32278]: pgmap v338: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-04-26T20:26:50.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.414+0000 7f306889d700 1 -- 172.21.15.70:0/1036753526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30641034b0 msgr2=0x7f30641038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:50.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.414+0000 7f306889d700 1 --2- 172.21.15.70:0/1036753526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30641034b0 0x7f30641038d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f30540099c0 tx=0x7f3054009cd0 comp rx=0 tx=0).stop 2024-04-26T20:26:50.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.414+0000 7f306889d700 1 -- 172.21.15.70:0/1036753526 shutdown_connections 2024-04-26T20:26:50.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.414+0000 7f306889d700 1 --2- 172.21.15.70:0/1036753526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3064105050 0x7f306410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:50.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.414+0000 7f306889d700 1 --2- 172.21.15.70:0/1036753526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30641034b0 0x7f30641038d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:50.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.414+0000 7f306889d700 1 --2- 172.21.15.70:0/1036753526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30641046b0 0x7f3064104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:50.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.414+0000 7f306889d700 1 -- 172.21.15.70:0/1036753526 >> 172.21.15.70:0/1036753526 conn(0x7f30640fea70 msgr2=0x7f3064100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:50.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.414+0000 7f306889d700 1 -- 172.21.15.70:0/1036753526 shutdown_connections 2024-04-26T20:26:50.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.414+0000 7f306889d700 1 -- 172.21.15.70:0/1036753526 wait complete. 2024-04-26T20:26:50.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306889d700 1 Processor -- start 2024-04-26T20:26:50.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306889d700 1 -- start start 2024-04-26T20:26:50.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306889d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30641034b0 0x7f30641995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:50.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306889d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30641046b0 0x7f3064199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:50.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306889d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3064105050 0x7f30641a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:50.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306889d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f306410f0a0 con 0x7f30641034b0 2024-04-26T20:26:50.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306889d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f306410ef20 con 0x7f30641046b0 2024-04-26T20:26:50.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306889d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f306410f220 con 0x7f3064105050 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30641034b0 0x7f30641995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30641034b0 0x7f30641995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35906/0 (socket says 172.21.15.70:35906) 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306259c700 1 -- 172.21.15.70:0/3781352564 learned_addr learned my addr 172.21.15.70:0/3781352564 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f3062d9d700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3064105050 0x7f30641a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f3061d9b700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30641046b0 0x7f3064199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306259c700 1 -- 172.21.15.70:0/3781352564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3064105050 msgr2=0x7f30641a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306259c700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3064105050 0x7f30641a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306259c700 1 -- 172.21.15.70:0/3781352564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30641046b0 msgr2=0x7f3064199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306259c700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30641046b0 0x7f3064199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306259c700 1 -- 172.21.15.70:0/3781352564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30641a1200 con 0x7f30641034b0 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f3061d9b700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30641046b0 0x7f3064199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:50.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.415+0000 7f306259c700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30641034b0 0x7f30641995a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3054003910 tx=0x7f30540047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:50.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.416+0000 7f30537fe700 1 -- 172.21.15.70:0/3781352564 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3054027070 con 0x7f30641034b0 2024-04-26T20:26:50.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.416+0000 7f306889d700 1 -- 172.21.15.70:0/3781352564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30641a1490 con 0x7f30641034b0 2024-04-26T20:26:50.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.416+0000 7f30537fe700 1 -- 172.21.15.70:0/3781352564 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3054004150 con 0x7f30641034b0 2024-04-26T20:26:50.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.416+0000 7f30537fe700 1 -- 172.21.15.70:0/3781352564 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305400f460 con 0x7f30641034b0 2024-04-26T20:26:50.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.416+0000 7f306889d700 1 -- 172.21.15.70:0/3781352564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30641a1940 con 0x7f30641034b0 2024-04-26T20:26:50.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.417+0000 7f306889d700 1 -- 172.21.15.70:0/3781352564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306406a110 con 0x7f30641034b0 2024-04-26T20:26:50.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.418+0000 7f30537fe700 1 -- 172.21.15.70:0/3781352564 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f305402a070 con 0x7f30641034b0 2024-04-26T20:26:50.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.418+0000 7f30537fe700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f304c0a3cd0 0x7f304c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:50.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.418+0000 7f3061d9b700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f304c0a3cd0 0x7f304c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:50.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.418+0000 7f30537fe700 1 -- 172.21.15.70:0/3781352564 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f30540d1260 con 0x7f30641034b0 2024-04-26T20:26:50.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.419+0000 7f3061d9b700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f304c0a3cd0 0x7f304c0a6190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3058005fd0 tx=0x7f3058005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:50.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.423+0000 7f30537fe700 1 -- 172.21.15.70:0/3781352564 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f3054013070 con 0x7f30641034b0 2024-04-26T20:26:50.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.630+0000 7f306889d700 1 -- 172.21.15.70:0/3781352564 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3064063860 con 0x7f304c0a3cd0 2024-04-26T20:26:50.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.644+0000 7f30537fe700 1 -- 172.21.15.70:0/3781352564 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f3064063860 con 0x7f304c0a3cd0 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:mds.a smithi070 running (104s) 16s ago 103s 17.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 e10b51548670 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:mds.b smithi080 running (100s) 33s ago 100s 26.1M - 19.0.0-3306-gbc612ffb 55dc54019ad8 65c65c393630 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:mds.c smithi098 running (115s) 33s ago 115s 17.8M - 19.0.0-3306-gbc612ffb 55dc54019ad8 10e6c2710488 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:mds.d smithi070 running (2m) 16s ago 2m 15.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 8796fa5407f6 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:mds.e smithi080 running (2m) 33s ago 2m 17.9M - 19.0.0-3306-gbc612ffb 55dc54019ad8 4e4863d539fd 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:mds.f smithi098 running (118s) 33s ago 118s 19.7M - 19.0.0-3306-gbc612ffb 55dc54019ad8 46300548d288 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:mds.g smithi070 running (106s) 16s ago 106s 19.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 53faf2c80c94 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:mds.h smithi080 running (112s) 33s ago 112s 20.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 8d796e6cfab6 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:mds.i smithi098 running (109s) 33s ago 109s 20.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 1a2204d234f6 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:mds.j smithi070 running (2m) 16s ago 2m 14.1M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a6318ca21c64 2024-04-26T20:26:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:mds.k smithi080 running (2m) 33s ago 2m 16.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 ebb72b90741f 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:mds.l smithi098 running (2m) 33s ago 2m 15.9M - 19.0.0-3306-gbc612ffb 55dc54019ad8 994820d5e679 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.x smithi070 *:9283,8765 running (9m) 16s ago 9m 515M - 19.0.0-3306-gbc612ffb 55dc54019ad8 9c91667f2980 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.y smithi080 *:8443,8765 running (7m) 33s ago 7m 452M - 19.0.0-3306-gbc612ffb 55dc54019ad8 19002b95cc56 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.z smithi098 *:8443,8765 running (7m) 33s ago 7m 454M - 19.0.0-3306-gbc612ffb 55dc54019ad8 b82314337253 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a smithi070 running (9m) 16s ago 9m 50.5M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 add84205b42c 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b smithi080 running (7m) 33s ago 7m 38.3M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 370a2df9f6d9 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c smithi098 running (7m) 33s ago 7m 40.1M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fc5a964d3989 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 smithi070 running (7m) 16s ago 7m 45.3M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 1e59bcaec0d2 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 smithi080 running (6m) 33s ago 6m 45.9M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 124032a0c739 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 smithi098 running (6m) 33s ago 6m 58.3M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 634e6c184481 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 smithi070 running (6m) 16s ago 6m 43.4M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 93971dadae6d 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 smithi080 running (5m) 33s ago 5m 53.4M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 6d5f8ef819aa 2024-04-26T20:26:50.647 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 smithi098 running (5m) 33s ago 5m 45.7M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 973833c6c6f6 2024-04-26T20:26:50.648 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 smithi070 running (4m) 16s ago 4m 53.0M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 af206cdccf37 2024-04-26T20:26:50.648 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 smithi080 running (4m) 33s ago 4m 56.4M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 4fed8a5af5b6 2024-04-26T20:26:50.648 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 smithi098 running (3m) 33s ago 3m 42.3M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 6cfb99db6cab 2024-04-26T20:26:50.648 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 smithi070 running (3m) 16s ago 3m 51.3M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 1078e0a7cca7 2024-04-26T20:26:50.648 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 smithi080 running (3m) 33s ago 3m 55.3M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 47c872512d51 2024-04-26T20:26:50.648 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 smithi098 running (2m) 33s ago 2m 51.3M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 aef829dc9005 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 -- 172.21.15.70:0/3781352564 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f304c0a3cd0 msgr2=0x7f304c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f304c0a3cd0 0x7f304c0a6190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3058005fd0 tx=0x7f3058005e20 comp rx=0 tx=0).stop 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 -- 172.21.15.70:0/3781352564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30641034b0 msgr2=0x7f30641995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30641034b0 0x7f30641995a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3054003910 tx=0x7f30540047b0 comp rx=0 tx=0).stop 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 -- 172.21.15.70:0/3781352564 shutdown_connections 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f304c0a3cd0 0x7f304c0a6190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3064105050 0x7f30641a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30641034b0 0x7f30641995a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 --2- 172.21.15.70:0/3781352564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30641046b0 0x7f3064199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 -- 172.21.15.70:0/3781352564 >> 172.21.15.70:0/3781352564 conn(0x7f30640fea70 msgr2=0x7f30641078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 -- 172.21.15.70:0/3781352564 shutdown_connections 2024-04-26T20:26:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:50.646+0000 7f306889d700 1 -- 172.21.15.70:0/3781352564 wait complete. 2024-04-26T20:26:51.027 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:50 smithi070 ceph-mon[29124]: pgmap v339: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:26:51.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:50 smithi098 ceph-mon[32591]: pgmap v339: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:26:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:50 smithi080 ceph-mon[32278]: pgmap v339: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:26:51.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-26T20:26:51.742 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:52.117 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:51 smithi070 ceph-mon[29124]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:52.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:51 smithi098 ceph-mon[32591]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:52.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:51 smithi080 ceph-mon[32278]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:53.163 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:52 smithi070 ceph-mon[29124]: pgmap v340: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:26:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:52 smithi098 ceph-mon[32591]: pgmap v340: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:26:53.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:52 smithi080 ceph-mon[32278]: pgmap v340: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:26:53.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.410+0000 7f8365d95700 1 -- 172.21.15.70:0/1025889532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8360103f10 msgr2=0x7f8360106300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:53.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.410+0000 7f8365d95700 1 --2- 172.21.15.70:0/1025889532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8360103f10 0x7f8360106300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8350009990 tx=0x7f8350009ca0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.410+0000 7f8365d95700 1 -- 172.21.15.70:0/1025889532 shutdown_connections 2024-04-26T20:26:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.410+0000 7f8365d95700 1 --2- 172.21.15.70:0/1025889532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8360109170 0x7f836010b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.410+0000 7f8365d95700 1 --2- 172.21.15.70:0/1025889532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8360103f10 0x7f8360106300 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.410+0000 7f8365d95700 1 --2- 172.21.15.70:0/1025889532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360106840 0x7f8360108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.410+0000 7f8365d95700 1 -- 172.21.15.70:0/1025889532 >> 172.21.15.70:0/1025889532 conn(0x7f83600fd920 msgr2=0x7f83600ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.410+0000 7f8365d95700 1 -- 172.21.15.70:0/1025889532 shutdown_connections 2024-04-26T20:26:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.410+0000 7f8365d95700 1 -- 172.21.15.70:0/1025889532 wait complete. 2024-04-26T20:26:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f8365d95700 1 Processor -- start 2024-04-26T20:26:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f8365d95700 1 -- start start 2024-04-26T20:26:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f8365d95700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360103f10 0x7f8360199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f8365d95700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8360106840 0x7f8360199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f8365d95700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8360109170 0x7f83601a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f8365d95700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f836010f060 con 0x7f8360109170 2024-04-26T20:26:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f8365d95700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f836010eee0 con 0x7f8360103f10 2024-04-26T20:26:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f8365d95700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f836010f1e0 con 0x7f8360106840 2024-04-26T20:26:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f835ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8360109170 0x7f83601a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f835ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8360109170 0x7f83601a0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35932/0 (socket says 172.21.15.70:35932) 2024-04-26T20:26:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f835ffff700 1 -- 172.21.15.70:0/3881187206 learned_addr learned my addr 172.21.15.70:0/3881187206 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f8356ffd700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8360106840 0x7f8360199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.411+0000 7f835f7fe700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360103f10 0x7f8360199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.412+0000 7f835ffff700 1 -- 172.21.15.70:0/3881187206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8360106840 msgr2=0x7f8360199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.412+0000 7f835ffff700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8360106840 0x7f8360199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.412+0000 7f835ffff700 1 -- 172.21.15.70:0/3881187206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360103f10 msgr2=0x7f8360199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.412+0000 7f835ffff700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360103f10 0x7f8360199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.412+0000 7f835ffff700 1 -- 172.21.15.70:0/3881187206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83601a12d0 con 0x7f8360109170 2024-04-26T20:26:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.412+0000 7f835ffff700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8360109170 0x7f83601a0c30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f835800efc0 tx=0x7f835800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.412+0000 7f835d7fa700 1 -- 172.21.15.70:0/3881187206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580092e0 con 0x7f8360109170 2024-04-26T20:26:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.412+0000 7f835d7fa700 1 -- 172.21.15.70:0/3881187206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8358004bb0 con 0x7f8360109170 2024-04-26T20:26:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.412+0000 7f8365d95700 1 -- 172.21.15.70:0/3881187206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83601a1560 con 0x7f8360109170 2024-04-26T20:26:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.412+0000 7f835d7fa700 1 -- 172.21.15.70:0/3881187206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835800cea0 con 0x7f8360109170 2024-04-26T20:26:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.412+0000 7f8365d95700 1 -- 172.21.15.70:0/3881187206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83601a1aa0 con 0x7f8360109170 2024-04-26T20:26:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.413+0000 7f8365d95700 1 -- 172.21.15.70:0/3881187206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f836006a110 con 0x7f8360109170 2024-04-26T20:26:53.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.414+0000 7f835d7fa700 1 -- 172.21.15.70:0/3881187206 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f835801b030 con 0x7f8360109170 2024-04-26T20:26:53.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.415+0000 7f835d7fa700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f834c0a3d50 0x7f834c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:53.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.415+0000 7f835f7fe700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f834c0a3d50 0x7f834c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:53.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.415+0000 7f835d7fa700 1 -- 172.21.15.70:0/3881187206 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f83580d09e0 con 0x7f8360109170 2024-04-26T20:26:53.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.416+0000 7f835f7fe700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f834c0a3d50 0x7f834c0a6210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f835000b720 tx=0x7f8350005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:53.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.419+0000 7f835d7fa700 1 -- 172.21.15.70:0/3881187206 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f8358022020 con 0x7f8360109170 2024-04-26T20:26:53.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.624+0000 7f8365d95700 1 -- 172.21.15.70:0/3881187206 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f8360063860 con 0x7f834c0a3d50 2024-04-26T20:26:53.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.630+0000 7f835d7fa700 1 -- 172.21.15.70:0/3881187206 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f8360063860 con 0x7f834c0a3d50 2024-04-26T20:26:53.632 INFO:teuthology.orchestra.run.smithi070.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-26T20:26:53.632 INFO:teuthology.orchestra.run.smithi070.stdout:mds.all 12/12 36s ago 2m smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi080=b;smithi080=e;smithi080=h;smithi080=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-04-26T20:26:53.632 INFO:teuthology.orchestra.run.smithi070.stdout:mgr 3/3 36s ago 7m smithi070=x;smithi080=y;smithi098=z;count:3 2024-04-26T20:26:53.632 INFO:teuthology.orchestra.run.smithi070.stdout:mon 3/3 36s ago 8m smithi070:172.21.15.70=a;smithi080:172.21.15.80=b;smithi098:172.21.15.98=c;count:3 2024-04-26T20:26:53.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd 12 36s ago - 2024-04-26T20:26:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 -- 172.21.15.70:0/3881187206 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f834c0a3d50 msgr2=0x7f834c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f834c0a3d50 0x7f834c0a6210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f835000b720 tx=0x7f8350005fd0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 -- 172.21.15.70:0/3881187206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8360109170 msgr2=0x7f83601a0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8360109170 0x7f83601a0c30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f835800efc0 tx=0x7f835800c3a0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 -- 172.21.15.70:0/3881187206 shutdown_connections 2024-04-26T20:26:53.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f834c0a3d50 0x7f834c0a6210 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8360109170 0x7f83601a0c30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360103f10 0x7f8360199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 --2- 172.21.15.70:0/3881187206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8360106840 0x7f8360199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:53.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 -- 172.21.15.70:0/3881187206 >> 172.21.15.70:0/3881187206 conn(0x7f83600fd920 msgr2=0x7f8360104970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:53.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 -- 172.21.15.70:0/3881187206 shutdown_connections 2024-04-26T20:26:53.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:53.633+0000 7f8365d95700 1 -- 172.21.15.70:0/3881187206 wait complete. 2024-04-26T20:26:54.403 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-26T20:26:54.656 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:55.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:54 smithi070 ceph-mon[29124]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:55.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:54 smithi070 ceph-mon[29124]: pgmap v341: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-26T20:26:55.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:54 smithi098 ceph-mon[32591]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:55.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:54 smithi098 ceph-mon[32591]: pgmap v341: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-26T20:26:55.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:54 smithi080 ceph-mon[32278]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:55.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:54 smithi080 ceph-mon[32278]: pgmap v341: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-26T20:26:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.396+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/4264974217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fb0103f40 msgr2=0x7f5fb010a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.396+0000 7f5fb4a6b700 1 --2- 172.21.15.70:0/4264974217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fb0103f40 0x7f5fb010a7f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800b0d0 tx=0x7f5fa800b3e0 comp rx=0 tx=0).stop 2024-04-26T20:26:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/4264974217 shutdown_connections 2024-04-26T20:26:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 --2- 172.21.15.70:0/4264974217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fb0103f40 0x7f5fb010a7f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 --2- 172.21.15.70:0/4264974217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01023a0 0x7f5fb01027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 --2- 172.21.15.70:0/4264974217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fb01035a0 0x7f5fb0103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/4264974217 >> 172.21.15.70:0/4264974217 conn(0x7f5fb00fd940 msgr2=0x7f5fb00ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/4264974217 shutdown_connections 2024-04-26T20:26:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/4264974217 wait complete. 2024-04-26T20:26:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 Processor -- start 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 -- start start 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fb01023a0 0x7f5fb0199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01035a0 0x7f5fb0199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fb0103f40 0x7f5fb01a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb010dfd0 con 0x7f5fb0103f40 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb010de50 con 0x7f5fb01023a0 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.397+0000 7f5fb4a6b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb010e150 con 0x7f5fb01035a0 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5fae59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fb01023a0 0x7f5fb0199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5faed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fb0103f40 0x7f5fb01a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5fae59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fb01023a0 0x7f5fb0199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.70:49574/0 (socket says 172.21.15.70:49574) 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5fae59c700 1 -- 172.21.15.70:0/644480051 learned_addr learned my addr 172.21.15.70:0/644480051 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5fadd9b700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01035a0 0x7f5fb0199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5faed9d700 1 -- 172.21.15.70:0/644480051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01035a0 msgr2=0x7f5fb0199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5faed9d700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01035a0 0x7f5fb0199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5faed9d700 1 -- 172.21.15.70:0/644480051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fb01023a0 msgr2=0x7f5fb0199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5faed9d700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fb01023a0 0x7f5fb0199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5faed9d700 1 -- 172.21.15.70:0/644480051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb01a1260 con 0x7f5fb0103f40 2024-04-26T20:26:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5fadd9b700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01035a0 0x7f5fb0199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5faed9d700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fb0103f40 0x7f5fb01a0bc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800b820 tx=0x7f5fa8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5f9f7fe700 1 -- 172.21.15.70:0/644480051 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa801f020 con 0x7f5fb0103f40 2024-04-26T20:26:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/644480051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb01a14f0 con 0x7f5fb0103f40 2024-04-26T20:26:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5f9f7fe700 1 -- 172.21.15.70:0/644480051 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5fa8003e10 con 0x7f5fb0103f40 2024-04-26T20:26:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5f9f7fe700 1 -- 172.21.15.70:0/644480051 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa801b9b0 con 0x7f5fb0103f40 2024-04-26T20:26:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.398+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/644480051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb01a19d0 con 0x7f5fb0103f40 2024-04-26T20:26:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.400+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/644480051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb006a110 con 0x7f5fb0103f40 2024-04-26T20:26:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.400+0000 7f5f9f7fe700 1 -- 172.21.15.70:0/644480051 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5fa8022020 con 0x7f5fb0103f40 2024-04-26T20:26:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.401+0000 7f5f9f7fe700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f5f980a3cd0 0x7f5f980a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.401+0000 7f5fae59c700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f5f980a3cd0 0x7f5f980a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.401+0000 7f5f9f7fe700 1 -- 172.21.15.70:0/644480051 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f5fa800f020 con 0x7f5fb0103f40 2024-04-26T20:26:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.402+0000 7f5fae59c700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f5f980a3cd0 0x7f5f980a6190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000ace0 tx=0x7f5fa000a430 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:56.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.406+0000 7f5f9f7fe700 1 -- 172.21.15.70:0/644480051 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f5fa809de70 con 0x7f5fb0103f40 2024-04-26T20:26:56.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.611+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/644480051 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f5fb00ff980 con 0x7f5f980a3cd0 2024-04-26T20:26:56.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.612+0000 7f5f9f7fe700 1 -- 172.21.15.70:0/644480051 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f5fb00ff980 con 0x7f5f980a3cd0 2024-04-26T20:26:56.613 INFO:teuthology.orchestra.run.smithi070.stdout:HOST ADDR LABELS STATUS 2024-04-26T20:26:56.613 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 172.21.15.70 2024-04-26T20:26:56.613 INFO:teuthology.orchestra.run.smithi070.stdout:smithi080 172.21.15.80 2024-04-26T20:26:56.613 INFO:teuthology.orchestra.run.smithi070.stdout:smithi098 172.21.15.98 2024-04-26T20:26:56.613 INFO:teuthology.orchestra.run.smithi070.stdout:3 hosts in cluster 2024-04-26T20:26:56.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/644480051 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f5f980a3cd0 msgr2=0x7f5f980a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:56.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f5f980a3cd0 0x7f5f980a6190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000ace0 tx=0x7f5fa000a430 comp rx=0 tx=0).stop 2024-04-26T20:26:56.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/644480051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fb0103f40 msgr2=0x7f5fb01a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:56.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fb0103f40 0x7f5fb01a0bc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800b820 tx=0x7f5fa8007d90 comp rx=0 tx=0).stop 2024-04-26T20:26:56.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/644480051 shutdown_connections 2024-04-26T20:26:56.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f5f980a3cd0 0x7f5f980a6190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:56.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fb0103f40 0x7f5fb01a0bc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:56.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fb01023a0 0x7f5fb0199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:56.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 --2- 172.21.15.70:0/644480051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01035a0 0x7f5fb0199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:56.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/644480051 >> 172.21.15.70:0/644480051 conn(0x7f5fb00fd940 msgr2=0x7f5fb00ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:56.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/644480051 shutdown_connections 2024-04-26T20:26:56.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:56.614+0000 7f5fb4a6b700 1 -- 172.21.15.70:0/644480051 wait complete. 2024-04-26T20:26:57.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:56 smithi098 ceph-mon[32591]: pgmap v342: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:26:57.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:56 smithi080 ceph-mon[32278]: pgmap v342: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:26:57.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:56 smithi070 ceph-mon[29124]: pgmap v342: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:26:57.444 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-26T20:26:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:26:58.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:57 smithi070 ceph-mon[29124]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:58.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:57 smithi098 ceph-mon[32591]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:58.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:57 smithi080 ceph-mon[32278]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:26:59.159 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:26:58 smithi070 ceph-mon[29124]: pgmap v343: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:26:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:26:58 smithi098 ceph-mon[32591]: pgmap v343: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:26:59.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:26:58 smithi080 ceph-mon[32278]: pgmap v343: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:26:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.411+0000 7f0f4459e700 1 -- 172.21.15.70:0/993323613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f3c1023b0 msgr2=0x7f0f3c1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.411+0000 7f0f4459e700 1 --2- 172.21.15.70:0/993323613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f3c1023b0 0x7f0f3c1027d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0099c0 tx=0x7f0f2c009cd0 comp rx=0 tx=0).stop 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.411+0000 7f0f4459e700 1 -- 172.21.15.70:0/993323613 shutdown_connections 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.411+0000 7f0f4459e700 1 --2- 172.21.15.70:0/993323613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f3c103f50 0x7f0f3c10a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.411+0000 7f0f4459e700 1 --2- 172.21.15.70:0/993323613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f3c1023b0 0x7f0f3c1027d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.411+0000 7f0f4459e700 1 --2- 172.21.15.70:0/993323613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f3c1035b0 0x7f0f3c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.411+0000 7f0f4459e700 1 -- 172.21.15.70:0/993323613 >> 172.21.15.70:0/993323613 conn(0x7f0f3c0fd970 msgr2=0x7f0f3c0ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.411+0000 7f0f4459e700 1 -- 172.21.15.70:0/993323613 shutdown_connections 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.411+0000 7f0f4459e700 1 -- 172.21.15.70:0/993323613 wait complete. 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4459e700 1 Processor -- start 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4459e700 1 -- start start 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4459e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f3c1023b0 0x7f0f3c1062f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4459e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f3c1035b0 0x7f0f3c104990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4459e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f3c103f50 0x7f0f3c104ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4459e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c10dfe0 con 0x7f0f3c1023b0 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4459e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c10de60 con 0x7f0f3c103f50 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4459e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c10e160 con 0x7f0f3c1035b0 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4233a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f3c1023b0 0x7f0f3c1062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4233a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f3c1023b0 0x7f0f3c1062f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35982/0 (socket says 172.21.15.70:35982) 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4233a700 1 -- 172.21.15.70:0/1861380598 learned_addr learned my addr 172.21.15.70:0/1861380598 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f41b39700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f3c1035b0 0x7f0f3c104990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f42b3b700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f3c103f50 0x7f0f3c104ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4233a700 1 -- 172.21.15.70:0/1861380598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f3c1035b0 msgr2=0x7f0f3c104990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4233a700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f3c1035b0 0x7f0f3c104990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4233a700 1 -- 172.21.15.70:0/1861380598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f3c103f50 msgr2=0x7f0f3c104ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4233a700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f3c103f50 0x7f0f3c104ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4233a700 1 -- 172.21.15.70:0/1861380598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c1057a0 con 0x7f0f3c1023b0 2024-04-26T20:26:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f41b39700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f3c1035b0 0x7f0f3c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f42b3b700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f3c103f50 0x7f0f3c104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.412+0000 7f0f4233a700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f3c1023b0 0x7f0f3c1062f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c006010 tx=0x7f0f2c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.413+0000 7f0f337fe700 1 -- 172.21.15.70:0/1861380598 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c027070 con 0x7f0f3c1023b0 2024-04-26T20:26:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.413+0000 7f0f337fe700 1 -- 172.21.15.70:0/1861380598 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0f2c022470 con 0x7f0f3c1023b0 2024-04-26T20:26:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.413+0000 7f0f337fe700 1 -- 172.21.15.70:0/1861380598 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00f6e0 con 0x7f0f3c1023b0 2024-04-26T20:26:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.413+0000 7f0f4459e700 1 -- 172.21.15.70:0/1861380598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3c1a3780 con 0x7f0f3c1023b0 2024-04-26T20:26:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.413+0000 7f0f4459e700 1 -- 172.21.15.70:0/1861380598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3c1a3c30 con 0x7f0f3c1023b0 2024-04-26T20:26:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.414+0000 7f0f4459e700 1 -- 172.21.15.70:0/1861380598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3c06a110 con 0x7f0f3c1023b0 2024-04-26T20:26:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.415+0000 7f0f337fe700 1 -- 172.21.15.70:0/1861380598 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0f2c02a070 con 0x7f0f3c1023b0 2024-04-26T20:26:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.415+0000 7f0f337fe700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0f280a3cd0 0x7f0f280a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.415+0000 7f0f41b39700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0f280a3cd0 0x7f0f280a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.415+0000 7f0f337fe700 1 -- 172.21.15.70:0/1861380598 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f0f2c0d1540 con 0x7f0f3c1023b0 2024-04-26T20:26:59.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.416+0000 7f0f41b39700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0f280a3cd0 0x7f0f280a6190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0f38005fd0 tx=0x7f0f38005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.420+0000 7f0f337fe700 1 -- 172.21.15.70:0/1861380598 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f0f2c013070 con 0x7f0f3c1023b0 2024-04-26T20:26:59.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.624+0000 7f0f4459e700 1 -- 172.21.15.70:0/1861380598 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f0f3c0ffa60 con 0x7f0f280a3cd0 2024-04-26T20:26:59.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.626+0000 7f0f337fe700 1 -- 172.21.15.70:0/1861380598 <== mgr.14152 v2:172.21.15.70:6800/828657527 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f0f3c0ffa60 con 0x7f0f280a3cd0 2024-04-26T20:26:59.627 INFO:teuthology.orchestra.run.smithi070.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-26T20:26:59.627 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002P480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-04-26T20:26:59.627 INFO:teuthology.orchestra.run.smithi070.stdout:smithi080 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204014T400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-26T20:26:59.627 INFO:teuthology.orchestra.run.smithi070.stdout:smithi098 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010H400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-26T20:26:59.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.628+0000 7f0f4459e700 1 -- 172.21.15.70:0/1861380598 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0f280a3cd0 msgr2=0x7f0f280a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:59.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.628+0000 7f0f4459e700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0f280a3cd0 0x7f0f280a6190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0f38005fd0 tx=0x7f0f38005e20 comp rx=0 tx=0).stop 2024-04-26T20:26:59.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.628+0000 7f0f4459e700 1 -- 172.21.15.70:0/1861380598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f3c1023b0 msgr2=0x7f0f3c1062f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:59.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.628+0000 7f0f4459e700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f3c1023b0 0x7f0f3c1062f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c006010 tx=0x7f0f2c0047b0 comp rx=0 tx=0).stop 2024-04-26T20:26:59.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.628+0000 7f0f4459e700 1 -- 172.21.15.70:0/1861380598 shutdown_connections 2024-04-26T20:26:59.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.628+0000 7f0f4459e700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f0f280a3cd0 0x7f0f280a6190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:59.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.628+0000 7f0f4459e700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f3c103f50 0x7f0f3c104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:59.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.628+0000 7f0f4459e700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f3c1023b0 0x7f0f3c1062f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:59.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.628+0000 7f0f4459e700 1 --2- 172.21.15.70:0/1861380598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f3c1035b0 0x7f0f3c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:59.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.628+0000 7f0f4459e700 1 -- 172.21.15.70:0/1861380598 >> 172.21.15.70:0/1861380598 conn(0x7f0f3c0fd970 msgr2=0x7f0f3c0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:59.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.629+0000 7f0f4459e700 1 -- 172.21.15.70:0/1861380598 shutdown_connections 2024-04-26T20:26:59.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:26:59.629+0000 7f0f4459e700 1 -- 172.21.15.70:0/1861380598 wait complete. 2024-04-26T20:27:00.453 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T20:27:00.461 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T20:27:00.462 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-26T20:27:00.701 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:27:01.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:00 smithi070 ceph-mon[29124]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:01.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:00 smithi070 ceph-mon[29124]: pgmap v344: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:27:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:00 smithi098 ceph-mon[32591]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:00 smithi098 ceph-mon[32591]: pgmap v344: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:27:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:00 smithi080 ceph-mon[32278]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:00 smithi080 ceph-mon[32278]: pgmap v344: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:27:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.287+0000 7f87c643f700 1 -- 172.21.15.70:0/371028537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87c0104710 msgr2=0x7f87c0104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.287+0000 7f87c643f700 1 --2- 172.21.15.70:0/371028537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87c0104710 0x7f87c0104b70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009990 tx=0x7f87b4009ca0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.287+0000 7f87c643f700 1 -- 172.21.15.70:0/371028537 shutdown_connections 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.287+0000 7f87c643f700 1 --2- 172.21.15.70:0/371028537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87c01050b0 0x7f87c010b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.287+0000 7f87c643f700 1 --2- 172.21.15.70:0/371028537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c0101730 0x7f87c0101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.287+0000 7f87c643f700 1 --2- 172.21.15.70:0/371028537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87c0104710 0x7f87c0104b70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.287+0000 7f87c643f700 1 -- 172.21.15.70:0/371028537 >> 172.21.15.70:0/371028537 conn(0x7f87c00fd0b0 msgr2=0x7f87c00ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.287+0000 7f87c643f700 1 -- 172.21.15.70:0/371028537 shutdown_connections 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.287+0000 7f87c643f700 1 -- 172.21.15.70:0/371028537 wait complete. 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c643f700 1 Processor -- start 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c643f700 1 -- start start 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c643f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c0101730 0x7f87c01995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c643f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87c0104710 0x7f87c0199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c643f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87c01050b0 0x7f87c01a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c643f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87c010f030 con 0x7f87c01050b0 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c643f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f87c010eeb0 con 0x7f87c0104710 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c643f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f87c010f1b0 con 0x7f87c0101730 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c49dc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87c01050b0 0x7f87c01a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c49dc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87c01050b0 0x7f87c01a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41982/0 (socket says 172.21.15.70:41982) 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c49dc700 1 -- 172.21.15.70:0/1047610137 learned_addr learned my addr 172.21.15.70:0/1047610137 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87bffff700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c0101730 0x7f87c01995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87bf7fe700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87c0104710 0x7f87c0199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c49dc700 1 -- 172.21.15.70:0/1047610137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c0101730 msgr2=0x7f87c01995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c49dc700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c0101730 0x7f87c01995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c49dc700 1 -- 172.21.15.70:0/1047610137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87c0104710 msgr2=0x7f87c0199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c49dc700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87c0104710 0x7f87c0199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c49dc700 1 -- 172.21.15.70:0/1047610137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c01a1200 con 0x7f87c01050b0 2024-04-26T20:27:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.288+0000 7f87c49dc700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87c01050b0 0x7f87c01a0b60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f87b8007f10 tx=0x7f87b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.289+0000 7f87bd7fa700 1 -- 172.21.15.70:0/1047610137 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8004bb0 con 0x7f87c01050b0 2024-04-26T20:27:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.289+0000 7f87bd7fa700 1 -- 172.21.15.70:0/1047610137 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f87b8004d50 con 0x7f87c01050b0 2024-04-26T20:27:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.289+0000 7f87c643f700 1 -- 172.21.15.70:0/1047610137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c01a14f0 con 0x7f87c01050b0 2024-04-26T20:27:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.289+0000 7f87bd7fa700 1 -- 172.21.15.70:0/1047610137 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b80133f0 con 0x7f87c01050b0 2024-04-26T20:27:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.289+0000 7f87c643f700 1 -- 172.21.15.70:0/1047610137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c01a19e0 con 0x7f87c01050b0 2024-04-26T20:27:02.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.290+0000 7f87c643f700 1 -- 172.21.15.70:0/1047610137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c006a110 con 0x7f87c01050b0 2024-04-26T20:27:02.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.291+0000 7f87bd7fa700 1 -- 172.21.15.70:0/1047610137 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f87b801a020 con 0x7f87c01050b0 2024-04-26T20:27:02.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.291+0000 7f87bd7fa700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f87a80a3cd0 0x7f87a80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.291+0000 7f87bffff700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f87a80a3cd0 0x7f87a80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.291+0000 7f87bd7fa700 1 -- 172.21.15.70:0/1047610137 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f87b80cfc40 con 0x7f87c01050b0 2024-04-26T20:27:02.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.292+0000 7f87bffff700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f87a80a3cd0 0x7f87a80a6190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f87c006af00 tx=0x7f87b000a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:02.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.296+0000 7f87bd7fa700 1 -- 172.21.15.70:0/1047610137 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f87b80d6080 con 0x7f87c01050b0 2024-04-26T20:27:02.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.539+0000 7f87c643f700 1 -- 172.21.15.70:0/1047610137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f87c002e4c0 con 0x7f87c01050b0 2024-04-26T20:27:02.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.540+0000 7f87bd7fa700 1 -- 172.21.15.70:0/1047610137 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3072 (secure 0 0 0) 0x7f87b8010070 con 0x7f87c01050b0 2024-04-26T20:27:02.540 INFO:teuthology.orchestra.run.smithi070.stdout:e24 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:legacy client fscid: 1 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:Filesystem 'cephfs' (1) 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:fs_name cephfs 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 24 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-04-26T20:25:15.345214+0000 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-04-26T20:25:22.041593+0000 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:tableserver 0 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:root 0 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:session_timeout 300 2024-04-26T20:27:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:session_autoclose 300 2024-04-26T20:27:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:max_file_size 1099511627776 2024-04-26T20:27:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:max_xattr_size 65536 2024-04-26T20:27:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:required_client_features {} 2024-04-26T20:27:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure 0 2024-04-26T20:27:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure_osd_epoch 0 2024-04-26T20:27:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T20:27:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:max_mds 5 2024-04-26T20:27:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:in 0,1,2,3,4 2024-04-26T20:27:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:up {0=24488,1=24481,2=24463,3=24461,4=24451} 2024-04-26T20:27:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:failed 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:damaged 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:stopped 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:data_pools [3] 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:metadata_pool 2 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:inline_data disabled 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:balancer 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:bal_rank_mask -1 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:standby_count_wanted 0 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:qdb_cluster leader: 24488 members: 24481,24488,24463,24461,24451 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b{0:24488} state up:active seq 3 addr [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.e{0:24422} state up:standby-replay seq 1 addr [v2:172.21.15.80:6834/857349607,v1:172.21.15.80:6835/857349607] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.i{1:24481} state up:active seq 6 addr [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.l{1:24409} state up:standby-replay seq 1 addr [v2:172.21.15.98:6832/699509756,v1:172.21.15.98:6833/699509756] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c{2:24463} state up:active seq 7 addr [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.k{2:24392} state up:standby-replay seq 1 addr [v2:172.21.15.80:6832/20228697,v1:172.21.15.80:6833/20228697] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.h{3:24461} state up:active seq 7 addr [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a{3:14607} state up:standby-replay seq 1 addr [v2:172.21.15.70:6840/3333683222,v1:172.21.15.70:6841/3333683222] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.f{4:24451} state up:active seq 9 addr [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.g{4:14595} state up:standby-replay seq 1 addr [v2:172.21.15.70:6838/2998426471,v1:172.21.15.70:6839/2998426471] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout:Standby daemons: 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.j{-1:14511} state up:standby seq 1 addr [v2:172.21.15.70:6834/931274137,v1:172.21.15.70:6835/931274137] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.544 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.d{-1:14529} state up:standby seq 1 addr [v2:172.21.15.70:6836/2473693414,v1:172.21.15.70:6837/2473693414] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:27:02.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 -- 172.21.15.70:0/1047610137 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f87a80a3cd0 msgr2=0x7f87a80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:02.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f87a80a3cd0 0x7f87a80a6190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f87c006af00 tx=0x7f87b000a3b0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 -- 172.21.15.70:0/1047610137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87c01050b0 msgr2=0x7f87c01a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:02.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87c01050b0 0x7f87c01a0b60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f87b8007f10 tx=0x7f87b800d3b0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 -- 172.21.15.70:0/1047610137 shutdown_connections 2024-04-26T20:27:02.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f87a80a3cd0 0x7f87a80a6190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87c01050b0 0x7f87c01a0b60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c0101730 0x7f87c01995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 --2- 172.21.15.70:0/1047610137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87c0104710 0x7f87c0199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 -- 172.21.15.70:0/1047610137 >> 172.21.15.70:0/1047610137 conn(0x7f87c00fd0b0 msgr2=0x7f87c01079b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:02.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 -- 172.21.15.70:0/1047610137 shutdown_connections 2024-04-26T20:27:02.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:02.542+0000 7f87c643f700 1 -- 172.21.15.70:0/1047610137 wait complete. 2024-04-26T20:27:02.546 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2024-04-26T20:27:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:02 smithi098 ceph-mon[32591]: pgmap v345: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-26T20:27:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:02 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1047610137' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T20:27:03.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:02 smithi080 ceph-mon[32278]: pgmap v345: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-26T20:27:03.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:02 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1047610137' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T20:27:03.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:02 smithi070 ceph-mon[29124]: pgmap v345: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-26T20:27:03.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:02 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1047610137' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T20:27:03.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-26T20:27:03.629 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:27:04.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:04 smithi070 ceph-mon[29124]: pgmap v346: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-26T20:27:04.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:04 smithi098 ceph-mon[32591]: pgmap v346: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-26T20:27:04.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:04 smithi080 ceph-mon[32278]: pgmap v346: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.421+0000 7f58660fb700 1 -- 172.21.15.70:0/2289155340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5860103580 msgr2=0x7f58601039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.421+0000 7f58660fb700 1 --2- 172.21.15.70:0/2289155340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5860103580 0x7f58601039e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f58540099c0 tx=0x7f5854009cd0 comp rx=0 tx=0).stop 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.421+0000 7f58660fb700 1 -- 172.21.15.70:0/2289155340 shutdown_connections 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.421+0000 7f58660fb700 1 --2- 172.21.15.70:0/2289155340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5860103f20 0x7f586010a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.421+0000 7f58660fb700 1 --2- 172.21.15.70:0/2289155340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5860102380 0x7f58601027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.421+0000 7f58660fb700 1 --2- 172.21.15.70:0/2289155340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5860103580 0x7f58601039e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.421+0000 7f58660fb700 1 -- 172.21.15.70:0/2289155340 >> 172.21.15.70:0/2289155340 conn(0x7f58600fd920 msgr2=0x7f58600ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.421+0000 7f58660fb700 1 -- 172.21.15.70:0/2289155340 shutdown_connections 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.421+0000 7f58660fb700 1 -- 172.21.15.70:0/2289155340 wait complete. 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f58660fb700 1 Processor -- start 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f58660fb700 1 -- start start 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f58660fb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5860102380 0x7f5860199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f58660fb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5860103580 0x7f5860199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f58660fb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5860103f20 0x7f58601a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f58660fb700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f586010df50 con 0x7f5860103580 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f58660fb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f586010ddd0 con 0x7f5860103f20 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f58660fb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f586010e0d0 con 0x7f5860102380 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f585effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5860103580 0x7f5860199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f585effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5860103580 0x7f5860199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42006/0 (socket says 172.21.15.70:42006) 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f585effd700 1 -- 172.21.15.70:0/610975536 learned_addr learned my addr 172.21.15.70:0/610975536 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f585f7fe700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5860102380 0x7f5860199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.422+0000 7f585ffff700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5860103f20 0x7f58601a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.423+0000 7f585effd700 1 -- 172.21.15.70:0/610975536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5860102380 msgr2=0x7f5860199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.423+0000 7f585effd700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5860102380 0x7f5860199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.423+0000 7f585effd700 1 -- 172.21.15.70:0/610975536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5860103f20 msgr2=0x7f58601a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.423+0000 7f585effd700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5860103f20 0x7f58601a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.423+0000 7f585effd700 1 -- 172.21.15.70:0/610975536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58601a1280 con 0x7f5860103580 2024-04-26T20:27:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.423+0000 7f585effd700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5860103580 0x7f5860199b60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f58540098e0 tx=0x7f5854003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:05.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.423+0000 7f585cff9700 1 -- 172.21.15.70:0/610975536 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854027070 con 0x7f5860103580 2024-04-26T20:27:05.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.423+0000 7f58660fb700 1 -- 172.21.15.70:0/610975536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58601a1510 con 0x7f5860103580 2024-04-26T20:27:05.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.423+0000 7f585cff9700 1 -- 172.21.15.70:0/610975536 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5854004110 con 0x7f5860103580 2024-04-26T20:27:05.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.423+0000 7f58660fb700 1 -- 172.21.15.70:0/610975536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58601a19c0 con 0x7f5860103580 2024-04-26T20:27:05.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.423+0000 7f585cff9700 1 -- 172.21.15.70:0/610975536 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585400f460 con 0x7f5860103580 2024-04-26T20:27:05.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.424+0000 7f58660fb700 1 -- 172.21.15.70:0/610975536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f586006a110 con 0x7f5860103580 2024-04-26T20:27:05.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.425+0000 7f585cff9700 1 -- 172.21.15.70:0/610975536 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5854005030 con 0x7f5860103580 2024-04-26T20:27:05.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.425+0000 7f585cff9700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f58480a3d50 0x7f58480a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:05.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.426+0000 7f585f7fe700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f58480a3d50 0x7f58480a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:05.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.426+0000 7f585cff9700 1 -- 172.21.15.70:0/610975536 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f58540d1880 con 0x7f5860103580 2024-04-26T20:27:05.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.426+0000 7f585f7fe700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f58480a3d50 0x7f58480a6210 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f58601033e0 tx=0x7f5858009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:05.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.429+0000 7f585cff9700 1 -- 172.21.15.70:0/610975536 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f5854013070 con 0x7f5860103580 2024-04-26T20:27:05.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.628+0000 7f58660fb700 1 -- 172.21.15.70:0/610975536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f58601a1ce0 con 0x7f5860103580 2024-04-26T20:27:05.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.629+0000 7f585cff9700 1 -- 172.21.15.70:0/610975536 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5290 (secure 0 0 0) 0x7f585409e120 con 0x7f5860103580 2024-04-26T20:27:05.630 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 88 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:fsid cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-04-26T20:17:12.718157+0000 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-04-26T20:26:08.787018+0000 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:crush_version 26 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:full_ratio 0.95 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:backfillfull_ratio 0.9 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:nearfull_ratio 0.85 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:require_min_compat_client luminous 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:min_compat_client luminous 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:require_osd_release squid 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:stretch_mode_enabled false 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-26T20:27:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:max_osd 12 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6802/1173414845,v1:172.21.15.70:6803/1173414845] [v2:172.21.15.70:6804/1173414845,v1:172.21.15.70:6805/1173414845] exists,up 8d5da62f-a10b-4799-89d0-24ceef513b9c 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6800/2449011375,v1:172.21.15.80:6801/2449011375] [v2:172.21.15.80:6802/2449011375,v1:172.21.15.80:6803/2449011375] exists,up 76cf2db0-33a9-490b-905b-207a44bdccde 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/3805036241,v1:172.21.15.98:6801/3805036241] [v2:172.21.15.98:6802/3805036241,v1:172.21.15.98:6803/3805036241] exists,up 0c05d101-5533-40fc-b51a-3f427309846d 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6810/2247334474,v1:172.21.15.70:6811/2247334474] [v2:172.21.15.70:6812/2247334474,v1:172.21.15.70:6813/2247334474] exists,up fdf9d5ab-8f4b-4078-b880-0a7a485e58fc 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 up in weight 1 up_from 34 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6808/1371786976,v1:172.21.15.80:6809/1371786976] [v2:172.21.15.80:6810/1371786976,v1:172.21.15.80:6811/1371786976] exists,up 47740d51-b10e-46d4-bb29-0d7d5dc763fd 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 up in weight 1 up_from 39 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6808/2247181535,v1:172.21.15.98:6809/2247181535] [v2:172.21.15.98:6810/2247181535,v1:172.21.15.98:6811/2247181535] exists,up 42170565-473a-4cee-95f8-cc9f0d195ec5 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 up in weight 1 up_from 47 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6818/1060533691,v1:172.21.15.70:6819/1060533691] [v2:172.21.15.70:6820/1060533691,v1:172.21.15.70:6821/1060533691] exists,up 3e835c1d-2db6-4e95-8300-e6f1d2be9916 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 up in weight 1 up_from 52 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6816/1066348895,v1:172.21.15.80:6817/1066348895] [v2:172.21.15.80:6818/1066348895,v1:172.21.15.80:6819/1066348895] exists,up be9f0075-a715-4f28-b180-061b1a7633ba 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 up in weight 1 up_from 60 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6816/588538700,v1:172.21.15.98:6817/588538700] [v2:172.21.15.98:6818/588538700,v1:172.21.15.98:6819/588538700] exists,up de51eb21-8654-4d96-b398-0059d86c9580 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 up in weight 1 up_from 68 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6826/1559827927,v1:172.21.15.70:6827/1559827927] [v2:172.21.15.70:6828/1559827927,v1:172.21.15.70:6829/1559827927] exists,up 8ab6f37b-5549-4582-8875-1863243bd85b 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 up in weight 1 up_from 73 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6824/3717005547,v1:172.21.15.80:6825/3717005547] [v2:172.21.15.80:6826/3717005547,v1:172.21.15.80:6827/3717005547] exists,up 1b598502-7650-4dc7-b997-60dd570914c2 2024-04-26T20:27:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 up in weight 1 up_from 81 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6824/1253190539,v1:172.21.15.98:6825/1253190539] [v2:172.21.15.98:6826/1253190539,v1:172.21.15.98:6827/1253190539] exists,up 2994a2a9-f896-4f0d-baab-095277c00bde 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.0 [8,4] 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.5 [8,11] 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.14 [2,6] 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.16 [2,4,7,11] 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.0 [4,8] 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.13 [4,9] 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.27 [3,9] 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.36 [4,9] 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.39 [5,6] 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/3780213411 expires 2024-04-27T20:18:07.694178+0000 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/1905137810 expires 2024-04-27T20:18:07.694178+0000 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/671108886 expires 2024-04-27T20:17:39.758227+0000 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/3935679702 expires 2024-04-27T20:17:39.758227+0000 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/3935679702 expires 2024-04-27T20:17:39.758227+0000 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/2279707405 expires 2024-04-27T20:18:07.694178+0000 2024-04-26T20:27:05.633 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/3852527117 expires 2024-04-27T20:17:39.758227+0000 2024-04-26T20:27:05.634 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/3005389885 expires 2024-04-27T20:18:07.694178+0000 2024-04-26T20:27:05.634 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/3800276670 expires 2024-04-27T20:17:39.758227+0000 2024-04-26T20:27:05.634 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/2279707405 expires 2024-04-27T20:18:07.694178+0000 2024-04-26T20:27:05.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 -- 172.21.15.70:0/610975536 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f58480a3d50 msgr2=0x7f58480a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:05.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f58480a3d50 0x7f58480a6210 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f58601033e0 tx=0x7f5858009040 comp rx=0 tx=0).stop 2024-04-26T20:27:05.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 -- 172.21.15.70:0/610975536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5860103580 msgr2=0x7f5860199b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:05.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5860103580 0x7f5860199b60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f58540098e0 tx=0x7f5854003680 comp rx=0 tx=0).stop 2024-04-26T20:27:05.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 -- 172.21.15.70:0/610975536 shutdown_connections 2024-04-26T20:27:05.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f58480a3d50 0x7f58480a6210 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:05.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5860103f20 0x7f58601a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:05.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5860102380 0x7f5860199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:05.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 --2- 172.21.15.70:0/610975536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5860103580 0x7f5860199b60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:05.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 -- 172.21.15.70:0/610975536 >> 172.21.15.70:0/610975536 conn(0x7f58600fd920 msgr2=0x7f586006b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:05.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 -- 172.21.15.70:0/610975536 shutdown_connections 2024-04-26T20:27:05.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:05.632+0000 7f58660fb700 1 -- 172.21.15.70:0/610975536 wait complete. 2024-04-26T20:27:05.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:05 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/610975536' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T20:27:05.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:05 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/610975536' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T20:27:06.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:05 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/610975536' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T20:27:06.479 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-26T20:27:06.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:27:06.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.598+0000 7fd273103640 1 -- 172.21.15.70:0/3881132436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd26c102a80 msgr2=0x7fd26c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:06.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.598+0000 7fd273103640 1 --2- 172.21.15.70:0/3881132436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd26c102a80 0x7fd26c102f00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009900 tx=0x7fd25c02a410 comp rx=0 tx=0).stop 2024-04-26T20:27:06.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.598+0000 7fd273103640 1 -- 172.21.15.70:0/3881132436 shutdown_connections 2024-04-26T20:27:06.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.598+0000 7fd273103640 1 --2- 172.21.15.70:0/3881132436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd26c103440 0x7fd26c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.598+0000 7fd273103640 1 --2- 172.21.15.70:0/3881132436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd26c102a80 0x7fd26c102f00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.598+0000 7fd273103640 1 --2- 172.21.15.70:0/3881132436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c101890 0x7fd26c101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.598+0000 7fd273103640 1 -- 172.21.15.70:0/3881132436 >> 172.21.15.70:0/3881132436 conn(0x7fd26c0fce00 msgr2=0x7fd26c0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:06.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.598+0000 7fd273103640 1 -- 172.21.15.70:0/3881132436 shutdown_connections 2024-04-26T20:27:06.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.598+0000 7fd273103640 1 -- 172.21.15.70:0/3881132436 wait complete. 2024-04-26T20:27:06.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.599+0000 7fd273103640 1 Processor -- start 2024-04-26T20:27:06.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.599+0000 7fd273103640 1 -- start start 2024-04-26T20:27:06.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.599+0000 7fd273103640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c101890 0x7fd26c198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:06.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.599+0000 7fd273103640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd26c102a80 0x7fd26c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.599+0000 7fd273103640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd26c103440 0x7fd26c1a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.599+0000 7fd273103640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c10d550 con 0x7fd26c103440 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.599+0000 7fd273103640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c10d3d0 con 0x7fd26c101890 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.599+0000 7fd273103640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c10d6d0 con 0x7fd26c102a80 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.599+0000 7fd2716a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd26c103440 0x7fd26c1a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.599+0000 7fd2716a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd26c103440 0x7fd26c1a0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42018/0 (socket says 172.21.15.70:42018) 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.599+0000 7fd2716a0640 1 -- 172.21.15.70:0/2920966360 learned_addr learned my addr 172.21.15.70:0/2920966360 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd263fff640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd26c102a80 0x7fd26c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd270e9f640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c101890 0x7fd26c198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd2716a0640 1 -- 172.21.15.70:0/2920966360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd26c102a80 msgr2=0x7fd26c1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd2716a0640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd26c102a80 0x7fd26c1991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd2716a0640 1 -- 172.21.15.70:0/2920966360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c101890 msgr2=0x7fd26c198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:06.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd2716a0640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c101890 0x7fd26c198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd2716a0640 1 -- 172.21.15.70:0/2920966360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26c1a08b0 con 0x7fd26c103440 2024-04-26T20:27:06.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd270e9f640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c101890 0x7fd26c198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:06.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd2716a0640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd26c103440 0x7fd26c1a0210 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd26400b970 tx=0x7fd26400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:06.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd261ffb640 1 -- 172.21.15.70:0/2920966360 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264019070 con 0x7fd26c103440 2024-04-26T20:27:06.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd273103640 1 -- 172.21.15.70:0/2920966360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26c1a0ba0 con 0x7fd26c103440 2024-04-26T20:27:06.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd261ffb640 1 -- 172.21.15.70:0/2920966360 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd26400cb40 con 0x7fd26c103440 2024-04-26T20:27:06.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd261ffb640 1 -- 172.21.15.70:0/2920966360 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264007650 con 0x7fd26c103440 2024-04-26T20:27:06.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.600+0000 7fd273103640 1 -- 172.21.15.70:0/2920966360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd26c1a1170 con 0x7fd26c103440 2024-04-26T20:27:06.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.601+0000 7fd273103640 1 -- 172.21.15.70:0/2920966360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26c1a13a0 con 0x7fd26c103440 2024-04-26T20:27:06.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.602+0000 7fd261ffb640 1 -- 172.21.15.70:0/2920966360 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd26401c070 con 0x7fd26c103440 2024-04-26T20:27:06.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.603+0000 7fd261ffb640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd2540a3c40 0x7fd2540a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:06.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.603+0000 7fd270e9f640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd2540a3c40 0x7fd2540a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:06.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.603+0000 7fd261ffb640 1 -- 172.21.15.70:0/2920966360 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fd2640cffa0 con 0x7fd26c103440 2024-04-26T20:27:06.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.603+0000 7fd270e9f640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd2540a3c40 0x7fd2540a6100 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd26c199b40 tx=0x7fd268005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:06.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.611+0000 7fd261ffb640 1 -- 172.21.15.70:0/2920966360 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd26409c920 con 0x7fd26c103440 2024-04-26T20:27:06.757 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:06 smithi070 ceph-mon[29124]: pgmap v347: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:06.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.796+0000 7fd273103640 1 -- 172.21.15.70:0/2920966360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd26c1a1570 con 0x7fd26c103440 2024-04-26T20:27:06.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.797+0000 7fd261ffb640 1 -- 172.21.15.70:0/2920966360 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22646 (secure 0 0 0) 0x7fd26409c220 con 0x7fd26c103440 2024-04-26T20:27:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:27:06.799 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:26:08.787018+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":6}]},{"pgid":"2.16","mappings":[{"from":2,"to":4},{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:27:06.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 -- 172.21.15.70:0/2920966360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd2540a3c40 msgr2=0x7fd2540a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd2540a3c40 0x7fd2540a6100 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd26c199b40 tx=0x7fd268005dd0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 -- 172.21.15.70:0/2920966360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd26c103440 msgr2=0x7fd26c1a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd26c103440 0x7fd26c1a0210 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd26400b970 tx=0x7fd26400be30 comp rx=0 tx=0).stop 2024-04-26T20:27:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 -- 172.21.15.70:0/2920966360 shutdown_connections 2024-04-26T20:27:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd2540a3c40 0x7fd2540a6100 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd26c103440 0x7fd26c1a0210 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd26c102a80 0x7fd26c1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 --2- 172.21.15.70:0/2920966360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26c101890 0x7fd26c198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 -- 172.21.15.70:0/2920966360 >> 172.21.15.70:0/2920966360 conn(0x7fd26c0fce00 msgr2=0x7fd26c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 -- 172.21.15.70:0/2920966360 shutdown_connections 2024-04-26T20:27:06.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.800+0000 7fd273103640 1 -- 172.21.15.70:0/2920966360 wait complete. 2024-04-26T20:27:06.813 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:20:33.781367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:25:13.606603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:25:14.309945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:27:06.813 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:27:06.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 -- 172.21.15.70:0/2445706755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c28103b70 msgr2=0x7f2c28103ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:06.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 --2- 172.21.15.70:0/2445706755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c28103b70 0x7f2c28103ff0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009900 tx=0x7f2c1002a410 comp rx=0 tx=0).stop 2024-04-26T20:27:06.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 -- 172.21.15.70:0/2445706755 shutdown_connections 2024-04-26T20:27:06.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 --2- 172.21.15.70:0/2445706755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c28104530 0x7f2c2810adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 --2- 172.21.15.70:0/2445706755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c28103b70 0x7f2c28103ff0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 --2- 172.21.15.70:0/2445706755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c28102980 0x7f2c28102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 -- 172.21.15.70:0/2445706755 >> 172.21.15.70:0/2445706755 conn(0x7f2c280fdef0 msgr2=0x7f2c28100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:06.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 -- 172.21.15.70:0/2445706755 shutdown_connections 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 -- 172.21.15.70:0/2445706755 wait complete. 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 Processor -- start 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 -- start start 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c28102980 0x7f2c28198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c28103b70 0x7f2c28199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c28104530 0x7f2c281a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2810e730 con 0x7f2c28102980 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2810e5b0 con 0x7f2c28104530 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c2d346640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2810e8b0 con 0x7f2c28103b70 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.918+0000 7f2c26ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c28102980 0x7f2c28198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c26ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c28102980 0x7f2c28198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42032/0 (socket says 172.21.15.70:42032) 2024-04-26T20:27:06.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c26ffd640 1 -- 172.21.15.70:0/729131315 learned_addr learned my addr 172.21.15.70:0/729131315 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c1ffff640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c28103b70 0x7f2c28199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c277fe640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c28104530 0x7f2c281a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c26ffd640 1 -- 172.21.15.70:0/729131315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c28103b70 msgr2=0x7f2c28199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c26ffd640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c28103b70 0x7f2c28199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c26ffd640 1 -- 172.21.15.70:0/729131315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c28104530 msgr2=0x7f2c281a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c26ffd640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c28104530 0x7f2c281a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c26ffd640 1 -- 172.21.15.70:0/729131315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c281a0a70 con 0x7f2c28102980 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c1ffff640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c28103b70 0x7f2c28199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c26ffd640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c28102980 0x7f2c28198e50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800b450 tx=0x7f2c1800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c24ff9640 1 -- 172.21.15.70:0/729131315 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18015020 con 0x7f2c28102980 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c24ff9640 1 -- 172.21.15.70:0/729131315 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c18011d60 con 0x7f2c28102980 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c2d346640 1 -- 172.21.15.70:0/729131315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c281a0d60 con 0x7f2c28102980 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c24ff9640 1 -- 172.21.15.70:0/729131315 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1800f340 con 0x7f2c28102980 2024-04-26T20:27:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.919+0000 7f2c2d346640 1 -- 172.21.15.70:0/729131315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c281a1220 con 0x7f2c28102980 2024-04-26T20:27:06.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.920+0000 7f2c2d346640 1 -- 172.21.15.70:0/729131315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c28109d70 con 0x7f2c28102980 2024-04-26T20:27:06.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.921+0000 7f2c24ff9640 1 -- 172.21.15.70:0/729131315 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2c18018020 con 0x7f2c28102980 2024-04-26T20:27:06.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.922+0000 7f2c24ff9640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c140a3c40 0x7f2c140a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:06.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.922+0000 7f2c1ffff640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c140a3c40 0x7f2c140a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:06.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.922+0000 7f2c24ff9640 1 -- 172.21.15.70:0/729131315 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f2c180d0010 con 0x7f2c28102980 2024-04-26T20:27:06.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.922+0000 7f2c1ffff640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c140a3c40 0x7f2c140a6100 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2c1002a930 tx=0x7f2c10000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:06.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:06.926+0000 7f2c24ff9640 1 -- 172.21.15.70:0/729131315 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2c1801f020 con 0x7f2c28102980 2024-04-26T20:27:06.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:06 smithi098 ceph-mon[32591]: pgmap v347: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:06.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:06 smithi080 ceph-mon[32278]: pgmap v347: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:07.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.112+0000 7f2c2d346640 1 -- 172.21.15.70:0/729131315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2c2802dcd0 con 0x7f2c28102980 2024-04-26T20:27:07.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.112+0000 7f2c24ff9640 1 -- 172.21.15.70:0/729131315 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f2c1800d040 con 0x7f2c28102980 2024-04-26T20:27:07.114 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-04-26T20:27:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 -- 172.21.15.70:0/729131315 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c140a3c40 msgr2=0x7f2c140a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c140a3c40 0x7f2c140a6100 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2c1002a930 tx=0x7f2c10000bc0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 -- 172.21.15.70:0/729131315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c28102980 msgr2=0x7f2c28198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c28102980 0x7f2c28198e50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800b450 tx=0x7f2c1800b910 comp rx=0 tx=0).stop 2024-04-26T20:27:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 -- 172.21.15.70:0/729131315 shutdown_connections 2024-04-26T20:27:07.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f2c140a3c40 0x7f2c140a6100 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c28104530 0x7f2c281a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c28103b70 0x7f2c28199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 --2- 172.21.15.70:0/729131315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c28102980 0x7f2c28198e50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 -- 172.21.15.70:0/729131315 >> 172.21.15.70:0/729131315 conn(0x7f2c280fdef0 msgr2=0x7f2c28106f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:07.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 -- 172.21.15.70:0/729131315 shutdown_connections 2024-04-26T20:27:07.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.114+0000 7f2c2d346640 1 -- 172.21.15.70:0/729131315 wait complete. 2024-04-26T20:27:07.126 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:27:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.229+0000 7f1114c37640 1 -- 172.21.15.70:0/541653897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11101086f0 msgr2=0x7f111010aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.229+0000 7f1114c37640 1 --2- 172.21.15.70:0/541653897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11101086f0 0x7f111010aae0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1108009ca0 tx=0x7f110802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.229+0000 7f1114c37640 1 -- 172.21.15.70:0/541653897 shutdown_connections 2024-04-26T20:27:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.229+0000 7f1114c37640 1 --2- 172.21.15.70:0/541653897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11101086f0 0x7f111010aae0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.229+0000 7f1114c37640 1 --2- 172.21.15.70:0/541653897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1110105dc0 0x7f11101081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.229+0000 7f1114c37640 1 --2- 172.21.15.70:0/541653897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1110103490 0x7f1110105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.229+0000 7f1114c37640 1 -- 172.21.15.70:0/541653897 >> 172.21.15.70:0/541653897 conn(0x7f11100fce00 msgr2=0x7f11100ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.229+0000 7f1114c37640 1 -- 172.21.15.70:0/541653897 shutdown_connections 2024-04-26T20:27:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.229+0000 7f1114c37640 1 -- 172.21.15.70:0/541653897 wait complete. 2024-04-26T20:27:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.229+0000 7f1114c37640 1 Processor -- start 2024-04-26T20:27:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.229+0000 7f1114c37640 1 -- start start 2024-04-26T20:27:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f1114c37640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1110103490 0x7f1110198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f1114c37640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1110105dc0 0x7f11101991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f1114c37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11101086f0 0x7f11101a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f1114c37640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f111010e5f0 con 0x7f1110103490 2024-04-26T20:27:07.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f1114c37640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f111010e470 con 0x7f1110105dc0 2024-04-26T20:27:07.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f1114c37640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f111010e770 con 0x7f11101086f0 2024-04-26T20:27:07.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1110103490 0x7f1110198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:07.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1110103490 0x7f1110198c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42058/0 (socket says 172.21.15.70:42058) 2024-04-26T20:27:07.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110e59c640 1 -- 172.21.15.70:0/1728353085 learned_addr learned my addr 172.21.15.70:0/1728353085 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:07.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110ed9d640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11101086f0 0x7f11101a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:07.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110dd9b640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1110105dc0 0x7f11101991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:07.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110e59c640 1 -- 172.21.15.70:0/1728353085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11101086f0 msgr2=0x7f11101a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110e59c640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11101086f0 0x7f11101a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110e59c640 1 -- 172.21.15.70:0/1728353085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1110105dc0 msgr2=0x7f11101991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110e59c640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1110105dc0 0x7f11101991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110e59c640 1 -- 172.21.15.70:0/1728353085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11101a08c0 con 0x7f1110103490 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110ed9d640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11101086f0 0x7f11101a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f110e59c640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1110103490 0x7f1110198c80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f110000c890 tx=0x7f110000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f10ff7fe640 1 -- 172.21.15.70:0/1728353085 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100004220 con 0x7f1110103490 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f10ff7fe640 1 -- 172.21.15.70:0/1728353085 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11000043c0 con 0x7f1110103490 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f1114c37640 1 -- 172.21.15.70:0/1728353085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11101a0bb0 con 0x7f1110103490 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f10ff7fe640 1 -- 172.21.15.70:0/1728353085 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11000049c0 con 0x7f1110103490 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.230+0000 7f1114c37640 1 -- 172.21.15.70:0/1728353085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11101a1100 con 0x7f1110103490 2024-04-26T20:27:07.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.231+0000 7f1114c37640 1 -- 172.21.15.70:0/1728353085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11100fe8f0 con 0x7f1110103490 2024-04-26T20:27:07.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.232+0000 7f10ff7fe640 1 -- 172.21.15.70:0/1728353085 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1100005140 con 0x7f1110103490 2024-04-26T20:27:07.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.233+0000 7f10ff7fe640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f10f80a3c40 0x7f10f80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.233+0000 7f110dd9b640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f10f80a3c40 0x7f10f80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:07.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.233+0000 7f10ff7fe640 1 -- 172.21.15.70:0/1728353085 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f11000d02f0 con 0x7f1110103490 2024-04-26T20:27:07.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.233+0000 7f110dd9b640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f10f80a3c40 0x7f10f80a6100 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1104005fd0 tx=0x7f1104005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:07.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.238+0000 7f10ff7fe640 1 -- 172.21.15.70:0/1728353085 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1100014030 con 0x7f1110103490 2024-04-26T20:27:07.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.419+0000 7f1114c37640 1 -- 172.21.15.70:0/1728353085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f111002dd20 con 0x7f1110103490 2024-04-26T20:27:07.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.420+0000 7f10ff7fe640 1 -- 172.21.15.70:0/1728353085 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f110009cb60 con 0x7f1110103490 2024-04-26T20:27:07.421 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-04-26T20:27:07.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 -- 172.21.15.70:0/1728353085 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f10f80a3c40 msgr2=0x7f10f80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f10f80a3c40 0x7f10f80a6100 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1104005fd0 tx=0x7f1104005850 comp rx=0 tx=0).stop 2024-04-26T20:27:07.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 -- 172.21.15.70:0/1728353085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1110103490 msgr2=0x7f1110198c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1110103490 0x7f1110198c80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f110000c890 tx=0x7f110000cd50 comp rx=0 tx=0).stop 2024-04-26T20:27:07.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 -- 172.21.15.70:0/1728353085 shutdown_connections 2024-04-26T20:27:07.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f10f80a3c40 0x7f10f80a6100 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11101086f0 0x7f11101a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1110105dc0 0x7f11101991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 --2- 172.21.15.70:0/1728353085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1110103490 0x7f1110198c80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 -- 172.21.15.70:0/1728353085 >> 172.21.15.70:0/1728353085 conn(0x7f11100fce00 msgr2=0x7f1110103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:07.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 -- 172.21.15.70:0/1728353085 shutdown_connections 2024-04-26T20:27:07.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.422+0000 7f1114c37640 1 -- 172.21.15.70:0/1728353085 wait complete. 2024-04-26T20:27:07.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:27:07.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.535+0000 7f204eebd640 1 -- 172.21.15.70:0/2457831698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2048108650 msgr2=0x7f204810aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.535+0000 7f204eebd640 1 --2- 172.21.15.70:0/2457831698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2048108650 0x7f204810aaa0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2040009ca0 tx=0x7f204002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.535+0000 7f204eebd640 1 -- 172.21.15.70:0/2457831698 shutdown_connections 2024-04-26T20:27:07.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.535+0000 7f204eebd640 1 --2- 172.21.15.70:0/2457831698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2048108650 0x7f204810aaa0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.535+0000 7f204eebd640 1 --2- 172.21.15.70:0/2457831698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2048105d20 0x7f2048108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.535+0000 7f204eebd640 1 --2- 172.21.15.70:0/2457831698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20481033f0 0x7f20481057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.535+0000 7f204eebd640 1 -- 172.21.15.70:0/2457831698 >> 172.21.15.70:0/2457831698 conn(0x7f20480fce00 msgr2=0x7f20480ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:07.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.535+0000 7f204eebd640 1 -- 172.21.15.70:0/2457831698 shutdown_connections 2024-04-26T20:27:07.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.535+0000 7f204eebd640 1 -- 172.21.15.70:0/2457831698 wait complete. 2024-04-26T20:27:07.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204eebd640 1 Processor -- start 2024-04-26T20:27:07.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204eebd640 1 -- start start 2024-04-26T20:27:07.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204eebd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20481033f0 0x7f2048198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204eebd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2048105d20 0x7f20481990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204eebd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2048108650 0x7f20481a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204eebd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f204810e5d0 con 0x7f20481033f0 2024-04-26T20:27:07.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204eebd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f204810e450 con 0x7f2048105d20 2024-04-26T20:27:07.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204eebd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f204810e750 con 0x7f2048108650 2024-04-26T20:27:07.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204cc59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20481033f0 0x7f2048198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:07.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204cc59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20481033f0 0x7f2048198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42080/0 (socket says 172.21.15.70:42080) 2024-04-26T20:27:07.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204cc59640 1 -- 172.21.15.70:0/3296008745 learned_addr learned my addr 172.21.15.70:0/3296008745 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:07.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204d45a640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2048108650 0x7f20481a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f2047fff640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2048105d20 0x7f20481990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204cc59640 1 -- 172.21.15.70:0/3296008745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2048108650 msgr2=0x7f20481a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204cc59640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2048108650 0x7f20481a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204cc59640 1 -- 172.21.15.70:0/3296008745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2048105d20 msgr2=0x7f20481990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204cc59640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2048105d20 0x7f20481990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.536+0000 7f204cc59640 1 -- 172.21.15.70:0/3296008745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20481a07b0 con 0x7f20481033f0 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.537+0000 7f204cc59640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20481033f0 0x7f2048198b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f203c00d950 tx=0x7f203c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.537+0000 7f2045ffb640 1 -- 172.21.15.70:0/3296008745 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c017030 con 0x7f20481033f0 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.537+0000 7f2045ffb640 1 -- 172.21.15.70:0/3296008745 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f203c004020 con 0x7f20481033f0 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.537+0000 7f204eebd640 1 -- 172.21.15.70:0/3296008745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20481a0aa0 con 0x7f20481033f0 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.537+0000 7f2045ffb640 1 -- 172.21.15.70:0/3296008745 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c0047a0 con 0x7f20481033f0 2024-04-26T20:27:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.537+0000 7f204eebd640 1 -- 172.21.15.70:0/3296008745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20481a0ff0 con 0x7f20481033f0 2024-04-26T20:27:07.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.538+0000 7f204eebd640 1 -- 172.21.15.70:0/3296008745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20480fe8f0 con 0x7f20481033f0 2024-04-26T20:27:07.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.539+0000 7f2045ffb640 1 -- 172.21.15.70:0/3296008745 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f203c0041d0 con 0x7f20481033f0 2024-04-26T20:27:07.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.540+0000 7f2045ffb640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20380a3c40 0x7f20380a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.540+0000 7f2045ffb640 1 -- 172.21.15.70:0/3296008745 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f203c0d00d0 con 0x7f20481033f0 2024-04-26T20:27:07.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.540+0000 7f2047fff640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20380a3c40 0x7f20380a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:07.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.540+0000 7f2047fff640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20380a3c40 0x7f20380a6100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f204819a0a0 tx=0x7f203400c4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:07.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.544+0000 7f2045ffb640 1 -- 172.21.15.70:0/3296008745 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f203c09c940 con 0x7f20481033f0 2024-04-26T20:27:07.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.731+0000 7f204eebd640 1 -- 172.21.15.70:0/3296008745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f204802dcc0 con 0x7f20481033f0 2024-04-26T20:27:07.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.731+0000 7f2045ffb640 1 -- 172.21.15.70:0/3296008745 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f203c09c240 con 0x7f20481033f0 2024-04-26T20:27:07.732 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-04-26T20:27:07.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.733+0000 7f204eebd640 1 -- 172.21.15.70:0/3296008745 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20380a3c40 msgr2=0x7f20380a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.733+0000 7f204eebd640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20380a3c40 0x7f20380a6100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f204819a0a0 tx=0x7f203400c4a0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.733+0000 7f204eebd640 1 -- 172.21.15.70:0/3296008745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20481033f0 msgr2=0x7f2048198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.733+0000 7f204eebd640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20481033f0 0x7f2048198b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f203c00d950 tx=0x7f203c00de10 comp rx=0 tx=0).stop 2024-04-26T20:27:07.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.733+0000 7f204eebd640 1 -- 172.21.15.70:0/3296008745 shutdown_connections 2024-04-26T20:27:07.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.733+0000 7f204eebd640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f20380a3c40 0x7f20380a6100 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.734+0000 7f204eebd640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2048108650 0x7f20481a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.734+0000 7f204eebd640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2048105d20 0x7f20481990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.734+0000 7f204eebd640 1 --2- 172.21.15.70:0/3296008745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20481033f0 0x7f2048198b90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.734+0000 7f204eebd640 1 -- 172.21.15.70:0/3296008745 >> 172.21.15.70:0/3296008745 conn(0x7f20480fce00 msgr2=0x7f2048103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:07.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.734+0000 7f204eebd640 1 -- 172.21.15.70:0/3296008745 shutdown_connections 2024-04-26T20:27:07.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.734+0000 7f204eebd640 1 -- 172.21.15.70:0/3296008745 wait complete. 2024-04-26T20:27:07.747 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:27:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.844+0000 7f6beeb38640 1 -- 172.21.15.70:0/1614099303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6be8101890 msgr2=0x7f6be8101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.844+0000 7f6beeb38640 1 --2- 172.21.15.70:0/1614099303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6be8101890 0x7f6be8101cb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009ca0 tx=0x7f6be002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.844+0000 7f6beeb38640 1 -- 172.21.15.70:0/1614099303 shutdown_connections 2024-04-26T20:27:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.844+0000 7f6beeb38640 1 --2- 172.21.15.70:0/1614099303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be8103440 0x7f6be8109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.844+0000 7f6beeb38640 1 --2- 172.21.15.70:0/1614099303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be8102a80 0x7f6be8102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.844+0000 7f6beeb38640 1 --2- 172.21.15.70:0/1614099303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6be8101890 0x7f6be8101cb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.844+0000 7f6beeb38640 1 -- 172.21.15.70:0/1614099303 >> 172.21.15.70:0/1614099303 conn(0x7f6be80fce00 msgr2=0x7f6be80ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.844+0000 7f6beeb38640 1 -- 172.21.15.70:0/1614099303 shutdown_connections 2024-04-26T20:27:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.844+0000 7f6beeb38640 1 -- 172.21.15.70:0/1614099303 wait complete. 2024-04-26T20:27:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6beeb38640 1 Processor -- start 2024-04-26T20:27:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6beeb38640 1 -- start start 2024-04-26T20:27:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6beeb38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6be8101890 0x7f6be8198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6beeb38640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be8102a80 0x7f6be8199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6beeb38640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be8103440 0x7f6be81a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6beeb38640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6be810d540 con 0x7f6be8101890 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6beeb38640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6be810d3c0 con 0x7f6be8103440 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6beeb38640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6be810d6c0 con 0x7f6be8102a80 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6bec8d4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6be8101890 0x7f6be8198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6bec8d4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6be8101890 0x7f6be8198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42100/0 (socket says 172.21.15.70:42100) 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6bec8d4640 1 -- 172.21.15.70:0/830824750 learned_addr learned my addr 172.21.15.70:0/830824750 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6be7fff640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be8102a80 0x7f6be8199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6bec8d4640 1 -- 172.21.15.70:0/830824750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be8102a80 msgr2=0x7f6be8199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6bec8d4640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be8102a80 0x7f6be8199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6bec8d4640 1 -- 172.21.15.70:0/830824750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be8103440 msgr2=0x7f6be81a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6bec8d4640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be8103440 0x7f6be81a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6bec8d4640 1 -- 172.21.15.70:0/830824750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be81a0900 con 0x7f6be8101890 2024-04-26T20:27:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.845+0000 7f6be7fff640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be8102a80 0x7f6be8199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.846+0000 7f6bec8d4640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6be8101890 0x7f6be8198cc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6be0000f80 tx=0x7f6be002f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.846+0000 7f6be5ffb640 1 -- 172.21.15.70:0/830824750 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0003c70 con 0x7f6be8101890 2024-04-26T20:27:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.846+0000 7f6be5ffb640 1 -- 172.21.15.70:0/830824750 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6be0003e10 con 0x7f6be8101890 2024-04-26T20:27:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.846+0000 7f6beeb38640 1 -- 172.21.15.70:0/830824750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be81a0b90 con 0x7f6be8101890 2024-04-26T20:27:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.846+0000 7f6be5ffb640 1 -- 172.21.15.70:0/830824750 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be002fd30 con 0x7f6be8101890 2024-04-26T20:27:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.846+0000 7f6beeb38640 1 -- 172.21.15.70:0/830824750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be81a1130 con 0x7f6be8101890 2024-04-26T20:27:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.847+0000 7f6beeb38640 1 -- 172.21.15.70:0/830824750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be81a1300 con 0x7f6be8101890 2024-04-26T20:27:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.848+0000 7f6be5ffb640 1 -- 172.21.15.70:0/830824750 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6be0004040 con 0x7f6be8101890 2024-04-26T20:27:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.849+0000 7f6be5ffb640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bd40a3cc0 0x7f6bd40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.849+0000 7f6be7fff640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bd40a3cc0 0x7f6bd40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.849+0000 7f6be5ffb640 1 -- 172.21.15.70:0/830824750 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f6be00f1bd0 con 0x7f6be8101890 2024-04-26T20:27:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.849+0000 7f6be7fff640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bd40a3cc0 0x7f6bd40a6180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6be819a1c0 tx=0x7f6bd0005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:07.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:07.852+0000 7f6be5ffb640 1 -- 172.21.15.70:0/830824750 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f6be00be550 con 0x7f6be8101890 2024-04-26T20:27:07.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:07 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2920966360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:27:07.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:07 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/729131315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:27:07.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:07 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1728353085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:27:07.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:07 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2920966360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:27:07.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:07 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/729131315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:27:07.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:07 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1728353085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:27:08.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:07 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2920966360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:27:08.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:07 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/729131315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:27:08.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:07 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1728353085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:27:08.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.073+0000 7f6beeb38640 1 -- 172.21.15.70:0/830824750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6be81a15f0 con 0x7f6be8101890 2024-04-26T20:27:08.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.074+0000 7f6be5ffb640 1 -- 172.21.15.70:0/830824750 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7f6be00bde50 con 0x7f6be8101890 2024-04-26T20:27:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:27:08.075 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:25:15.345214+0000","modified":"2024-04-26T20:25:22.041593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24488,"mds_1":24481,"mds_2":24463,"mds_3":24461,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3333683222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3333683222},{"type":"v1","addr":"172.21.15.70:6841","nonce":3333683222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":3,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":1,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6839/4099319394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4099319394},{"type":"v1","addr":"172.21.15.80:6839","nonce":4099319394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24481,24488,24463,24461,24451]},"id":1}]} 2024-04-26T20:27:08.075 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2024-04-26T20:27:08.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 -- 172.21.15.70:0/830824750 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bd40a3cc0 msgr2=0x7f6bd40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bd40a3cc0 0x7f6bd40a6180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6be819a1c0 tx=0x7f6bd0005e50 comp rx=0 tx=0).stop 2024-04-26T20:27:08.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 -- 172.21.15.70:0/830824750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6be8101890 msgr2=0x7f6be8198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6be8101890 0x7f6be8198cc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6be0000f80 tx=0x7f6be002f450 comp rx=0 tx=0).stop 2024-04-26T20:27:08.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 -- 172.21.15.70:0/830824750 shutdown_connections 2024-04-26T20:27:08.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f6bd40a3cc0 0x7f6bd40a6180 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be8103440 0x7f6be81a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be8102a80 0x7f6be8199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 --2- 172.21.15.70:0/830824750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6be8101890 0x7f6be8198cc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 -- 172.21.15.70:0/830824750 >> 172.21.15.70:0/830824750 conn(0x7f6be80fce00 msgr2=0x7f6be8069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:08.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 -- 172.21.15.70:0/830824750 shutdown_connections 2024-04-26T20:27:08.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.076+0000 7f6beeb38640 1 -- 172.21.15.70:0/830824750 wait complete. 2024-04-26T20:27:08.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:27:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.185+0000 7fd056319640 1 -- 172.21.15.70:0/545335092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd050103440 msgr2=0x7fd050109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.185+0000 7fd056319640 1 --2- 172.21.15.70:0/545335092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd050103440 0x7fd050109cd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd048009ca0 tx=0x7fd04802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.185+0000 7fd056319640 1 -- 172.21.15.70:0/545335092 shutdown_connections 2024-04-26T20:27:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.185+0000 7fd056319640 1 --2- 172.21.15.70:0/545335092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd050103440 0x7fd050109cd0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.185+0000 7fd056319640 1 --2- 172.21.15.70:0/545335092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd050102a80 0x7fd050102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.185+0000 7fd056319640 1 --2- 172.21.15.70:0/545335092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd050101890 0x7fd050101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.185+0000 7fd056319640 1 -- 172.21.15.70:0/545335092 >> 172.21.15.70:0/545335092 conn(0x7fd0500fce40 msgr2=0x7fd0500ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.185+0000 7fd056319640 1 -- 172.21.15.70:0/545335092 shutdown_connections 2024-04-26T20:27:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.185+0000 7fd056319640 1 -- 172.21.15.70:0/545335092 wait complete. 2024-04-26T20:27:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.185+0000 7fd056319640 1 Processor -- start 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd056319640 1 -- start start 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd056319640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd050101890 0x7fd050198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd056319640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd050102a80 0x7fd050199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd056319640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd050103440 0x7fd0501a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd056319640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd05010d5a0 con 0x7fd050101890 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd056319640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd05010d420 con 0x7fd050102a80 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd056319640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd05010d720 con 0x7fd050103440 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd04ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd050101890 0x7fd050198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd04ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd050101890 0x7fd050198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42110/0 (socket says 172.21.15.70:42110) 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd04ffff640 1 -- 172.21.15.70:0/824005472 learned_addr learned my addr 172.21.15.70:0/824005472 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd0548b6640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd050103440 0x7fd0501a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd04f7fe640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd050102a80 0x7fd050199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd04ffff640 1 -- 172.21.15.70:0/824005472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd050103440 msgr2=0x7fd0501a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd04ffff640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd050103440 0x7fd0501a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd04ffff640 1 -- 172.21.15.70:0/824005472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd050102a80 msgr2=0x7fd050199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd04ffff640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd050102a80 0x7fd050199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd04ffff640 1 -- 172.21.15.70:0/824005472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0501a0810 con 0x7fd050101890 2024-04-26T20:27:08.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.186+0000 7fd04ffff640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd050101890 0x7fd050198bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd04000c970 tx=0x7fd04000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:08.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.187+0000 7fd04d7fa640 1 -- 172.21.15.70:0/824005472 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040007b50 con 0x7fd050101890 2024-04-26T20:27:08.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.187+0000 7fd056319640 1 -- 172.21.15.70:0/824005472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0501a0b00 con 0x7fd050101890 2024-04-26T20:27:08.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.187+0000 7fd04d7fa640 1 -- 172.21.15.70:0/824005472 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd040007cf0 con 0x7fd050101890 2024-04-26T20:27:08.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.187+0000 7fd04d7fa640 1 -- 172.21.15.70:0/824005472 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04000f780 con 0x7fd050101890 2024-04-26T20:27:08.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.187+0000 7fd056319640 1 -- 172.21.15.70:0/824005472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0501a1050 con 0x7fd050101890 2024-04-26T20:27:08.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.188+0000 7fd056319640 1 -- 172.21.15.70:0/824005472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0501a1280 con 0x7fd050101890 2024-04-26T20:27:08.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.189+0000 7fd04d7fa640 1 -- 172.21.15.70:0/824005472 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd04000f980 con 0x7fd050101890 2024-04-26T20:27:08.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.189+0000 7fd04d7fa640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd0380a3c40 0x7fd0380a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.189+0000 7fd04f7fe640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd0380a3c40 0x7fd0380a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.189+0000 7fd04d7fa640 1 -- 172.21.15.70:0/824005472 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fd0400d0840 con 0x7fd050101890 2024-04-26T20:27:08.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.190+0000 7fd04f7fe640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd0380a3c40 0x7fd0380a6100 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd05019a100 tx=0x7fd044009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:08.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.194+0000 7fd04d7fa640 1 -- 172.21.15.70:0/824005472 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd04009d140 con 0x7fd050101890 2024-04-26T20:27:08.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.373+0000 7fd056319640 1 -- 172.21.15.70:0/824005472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0501a1450 con 0x7fd050101890 2024-04-26T20:27:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.375+0000 7fd04d7fa640 1 -- 172.21.15.70:0/824005472 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22646 (secure 0 0 0) 0x7fd04009ca40 con 0x7fd050101890 2024-04-26T20:27:08.376 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:27:08.376 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:26:08.787018+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":6}]},{"pgid":"2.16","mappings":[{"from":2,"to":4},{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:27:08.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 -- 172.21.15.70:0/824005472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd0380a3c40 msgr2=0x7fd0380a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd0380a3c40 0x7fd0380a6100 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd05019a100 tx=0x7fd044009110 comp rx=0 tx=0).stop 2024-04-26T20:27:08.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 -- 172.21.15.70:0/824005472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd050101890 msgr2=0x7fd050198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd050101890 0x7fd050198bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd04000c970 tx=0x7fd04000cd70 comp rx=0 tx=0).stop 2024-04-26T20:27:08.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 -- 172.21.15.70:0/824005472 shutdown_connections 2024-04-26T20:27:08.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fd0380a3c40 0x7fd0380a6100 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd050103440 0x7fd0501a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd050102a80 0x7fd050199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 --2- 172.21.15.70:0/824005472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd050101890 0x7fd050198bf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 -- 172.21.15.70:0/824005472 >> 172.21.15.70:0/824005472 conn(0x7fd0500fce40 msgr2=0x7fd0500fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:08.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 -- 172.21.15.70:0/824005472 shutdown_connections 2024-04-26T20:27:08.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.377+0000 7fd056319640 1 -- 172.21.15.70:0/824005472 wait complete. 2024-04-26T20:27:08.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:20:33.781367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:25:13.606603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:25:14.309945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:27:08.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:27:08.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.490+0000 7f33dea37640 1 -- 172.21.15.70:0/327547808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d8101870 msgr2=0x7f33d8101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.490+0000 7f33dea37640 1 --2- 172.21.15.70:0/327547808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d8101870 0x7f33d8101c90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009900 tx=0x7f33c802a410 comp rx=0 tx=0).stop 2024-04-26T20:27:08.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.490+0000 7f33dea37640 1 -- 172.21.15.70:0/327547808 shutdown_connections 2024-04-26T20:27:08.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.490+0000 7f33dea37640 1 --2- 172.21.15.70:0/327547808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d8103420 0x7f33d8109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.490+0000 7f33dea37640 1 --2- 172.21.15.70:0/327547808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d8102a60 0x7f33d8102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.490+0000 7f33dea37640 1 --2- 172.21.15.70:0/327547808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d8101870 0x7f33d8101c90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.490+0000 7f33dea37640 1 -- 172.21.15.70:0/327547808 >> 172.21.15.70:0/327547808 conn(0x7f33d80fce00 msgr2=0x7f33d80ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:08.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.490+0000 7f33dea37640 1 -- 172.21.15.70:0/327547808 shutdown_connections 2024-04-26T20:27:08.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.490+0000 7f33dea37640 1 -- 172.21.15.70:0/327547808 wait complete. 2024-04-26T20:27:08.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33dea37640 1 Processor -- start 2024-04-26T20:27:08.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33dea37640 1 -- start start 2024-04-26T20:27:08.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33dea37640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d8101870 0x7f33d8198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33dea37640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d8102a60 0x7f33d81991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33dea37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d8103420 0x7f33d81a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33dea37640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33d810e5e0 con 0x7f33d8101870 2024-04-26T20:27:08.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33dea37640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f33d810e460 con 0x7f33d8102a60 2024-04-26T20:27:08.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33dea37640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f33d810e760 con 0x7f33d8103420 2024-04-26T20:27:08.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d8101870 0x7f33d8198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d8101870 0x7f33d8198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42130/0 (socket says 172.21.15.70:42130) 2024-04-26T20:27:08.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33d7fff640 1 -- 172.21.15.70:0/3144957482 learned_addr learned my addr 172.21.15.70:0/3144957482 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33dcfd4640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d8103420 0x7f33d81a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33d77fe640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d8102a60 0x7f33d81991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33d7fff640 1 -- 172.21.15.70:0/3144957482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d8103420 msgr2=0x7f33d81a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33d7fff640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d8103420 0x7f33d81a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33d7fff640 1 -- 172.21.15.70:0/3144957482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d8102a60 msgr2=0x7f33d81991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33d7fff640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d8102a60 0x7f33d81991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33d7fff640 1 -- 172.21.15.70:0/3144957482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d81a08f0 con 0x7f33d8101870 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.491+0000 7f33dcfd4640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d8103420 0x7f33d81a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.492+0000 7f33d7fff640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d8101870 0x7f33d8198cb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f33c8006010 tx=0x7f33c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.492+0000 7f33d57fa640 1 -- 172.21.15.70:0/3144957482 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c803f030 con 0x7f33d8101870 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.492+0000 7f33d57fa640 1 -- 172.21.15.70:0/3144957482 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f33c8003cd0 con 0x7f33d8101870 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.492+0000 7f33dea37640 1 -- 172.21.15.70:0/3144957482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d81a0b80 con 0x7f33d8101870 2024-04-26T20:27:08.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.492+0000 7f33d57fa640 1 -- 172.21.15.70:0/3144957482 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8035070 con 0x7f33d8101870 2024-04-26T20:27:08.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.492+0000 7f33dea37640 1 -- 172.21.15.70:0/3144957482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d81a1070 con 0x7f33d8101870 2024-04-26T20:27:08.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.493+0000 7f33dea37640 1 -- 172.21.15.70:0/3144957482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d8108be0 con 0x7f33d8101870 2024-04-26T20:27:08.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.494+0000 7f33d57fa640 1 -- 172.21.15.70:0/3144957482 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f33c8042030 con 0x7f33d8101870 2024-04-26T20:27:08.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.494+0000 7f33d57fa640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f33c00a3c40 0x7f33c00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.495+0000 7f33d77fe640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f33c00a3c40 0x7f33c00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.495+0000 7f33d57fa640 1 -- 172.21.15.70:0/3144957482 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f33c80f0bc0 con 0x7f33d8101870 2024-04-26T20:27:08.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.495+0000 7f33d77fe640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f33c00a3c40 0x7f33c00a6100 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f33cc005d00 tx=0x7f33cc005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:08.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.499+0000 7f33d57fa640 1 -- 172.21.15.70:0/3144957482 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f33c80bd430 con 0x7f33d8101870 2024-04-26T20:27:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.678+0000 7f33dea37640 1 -- 172.21.15.70:0/3144957482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f33d8063530 con 0x7f33d8101870 2024-04-26T20:27:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.678+0000 7f33d57fa640 1 -- 172.21.15.70:0/3144957482 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f33c80bcd30 con 0x7f33d8101870 2024-04-26T20:27:08.679 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-04-26T20:27:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 -- 172.21.15.70:0/3144957482 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f33c00a3c40 msgr2=0x7f33c00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f33c00a3c40 0x7f33c00a6100 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f33cc005d00 tx=0x7f33cc005c50 comp rx=0 tx=0).stop 2024-04-26T20:27:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 -- 172.21.15.70:0/3144957482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d8101870 msgr2=0x7f33d8198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d8101870 0x7f33d8198cb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f33c8006010 tx=0x7f33c80042f0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 -- 172.21.15.70:0/3144957482 shutdown_connections 2024-04-26T20:27:08.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f33c00a3c40 0x7f33c00a6100 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d8103420 0x7f33d81a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d8102a60 0x7f33d81991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 --2- 172.21.15.70:0/3144957482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d8101870 0x7f33d8198cb0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 -- 172.21.15.70:0/3144957482 >> 172.21.15.70:0/3144957482 conn(0x7f33d80fce00 msgr2=0x7f33d8105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:08.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 -- 172.21.15.70:0/3144957482 shutdown_connections 2024-04-26T20:27:08.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.680+0000 7f33dea37640 1 -- 172.21.15.70:0/3144957482 wait complete. 2024-04-26T20:27:08.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:27:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.792+0000 7feedb8e1640 1 -- 172.21.15.70:0/3429539300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feed41033f0 msgr2=0x7feed41057e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.792+0000 7feedb8e1640 1 --2- 172.21.15.70:0/3429539300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feed41033f0 0x7feed41057e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feecc009900 tx=0x7feecc02a410 comp rx=0 tx=0).stop 2024-04-26T20:27:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.792+0000 7feedb8e1640 1 -- 172.21.15.70:0/3429539300 shutdown_connections 2024-04-26T20:27:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.792+0000 7feedb8e1640 1 --2- 172.21.15.70:0/3429539300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feed4108650 0x7feed410aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.792+0000 7feedb8e1640 1 --2- 172.21.15.70:0/3429539300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feed4105d20 0x7feed4108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.792+0000 7feedb8e1640 1 --2- 172.21.15.70:0/3429539300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feed41033f0 0x7feed41057e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.792+0000 7feedb8e1640 1 -- 172.21.15.70:0/3429539300 >> 172.21.15.70:0/3429539300 conn(0x7feed40fce00 msgr2=0x7feed40ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.792+0000 7feedb8e1640 1 -- 172.21.15.70:0/3429539300 shutdown_connections 2024-04-26T20:27:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.792+0000 7feedb8e1640 1 -- 172.21.15.70:0/3429539300 wait complete. 2024-04-26T20:27:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feedb8e1640 1 Processor -- start 2024-04-26T20:27:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feedb8e1640 1 -- start start 2024-04-26T20:27:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feedb8e1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feed41033f0 0x7feed4198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feedb8e1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feed4105d20 0x7feed4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feedb8e1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feed4108650 0x7feed41a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feedb8e1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feed410e650 con 0x7feed4105d20 2024-04-26T20:27:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feedb8e1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feed410e4d0 con 0x7feed41033f0 2024-04-26T20:27:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feedb8e1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feed410e7d0 con 0x7feed4108650 2024-04-26T20:27:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feed8e7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feed4105d20 0x7feed4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feed8e7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feed4105d20 0x7feed4199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42150/0 (socket says 172.21.15.70:42150) 2024-04-26T20:27:08.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feed8e7c640 1 -- 172.21.15.70:0/956425174 learned_addr learned my addr 172.21.15.70:0/956425174 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:08.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feed9e7e640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feed4108650 0x7feed41a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feed967d640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feed41033f0 0x7feed4198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feed8e7c640 1 -- 172.21.15.70:0/956425174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feed4108650 msgr2=0x7feed41a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feed8e7c640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feed4108650 0x7feed41a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feed8e7c640 1 -- 172.21.15.70:0/956425174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feed41033f0 msgr2=0x7feed4198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feed8e7c640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feed41033f0 0x7feed4198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.793+0000 7feed8e7c640 1 -- 172.21.15.70:0/956425174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed41a0950 con 0x7feed4105d20 2024-04-26T20:27:08.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.794+0000 7feed8e7c640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feed4105d20 0x7feed4199280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feec400c970 tx=0x7feec400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:08.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.794+0000 7feeca7fc640 1 -- 172.21.15.70:0/956425174 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4007bb0 con 0x7feed4105d20 2024-04-26T20:27:08.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.794+0000 7feeca7fc640 1 -- 172.21.15.70:0/956425174 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feec4007d50 con 0x7feed4105d20 2024-04-26T20:27:08.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.794+0000 7feeca7fc640 1 -- 172.21.15.70:0/956425174 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec400f450 con 0x7feed4105d20 2024-04-26T20:27:08.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.794+0000 7feedb8e1640 1 -- 172.21.15.70:0/956425174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed41a0c40 con 0x7feed4105d20 2024-04-26T20:27:08.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.794+0000 7feedb8e1640 1 -- 172.21.15.70:0/956425174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed41a1190 con 0x7feed4105d20 2024-04-26T20:27:08.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.795+0000 7feedb8e1640 1 -- 172.21.15.70:0/956425174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feed40fe8f0 con 0x7feed4105d20 2024-04-26T20:27:08.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.796+0000 7feeca7fc640 1 -- 172.21.15.70:0/956425174 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7feec40046c0 con 0x7feed4105d20 2024-04-26T20:27:08.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.796+0000 7feeca7fc640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7feec00a3c40 0x7feec00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:08.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.796+0000 7feed967d640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7feec00a3c40 0x7feec00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:08.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.796+0000 7feeca7fc640 1 -- 172.21.15.70:0/956425174 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7feec40d0700 con 0x7feed4105d20 2024-04-26T20:27:08.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.797+0000 7feed967d640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7feec00a3c40 0x7feec00a6100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feecc000c00 tx=0x7feecc0095f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:08.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.801+0000 7feeca7fc640 1 -- 172.21.15.70:0/956425174 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7feec4014030 con 0x7feed4105d20 2024-04-26T20:27:08.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:08 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3296008745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:27:08.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:08 smithi098 ceph-mon[32591]: pgmap v348: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:27:08.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:08 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/830824750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:27:08.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:08 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/824005472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:27:08.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:08 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3144957482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:27:08.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:08 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3296008745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:27:08.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:08 smithi080 ceph-mon[32278]: pgmap v348: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:27:08.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:08 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/830824750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:27:08.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:08 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/824005472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:27:08.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:08 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3144957482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:27:08.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.980+0000 7feedb8e1640 1 -- 172.21.15.70:0/956425174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7feed402dd20 con 0x7feed4105d20 2024-04-26T20:27:08.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.981+0000 7feeca7fc640 1 -- 172.21.15.70:0/956425174 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7feec409cf70 con 0x7feed4105d20 2024-04-26T20:27:08.982 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-04-26T20:27:08.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 -- 172.21.15.70:0/956425174 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7feec00a3c40 msgr2=0x7feec00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7feec00a3c40 0x7feec00a6100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feecc000c00 tx=0x7feecc0095f0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 -- 172.21.15.70:0/956425174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feed4105d20 msgr2=0x7feed4199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:08.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feed4105d20 0x7feed4199280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feec400c970 tx=0x7feec400ce30 comp rx=0 tx=0).stop 2024-04-26T20:27:08.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 -- 172.21.15.70:0/956425174 shutdown_connections 2024-04-26T20:27:08.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7feec00a3c40 0x7feec00a6100 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feed4108650 0x7feed41a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feed4105d20 0x7feed4199280 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 --2- 172.21.15.70:0/956425174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feed41033f0 0x7feed4198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:08.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 -- 172.21.15.70:0/956425174 >> 172.21.15.70:0/956425174 conn(0x7feed40fce00 msgr2=0x7feed4103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:08.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 -- 172.21.15.70:0/956425174 shutdown_connections 2024-04-26T20:27:08.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:08.983+0000 7feedb8e1640 1 -- 172.21.15.70:0/956425174 wait complete. 2024-04-26T20:27:08.993 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:08 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3296008745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:27:08.993 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:08 smithi070 ceph-mon[29124]: pgmap v348: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:27:08.993 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:08 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/830824750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:27:08.993 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:08 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/824005472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:27:08.994 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:08 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3144957482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:27:08.994 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:27:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.094+0000 7f738a2d1640 1 -- 172.21.15.70:0/504765737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7384102a80 msgr2=0x7f7384102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.094+0000 7f738a2d1640 1 --2- 172.21.15.70:0/504765737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7384102a80 0x7f7384102f00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7378009900 tx=0x7f737802a410 comp rx=0 tx=0).stop 2024-04-26T20:27:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.094+0000 7f738a2d1640 1 -- 172.21.15.70:0/504765737 shutdown_connections 2024-04-26T20:27:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.094+0000 7f738a2d1640 1 --2- 172.21.15.70:0/504765737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7384103440 0x7f7384109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.094+0000 7f738a2d1640 1 --2- 172.21.15.70:0/504765737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7384102a80 0x7f7384102f00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 --2- 172.21.15.70:0/504765737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7384101890 0x7f7384101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 -- 172.21.15.70:0/504765737 >> 172.21.15.70:0/504765737 conn(0x7f73840fce00 msgr2=0x7f73840ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 -- 172.21.15.70:0/504765737 shutdown_connections 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 -- 172.21.15.70:0/504765737 wait complete. 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 Processor -- start 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 -- start start 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7384101890 0x7f7384198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7384102a80 0x7f73841991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7384103440 0x7f73841a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f738410d4f0 con 0x7f7384102a80 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f738410d370 con 0x7f7384103440 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.095+0000 7f738a2d1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f738410d670 con 0x7f7384101890 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7384102a80 0x7f73841991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7384102a80 0x7f73841991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42168/0 (socket says 172.21.15.70:42168) 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73837fe640 1 -- 172.21.15.70:0/1760723990 learned_addr learned my addr 172.21.15.70:0/1760723990 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f738886e640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7384103440 0x7f73841a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f7383fff640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7384101890 0x7f7384198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73837fe640 1 -- 172.21.15.70:0/1760723990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7384101890 msgr2=0x7f7384198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73837fe640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7384101890 0x7f7384198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73837fe640 1 -- 172.21.15.70:0/1760723990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7384103440 msgr2=0x7f73841a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73837fe640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7384103440 0x7f73841a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73837fe640 1 -- 172.21.15.70:0/1760723990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73841a08c0 con 0x7f7384102a80 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73837fe640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7384102a80 0x7f73841991c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7378005940 tx=0x7f73780043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73817fa640 1 -- 172.21.15.70:0/1760723990 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737803f030 con 0x7f7384102a80 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f738a2d1640 1 -- 172.21.15.70:0/1760723990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73841a0b50 con 0x7f7384102a80 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73817fa640 1 -- 172.21.15.70:0/1760723990 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7378003cd0 con 0x7f7384102a80 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f73817fa640 1 -- 172.21.15.70:0/1760723990 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378035070 con 0x7f7384102a80 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.096+0000 7f738a2d1640 1 -- 172.21.15.70:0/1760723990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73841a1090 con 0x7f7384102a80 2024-04-26T20:27:09.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.097+0000 7f738a2d1640 1 -- 172.21.15.70:0/1760723990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73841a1260 con 0x7f7384102a80 2024-04-26T20:27:09.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.098+0000 7f73817fa640 1 -- 172.21.15.70:0/1760723990 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7378042030 con 0x7f7384102a80 2024-04-26T20:27:09.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.099+0000 7f73817fa640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f736c0a3c40 0x7f736c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.099+0000 7f7383fff640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f736c0a3c40 0x7f736c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.099+0000 7f73817fa640 1 -- 172.21.15.70:0/1760723990 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f73780f0b90 con 0x7f7384102a80 2024-04-26T20:27:09.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.099+0000 7f7383fff640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f736c0a3c40 0x7f736c0a6100 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7374005fd0 tx=0x7f7374005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:09.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.103+0000 7f73817fa640 1 -- 172.21.15.70:0/1760723990 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f73780bd400 con 0x7f7384102a80 2024-04-26T20:27:09.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.279+0000 7f738a2d1640 1 -- 172.21.15.70:0/1760723990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f73841a1430 con 0x7f7384102a80 2024-04-26T20:27:09.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.280+0000 7f73817fa640 1 -- 172.21.15.70:0/1760723990 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f73780bcd00 con 0x7f7384102a80 2024-04-26T20:27:09.281 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-04-26T20:27:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 -- 172.21.15.70:0/1760723990 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f736c0a3c40 msgr2=0x7f736c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f736c0a3c40 0x7f736c0a6100 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7374005fd0 tx=0x7f7374005850 comp rx=0 tx=0).stop 2024-04-26T20:27:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 -- 172.21.15.70:0/1760723990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7384102a80 msgr2=0x7f73841991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7384102a80 0x7f73841991c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7378005940 tx=0x7f73780043b0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 -- 172.21.15.70:0/1760723990 shutdown_connections 2024-04-26T20:27:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f736c0a3c40 0x7f736c0a6100 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7384103440 0x7f73841a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7384102a80 0x7f73841991c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 --2- 172.21.15.70:0/1760723990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7384101890 0x7f7384198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 -- 172.21.15.70:0/1760723990 >> 172.21.15.70:0/1760723990 conn(0x7f73840fce00 msgr2=0x7f738406b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 -- 172.21.15.70:0/1760723990 shutdown_connections 2024-04-26T20:27:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.282+0000 7f738a2d1640 1 -- 172.21.15.70:0/1760723990 wait complete. 2024-04-26T20:27:09.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:27:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.390+0000 7f23480cc640 1 -- 172.21.15.70:0/4201286286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23401086f0 msgr2=0x7f234010ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.390+0000 7f23480cc640 1 --2- 172.21.15.70:0/4201286286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23401086f0 0x7f234010ab40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2338009ca0 tx=0x7f233802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.390+0000 7f23480cc640 1 -- 172.21.15.70:0/4201286286 shutdown_connections 2024-04-26T20:27:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.390+0000 7f23480cc640 1 --2- 172.21.15.70:0/4201286286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23401086f0 0x7f234010ab40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.390+0000 7f23480cc640 1 --2- 172.21.15.70:0/4201286286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2340105dc0 0x7f23401081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.390+0000 7f23480cc640 1 --2- 172.21.15.70:0/4201286286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2340103490 0x7f2340105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f23480cc640 1 -- 172.21.15.70:0/4201286286 >> 172.21.15.70:0/4201286286 conn(0x7f23400fce60 msgr2=0x7f23400ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f23480cc640 1 -- 172.21.15.70:0/4201286286 shutdown_connections 2024-04-26T20:27:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f23480cc640 1 -- 172.21.15.70:0/4201286286 wait complete. 2024-04-26T20:27:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f23480cc640 1 Processor -- start 2024-04-26T20:27:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f23480cc640 1 -- start start 2024-04-26T20:27:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f23480cc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2340103490 0x7f2340198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f23480cc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2340105dc0 0x7f2340199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f23480cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23401086f0 0x7f23401a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f23480cc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f234010e700 con 0x7f2340105dc0 2024-04-26T20:27:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f23480cc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f234010e580 con 0x7f23401086f0 2024-04-26T20:27:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f23480cc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f234010e880 con 0x7f2340103490 2024-04-26T20:27:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f2345667640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2340105dc0 0x7f2340199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f2345667640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2340105dc0 0x7f2340199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42192/0 (socket says 172.21.15.70:42192) 2024-04-26T20:27:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.391+0000 7f2345667640 1 -- 172.21.15.70:0/2371505293 learned_addr learned my addr 172.21.15.70:0/2371505293 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2345e68640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2340103490 0x7f2340198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2346669640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23401086f0 0x7f23401a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2345667640 1 -- 172.21.15.70:0/2371505293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2340103490 msgr2=0x7f2340198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2345667640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2340103490 0x7f2340198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2345667640 1 -- 172.21.15.70:0/2371505293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23401086f0 msgr2=0x7f23401a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2345667640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23401086f0 0x7f23401a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2345667640 1 -- 172.21.15.70:0/2371505293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23401a09d0 con 0x7f2340105dc0 2024-04-26T20:27:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2345e68640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2340103490 0x7f2340198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2345667640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2340105dc0 0x7f2340199300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f233000b450 tx=0x7f233000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2336ffd640 1 -- 172.21.15.70:0/2371505293 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330015020 con 0x7f2340105dc0 2024-04-26T20:27:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f23480cc640 1 -- 172.21.15.70:0/2371505293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23401a0cc0 con 0x7f2340105dc0 2024-04-26T20:27:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2336ffd640 1 -- 172.21.15.70:0/2371505293 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2330011d60 con 0x7f2340105dc0 2024-04-26T20:27:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f2336ffd640 1 -- 172.21.15.70:0/2371505293 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233000f340 con 0x7f2340105dc0 2024-04-26T20:27:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.392+0000 7f23480cc640 1 -- 172.21.15.70:0/2371505293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23401a1230 con 0x7f2340105dc0 2024-04-26T20:27:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.393+0000 7f23480cc640 1 -- 172.21.15.70:0/2371505293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23400fe950 con 0x7f2340105dc0 2024-04-26T20:27:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.394+0000 7f2336ffd640 1 -- 172.21.15.70:0/2371505293 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2330018020 con 0x7f2340105dc0 2024-04-26T20:27:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.395+0000 7f2336ffd640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f232c0a3c40 0x7f232c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.395+0000 7f2345e68640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f232c0a3c40 0x7f232c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.395+0000 7f2336ffd640 1 -- 172.21.15.70:0/2371505293 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f23300d0040 con 0x7f2340105dc0 2024-04-26T20:27:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.395+0000 7f2345e68640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f232c0a3c40 0x7f232c0a6100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f234019a290 tx=0x7f233c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:09.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.400+0000 7f2336ffd640 1 -- 172.21.15.70:0/2371505293 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f233001f020 con 0x7f2340105dc0 2024-04-26T20:27:09.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.616+0000 7f23480cc640 1 -- 172.21.15.70:0/2371505293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f234002dca0 con 0x7f2340105dc0 2024-04-26T20:27:09.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.617+0000 7f2336ffd640 1 -- 172.21.15.70:0/2371505293 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7f233000d040 con 0x7f2340105dc0 2024-04-26T20:27:09.618 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:27:09.618 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:25:15.345214+0000","modified":"2024-04-26T20:25:22.041593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24488,"mds_1":24481,"mds_2":24463,"mds_3":24461,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3333683222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3333683222},{"type":"v1","addr":"172.21.15.70:6841","nonce":3333683222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":3,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":1,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6839/4099319394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4099319394},{"type":"v1","addr":"172.21.15.80:6839","nonce":4099319394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24481,24488,24463,24461,24451]},"id":1}]} 2024-04-26T20:27:09.618 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2024-04-26T20:27:09.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 -- 172.21.15.70:0/2371505293 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f232c0a3c40 msgr2=0x7f232c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f232c0a3c40 0x7f232c0a6100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f234019a290 tx=0x7f233c008040 comp rx=0 tx=0).stop 2024-04-26T20:27:09.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 -- 172.21.15.70:0/2371505293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2340105dc0 msgr2=0x7f2340199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2340105dc0 0x7f2340199300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f233000b450 tx=0x7f233000b910 comp rx=0 tx=0).stop 2024-04-26T20:27:09.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 -- 172.21.15.70:0/2371505293 shutdown_connections 2024-04-26T20:27:09.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f232c0a3c40 0x7f232c0a6100 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23401086f0 0x7f23401a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2340105dc0 0x7f2340199300 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 --2- 172.21.15.70:0/2371505293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2340103490 0x7f2340198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 -- 172.21.15.70:0/2371505293 >> 172.21.15.70:0/2371505293 conn(0x7f23400fce60 msgr2=0x7f2340103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:09.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 -- 172.21.15.70:0/2371505293 shutdown_connections 2024-04-26T20:27:09.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.619+0000 7f23480cc640 1 -- 172.21.15.70:0/2371505293 wait complete. 2024-04-26T20:27:09.631 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:27:09.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.729+0000 7f59df847640 1 -- 172.21.15.70:0/89557890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d81018f0 msgr2=0x7f59d8101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.729+0000 7f59df847640 1 --2- 172.21.15.70:0/89557890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d81018f0 0x7f59d8101d10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009900 tx=0x7f59d402a410 comp rx=0 tx=0).stop 2024-04-26T20:27:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.729+0000 7f59df847640 1 -- 172.21.15.70:0/89557890 shutdown_connections 2024-04-26T20:27:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.729+0000 7f59df847640 1 --2- 172.21.15.70:0/89557890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59d81034a0 0x7f59d8109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.729+0000 7f59df847640 1 --2- 172.21.15.70:0/89557890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59d8102ae0 0x7f59d8102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.729+0000 7f59df847640 1 --2- 172.21.15.70:0/89557890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d81018f0 0x7f59d8101d10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.729+0000 7f59df847640 1 -- 172.21.15.70:0/89557890 >> 172.21.15.70:0/89557890 conn(0x7f59d80fcea0 msgr2=0x7f59d80ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.729+0000 7f59df847640 1 -- 172.21.15.70:0/89557890 shutdown_connections 2024-04-26T20:27:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.729+0000 7f59df847640 1 -- 172.21.15.70:0/89557890 wait complete. 2024-04-26T20:27:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59df847640 1 Processor -- start 2024-04-26T20:27:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59df847640 1 -- start start 2024-04-26T20:27:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59df847640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59d81018f0 0x7f59d806bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59df847640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8102ae0 0x7f59d819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59df847640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59d81034a0 0x7f59d81a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59df847640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59d810d540 con 0x7f59d8102ae0 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59df847640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f59d810d3c0 con 0x7f59d81018f0 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59df847640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f59d810d6c0 con 0x7f59d81034a0 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59dcde2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8102ae0 0x7f59d819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59dcde2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8102ae0 0x7f59d819da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35772/0 (socket says 172.21.15.70:35772) 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59dcde2640 1 -- 172.21.15.70:0/3389219821 learned_addr learned my addr 172.21.15.70:0/3389219821 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59ddde4640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59d81034a0 0x7f59d81a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59dd5e3640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59d81018f0 0x7f59d806bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59dcde2640 1 -- 172.21.15.70:0/3389219821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59d81034a0 msgr2=0x7f59d81a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59dcde2640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59d81034a0 0x7f59d81a0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59dcde2640 1 -- 172.21.15.70:0/3389219821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59d81018f0 msgr2=0x7f59d806bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59dcde2640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59d81018f0 0x7f59d806bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59dcde2640 1 -- 172.21.15.70:0/3389219821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d81a0950 con 0x7f59d8102ae0 2024-04-26T20:27:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59ddde4640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59d81034a0 0x7f59d81a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.730+0000 7f59dcde2640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8102ae0 0x7f59d819da20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f59c800c890 tx=0x7f59c800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.731+0000 7f59ce7fc640 1 -- 172.21.15.70:0/3389219821 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8004220 con 0x7f59d8102ae0 2024-04-26T20:27:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.731+0000 7f59ce7fc640 1 -- 172.21.15.70:0/3389219821 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f59c80043c0 con 0x7f59d8102ae0 2024-04-26T20:27:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.731+0000 7f59df847640 1 -- 172.21.15.70:0/3389219821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d81a0be0 con 0x7f59d8102ae0 2024-04-26T20:27:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.731+0000 7f59ce7fc640 1 -- 172.21.15.70:0/3389219821 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c80049c0 con 0x7f59d8102ae0 2024-04-26T20:27:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.731+0000 7f59df847640 1 -- 172.21.15.70:0/3389219821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d81a1180 con 0x7f59d8102ae0 2024-04-26T20:27:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.732+0000 7f59df847640 1 -- 172.21.15.70:0/3389219821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d8108cb0 con 0x7f59d8102ae0 2024-04-26T20:27:09.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.733+0000 7f59ce7fc640 1 -- 172.21.15.70:0/3389219821 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f59c8005140 con 0x7f59d8102ae0 2024-04-26T20:27:09.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.733+0000 7f59ce7fc640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f59c40a3cc0 0x7f59c40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:09.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.733+0000 7f59dd5e3640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f59c40a3cc0 0x7f59c40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:09.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.733+0000 7f59ce7fc640 1 -- 172.21.15.70:0/3389219821 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f59c80d0280 con 0x7f59d8102ae0 2024-04-26T20:27:09.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.734+0000 7f59dd5e3640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f59c40a3cc0 0x7f59c40a6180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59d4031570 tx=0x7f59d4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:09.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.738+0000 7f59ce7fc640 1 -- 172.21.15.70:0/3389219821 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f59c8014030 con 0x7f59d8102ae0 2024-04-26T20:27:09.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.917+0000 7f59df847640 1 -- 172.21.15.70:0/3389219821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59d802dca0 con 0x7f59d8102ae0 2024-04-26T20:27:09.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.919+0000 7f59ce7fc640 1 -- 172.21.15.70:0/3389219821 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22646 (secure 0 0 0) 0x7f59c809caf0 con 0x7f59d8102ae0 2024-04-26T20:27:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:27:09.920 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:26:08.787018+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":6}]},{"pgid":"2.16","mappings":[{"from":2,"to":4},{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:27:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 -- 172.21.15.70:0/3389219821 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f59c40a3cc0 msgr2=0x7f59c40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f59c40a3cc0 0x7f59c40a6180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59d4031570 tx=0x7f59d4000bc0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 -- 172.21.15.70:0/3389219821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8102ae0 msgr2=0x7f59d819da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8102ae0 0x7f59d819da20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f59c800c890 tx=0x7f59c800cd50 comp rx=0 tx=0).stop 2024-04-26T20:27:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 -- 172.21.15.70:0/3389219821 shutdown_connections 2024-04-26T20:27:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f59c40a3cc0 0x7f59c40a6180 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59d81034a0 0x7f59d81a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8102ae0 0x7f59d819da20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 --2- 172.21.15.70:0/3389219821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59d81018f0 0x7f59d806bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 -- 172.21.15.70:0/3389219821 >> 172.21.15.70:0/3389219821 conn(0x7f59d80fcea0 msgr2=0x7f59d8105e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 -- 172.21.15.70:0/3389219821 shutdown_connections 2024-04-26T20:27:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:09.921+0000 7f59df847640 1 -- 172.21.15.70:0/3389219821 wait complete. 2024-04-26T20:27:09.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:09 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/956425174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:27:09.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:09 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1760723990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:27:09.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:09 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2371505293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:27:09.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T20:25:15.345214+0000', 'modified': '2024-04-26T20:25:22.041593+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24488, 'mds_1': 24481, 'mds_2': 24463, 'mds_3': 24461, 'mds_4': 24451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14595': {'gid': 14595, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6839/2998426471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 2998426471}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 2998426471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14607': {'gid': 14607, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6841/3333683222', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6840', 'nonce': 3333683222}, {'type': 'v1', 'addr': '172.21.15.70:6841', 'nonce': 3333683222}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.80:6833/20228697', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6832', 'nonce': 20228697}, {'type': 'v1', 'addr': '172.21.15.80:6833', 'nonce': 20228697}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24409': {'gid': 24409, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6833/699509756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6832', 'nonce': 699509756}, {'type': 'v1', 'addr': '172.21.15.98:6833', 'nonce': 699509756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.80:6835/857349607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6834', 'nonce': 857349607}, {'type': 'v1', 'addr': '172.21.15.80:6835', 'nonce': 857349607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 4, 'incarnation': 22, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.98:6835/2812509799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 2812509799}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 2812509799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 3, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.80:6837/3487724503', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6836', 'nonce': 3487724503}, {'type': 'v1', 'addr': '172.21.15.80:6837', 'nonce': 3487724503}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 2, 'incarnation': 18, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.98:6837/3751464822', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 3751464822}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 3751464822}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'i', 'rank': 1, 'incarnation': 16, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.98:6839/4073846722', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 4073846722}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 4073846722}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.80:6839/4099319394', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6838', 'nonce': 4099319394}, {'type': 'v1', 'addr': '172.21.15.80:6839', 'nonce': 4099319394}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24488, 'qdb_cluster': [24481, 24488, 24463, 24461, 24451]} 2024-04-26T20:27:09.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-26T20:27:09.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-26T20:27:09.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:09 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/956425174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:27:09.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:09 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1760723990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:27:09.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:09 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2371505293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:27:09.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:09 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/956425174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:27:09.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:09 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1760723990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:27:09.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:09 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2371505293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:27:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.031+0000 7f9f65c1d640 1 -- 172.21.15.70:0/1092389834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f60102bc0 msgr2=0x7f9f60109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.031+0000 7f9f65c1d640 1 --2- 172.21.15.70:0/1092389834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f60102bc0 0x7f9f60109450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009ca0 tx=0x7f9f5802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.031+0000 7f9f65c1d640 1 -- 172.21.15.70:0/1092389834 shutdown_connections 2024-04-26T20:27:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.031+0000 7f9f65c1d640 1 --2- 172.21.15.70:0/1092389834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f60102bc0 0x7f9f60109450 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.031+0000 7f9f65c1d640 1 --2- 172.21.15.70:0/1092389834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f60102200 0x7f9f60102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.031+0000 7f9f65c1d640 1 --2- 172.21.15.70:0/1092389834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f60101010 0x7f9f60101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.031+0000 7f9f65c1d640 1 -- 172.21.15.70:0/1092389834 >> 172.21.15.70:0/1092389834 conn(0x7f9f600fc580 msgr2=0x7f9f600fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.031+0000 7f9f65c1d640 1 -- 172.21.15.70:0/1092389834 shutdown_connections 2024-04-26T20:27:10.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.031+0000 7f9f65c1d640 1 -- 172.21.15.70:0/1092389834 wait complete. 2024-04-26T20:27:10.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.032+0000 7f9f65c1d640 1 Processor -- start 2024-04-26T20:27:10.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.032+0000 7f9f65c1d640 1 -- start start 2024-04-26T20:27:10.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.032+0000 7f9f65c1d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f60101010 0x7f9f60197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.032+0000 7f9f65c1d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f60102200 0x7f9f60198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.032+0000 7f9f65c1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f60102bc0 0x7f9f6019f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.032+0000 7f9f65c1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6010ccd0 con 0x7f9f60102bc0 2024-04-26T20:27:10.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.032+0000 7f9f65c1d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6010cb50 con 0x7f9f60102200 2024-04-26T20:27:10.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.032+0000 7f9f65c1d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6010ce50 con 0x7f9f60101010 2024-04-26T20:27:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.032+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f60102bc0 0x7f9f6019f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.032+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f60102bc0 0x7f9f6019f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35788/0 (socket says 172.21.15.70:35788) 2024-04-26T20:27:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.032+0000 7f9f5ffff640 1 -- 172.21.15.70:0/4232557597 learned_addr learned my addr 172.21.15.70:0/4232557597 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f5ffff640 1 -- 172.21.15.70:0/4232557597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f60101010 msgr2=0x7f9f60197bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f5ffff640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f60101010 0x7f9f60197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f5ffff640 1 -- 172.21.15.70:0/4232557597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f60102200 msgr2=0x7f9f60198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f5effd640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f60102200 0x7f9f60198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f5ffff640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f60102200 0x7f9f60198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f5ffff640 1 -- 172.21.15.70:0/4232557597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6019f7f0 con 0x7f9f60102bc0 2024-04-26T20:27:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f5effd640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f60102200 0x7f9f60198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f5ffff640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f60102bc0 0x7f9f6019f180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009dc0 tx=0x7f9f58003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f5cff9640 1 -- 172.21.15.70:0/4232557597 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58004240 con 0x7f9f60102bc0 2024-04-26T20:27:10.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f65c1d640 1 -- 172.21.15.70:0/4232557597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f6019fa80 con 0x7f9f60102bc0 2024-04-26T20:27:10.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f5cff9640 1 -- 172.21.15.70:0/4232557597 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f58031830 con 0x7f9f60102bc0 2024-04-26T20:27:10.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f65c1d640 1 -- 172.21.15.70:0/4232557597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f601a0020 con 0x7f9f60102bc0 2024-04-26T20:27:10.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.033+0000 7f9f5cff9640 1 -- 172.21.15.70:0/4232557597 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f580305c0 con 0x7f9f60102bc0 2024-04-26T20:27:10.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5cff9640 1 -- 172.21.15.70:0/4232557597 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9f5802f660 con 0x7f9f60102bc0 2024-04-26T20:27:10.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f68a0e740 1 Processor -- start 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f68a0e740 1 -- start start 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e2d10 0x5569dd4e1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 0x5569dd4e1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569dd446740 con 0x5569dd4eb9b0 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5569dd3e23a0 con 0x5569dd4e19a0 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5569dd442700 con 0x5569dd4e2d10 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35792/0 (socket says 172.21.15.70:35792) 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5effd640 1 -- 172.21.15.70:0/2511929255 learned_addr learned my addr 172.21.15.70:0/2511929255 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5effd640 1 --2- 172.21.15.70:0/2511929255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e2d10 0x5569dd4e1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5f7fe640 1 --2- 172.21.15.70:0/2511929255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 0x5569dd4e1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5cff9640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9f480a3c40 0x7f9f480a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5effd640 1 -- 172.21.15.70:0/2511929255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e2d10 msgr2=0x5569dd4e1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5effd640 1 --2- 172.21.15.70:0/2511929255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e2d10 0x5569dd4e1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5effd640 1 -- 172.21.15.70:0/2511929255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 msgr2=0x5569dd4e1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5effd640 1 --2- 172.21.15.70:0/2511929255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 0x5569dd4e1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5effd640 1 -- 172.21.15.70:0/2511929255 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569dd3fe750 con 0x5569dd4eb9b0 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.036+0000 7f9f5ffff640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9f480a3c40 0x7f9f480a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f5effd640 1 --2- 172.21.15.70:0/2511929255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4edda0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400cfd0 tx=0x7f9f5400c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1665f160a4584f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f5cff9640 1 -- 172.21.15.70:0/4232557597 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f9f580f1e30 con 0x7f9f60102bc0 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f45ffb640 1 -- 172.21.15.70:0/2511929255 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5401c070 con 0x5569dd4eb9b0 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f45ffb640 1 -- 172.21.15.70:0/2511929255 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f54017ae0 con 0x5569dd4eb9b0 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f45ffb640 1 -- 172.21.15.70:0/2511929255 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5400f040 con 0x5569dd4eb9b0 2024-04-26T20:27:10.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f68a0e740 1 -- 172.21.15.70:0/2511929255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 msgr2=0x5569dd4edda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f5ffff640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9f480a3c40 0x7f9f480a6100 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9f580be040 tx=0x7f9f5808fb40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/2511929255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4edda0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400cfd0 tx=0x7f9f5400c230 comp rx=0 tx=0).stop 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f68a0e740 1 -- 172.21.15.70:0/2511929255 shutdown_connections 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/2511929255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4edda0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/2511929255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 0x5569dd4e1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/2511929255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e2d10 0x5569dd4e1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.037+0000 7f9f68a0e740 1 -- 172.21.15.70:0/2511929255 >> 172.21.15.70:0/2511929255 conn(0x5569dd4dcd00 msgr2=0x5569dd4dd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f68a0e740 1 -- 172.21.15.70:0/2511929255 shutdown_connections 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f68a0e740 1 -- 172.21.15.70:0/2511929255 wait complete. 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f68a0e740 1 -- start start 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f68a0e740 1 Processor -- start 2024-04-26T20:27:10.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 0x5569dd4eff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e2d10 0x5569dd4f0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569dd4ee5e0 con 0x5569dd4eb9b0 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5569dd3cdfe0 con 0x5569dd4e19a0 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5569dd4ee760 con 0x5569dd4e2d10 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f68a0e740 10 client.0 _ll_register_callbacks cb 0x5569dd3e4150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f5effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f5effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4f74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35796/0 (socket says 172.21.15.70:35796) 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f5effd640 1 -- 172.21.15.70:0/1072349316 learned_addr learned my addr 172.21.15.70:0/1072349316 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.038+0000 7f9f5effd640 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 0x5569dd4eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f5effd640 1 -- 172.21.15.70:0/1072349316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e2d10 msgr2=0x5569dd4f0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f5effd640 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e2d10 0x5569dd4f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f5effd640 1 -- 172.21.15.70:0/1072349316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 msgr2=0x5569dd4eff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f5effd640 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 0x5569dd4eff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f5effd640 1 -- 172.21.15.70:0/1072349316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569dd1582d0 con 0x5569dd4eb9b0 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f5effd640 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4f74c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9f54017410 tx=0x7f9f54015f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23129a0ea86d3a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f3effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f3effd640 1 -- 172.21.15.70:0/1072349316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5401c040 con 0x5569dd4eb9b0 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f3effd640 1 -- 172.21.15.70:0/1072349316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f9f540176f0 con 0x5569dd4eb9b0 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1072349316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f54017ae0 con 0x5569dd4eb9b0 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f3effd640 1 -- 172.21.15.70:0/1072349316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9f540178f0 con 0x5569dd4eb9b0 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f68a0e740 10 client.15231 fetch_fsmap learned FSMap version 24 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1072349316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5569dd2226b0 con 0x5569dd4eb9b0 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f3effd640 1 -- 172.21.15.70:0/1072349316 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f54017ae0 con 0x5569dd4eb9b0 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f3effd640 1 -- 172.21.15.70:0/1072349316 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f9f54015040 con 0x5569dd4eb9b0 2024-04-26T20:27:10.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f68a0e740 10 client.15231 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f68a0e740 10 client.15231 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f68a0e740 20 client.15231 populate_metadata read hostname 'smithi070' 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x5569dd4fc520 0x5569dd4fd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f68a0e740 4 client.15231 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.039+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1072349316 --> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569dd454350 con 0x5569dd4fc520 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.040+0000 7f9f5f7fe640 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x5569dd4fc520 0x5569dd4fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.040+0000 7f9f3effd640 10 client.15231 ms_handle_connect on v2:172.21.15.98:6834/2812509799 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.040+0000 7f9f5f7fe640 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x5569dd4fc520 0x5569dd4fd990 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2d3b56fa70aa059b server_cookie=f3ab2e03080aa1f2 in_seq=0 out_seq=0 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f3effd640 1 -- 172.21.15.70:0/1072349316 <== mds.4 v2:172.21.15.98:6834/2812509799 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5569dd454350 con 0x5569dd4fc520 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f3effd640 10 client.15231 handle_command_reply: tid=0 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 1 client.15231 shutdown 2024-04-26T20:27:10.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1072349316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 msgr2=0x5569dd4f74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4f74c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9f54017410 tx=0x7f9f54015f60 comp rx=0 tx=0).stop 2024-04-26T20:27:10.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1072349316 shutdown_connections 2024-04-26T20:27:10.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x5569dd4fc520 0x5569dd4fd990 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4eb9b0 0x5569dd4f74c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e2d10 0x5569dd4f0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1072349316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 0x5569dd4eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f3effd640 0 client.15231 ms_handle_reset on v2:172.21.15.98:6834/2812509799 2024-04-26T20:27:10.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1072349316 >> 172.21.15.70:0/1072349316 conn(0x5569dd4dcd00 msgr2=0x5569dd4dbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1072349316 shutdown_connections 2024-04-26T20:27:10.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1072349316 wait complete. 2024-04-26T20:27:10.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.041+0000 7f9f68a0e740 20 client.15231 trim_cache size 0 max 16384 2024-04-26T20:27:10.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.059+0000 7f9f68a0e740 1 Processor -- start 2024-04-26T20:27:10.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.059+0000 7f9f68a0e740 1 -- start start 2024-04-26T20:27:10.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.059+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 0x5569dd4fb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.059+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.059+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4eb9b0 0x5569dd4edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.059+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569dd4fbcd0 con 0x5569dd4e2d10 2024-04-26T20:27:10.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.059+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5569dd4fc3a0 con 0x5569dd4e19a0 2024-04-26T20:27:10.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.059+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5569dd4fca70 con 0x5569dd4eb9b0 2024-04-26T20:27:10.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.059+0000 7f9f5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.059+0000 7f9f5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35802/0 (socket says 172.21.15.70:35802) 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.059+0000 7f9f5f7fe640 1 -- 172.21.15.70:0/1286201641 learned_addr learned my addr 172.21.15.70:0/1286201641 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f5effd640 1 --2- 172.21.15.70:0/1286201641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4eb9b0 0x5569dd4edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f5f7fe640 1 -- 172.21.15.70:0/1286201641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4eb9b0 msgr2=0x5569dd4edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f5f7fe640 1 --2- 172.21.15.70:0/1286201641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4eb9b0 0x5569dd4edda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f5f7fe640 1 -- 172.21.15.70:0/1286201641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 msgr2=0x5569dd4fb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f5f7fe640 1 --2- 172.21.15.70:0/1286201641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 0x5569dd4fb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f5f7fe640 1 -- 172.21.15.70:0/1286201641 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569dd4eb7e0 con 0x5569dd4e2d10 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f5effd640 1 --2- 172.21.15.70:0/1286201641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4eb9b0 0x5569dd4edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f5f7fe640 1 --2- 172.21.15.70:0/1286201641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f7480 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x5569dd4f1420 tx=0x7f9f50010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19d7324c972af9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f457fa640 1 -- 172.21.15.70:0/1286201641 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5000ad00 con 0x5569dd4e2d10 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f457fa640 1 -- 172.21.15.70:0/1286201641 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f500198c0 con 0x5569dd4e2d10 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f457fa640 1 -- 172.21.15.70:0/1286201641 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f50004a00 con 0x5569dd4e2d10 2024-04-26T20:27:10.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1286201641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 msgr2=0x5569dd4f7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1286201641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f7480 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x5569dd4f1420 tx=0x7f9f50010800 comp rx=0 tx=0).stop 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1286201641 shutdown_connections 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1286201641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4eb9b0 0x5569dd4edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1286201641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f7480 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.060+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1286201641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4e19a0 0x5569dd4fb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1286201641 >> 172.21.15.70:0/1286201641 conn(0x5569dd4dcd00 msgr2=0x5569dd4e1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1286201641 shutdown_connections 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1286201641 wait complete. 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 1 -- start start 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 1 Processor -- start 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e19a0 0x5569dd4f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4eb9b0 0x5569dd4f6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569dd4fd810 con 0x5569dd4e2d10 2024-04-26T20:27:10.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5569dd4fd140 con 0x5569dd4eb9b0 2024-04-26T20:27:10.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5569dd4fdee0 con 0x5569dd4e19a0 2024-04-26T20:27:10.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f68a0e740 10 client.0 _ll_register_callbacks cb 0x7f9f5401a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:10.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35816/0 (socket says 172.21.15.70:35816) 2024-04-26T20:27:10.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f5f7fe640 1 -- 172.21.15.70:0/1813281112 learned_addr learned my addr 172.21.15.70:0/1813281112 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f5effd640 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e19a0 0x5569dd4f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f5f7fe640 1 -- 172.21.15.70:0/1813281112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e19a0 msgr2=0x5569dd4f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f5f7fe640 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e19a0 0x5569dd4f2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f5f7fe640 1 -- 172.21.15.70:0/1813281112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4eb9b0 msgr2=0x5569dd4f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f5f7fe640 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4eb9b0 0x5569dd4f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.061+0000 7f9f5f7fe640 1 -- 172.21.15.70:0/1813281112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569dd4f6860 con 0x5569dd4e2d10 2024-04-26T20:27:10.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f5effd640 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e19a0 0x5569dd4f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:10.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f5f7fe640 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f3250 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9f50019ab0 tx=0x7f9f5000a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13764303247a3d7b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f3effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f3effd640 1 -- 172.21.15.70:0/1813281112 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f50004020 con 0x5569dd4e2d10 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f3effd640 1 -- 172.21.15.70:0/1813281112 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f9f500041c0 con 0x5569dd4e2d10 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1813281112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f500198c0 con 0x5569dd4e2d10 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f3effd640 1 -- 172.21.15.70:0/1813281112 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9f50031050 con 0x5569dd4e2d10 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f68a0e740 10 client.15237 fetch_fsmap learned FSMap version 24 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1813281112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5569dd562610 con 0x5569dd4e2d10 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f3effd640 1 -- 172.21.15.70:0/1813281112 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f500198c0 con 0x5569dd4e2d10 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f3effd640 1 -- 172.21.15.70:0/1813281112 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f9f500224a0 con 0x5569dd4e2d10 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f68a0e740 10 client.15237 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f68a0e740 10 client.15237 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f68a0e740 20 client.15237 populate_metadata read hostname 'smithi070' 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x5569dd566ef0 0x5569dd565c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f68a0e740 4 client.15237 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:27:10.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.062+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1813281112 --> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] -- command(tid 0: {"prefix": "status"}) -- 0x5569dd44e1c0 con 0x5569dd566ef0 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.063+0000 7f9f5effd640 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x5569dd566ef0 0x5569dd565c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.063+0000 7f9f3effd640 10 client.15237 ms_handle_connect on v2:172.21.15.98:6834/2812509799 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.063+0000 7f9f5effd640 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x5569dd566ef0 0x5569dd565c00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=58245311110316ec server_cookie=5f394580552040eb in_seq=0 out_seq=0 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.063+0000 7f9f3effd640 1 -- 172.21.15.70:0/1813281112 <== mds.4 v2:172.21.15.98:6834/2812509799 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5569dd44e1c0 con 0x5569dd566ef0 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.063+0000 7f9f3effd640 10 client.15237 handle_command_reply: tid=0 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.063+0000 7f9f68a0e740 1 client.15237 shutdown 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.063+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1813281112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 msgr2=0x5569dd4f3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.063+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f3250 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9f50019ab0 tx=0x7f9f5000a860 comp rx=0 tx=0).stop 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.063+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1813281112 shutdown_connections 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.063+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.98:6834/2812509799,v1:172.21.15.98:6835/2812509799] conn(0x5569dd566ef0 0x5569dd565c00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.063+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5569dd4eb9b0 0x5569dd4f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569dd4e2d10 0x5569dd4f3250 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f3effd640 0 client.15237 ms_handle_reset on v2:172.21.15.98:6834/2812509799 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f68a0e740 1 --2- 172.21.15.70:0/1813281112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569dd4e19a0 0x5569dd4f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1813281112 >> 172.21.15.70:0/1813281112 conn(0x5569dd4dcd00 msgr2=0x5569dd4dd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1813281112 shutdown_connections 2024-04-26T20:27:10.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f68a0e740 1 -- 172.21.15.70:0/1813281112 wait complete. 2024-04-26T20:27:10.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f68a0e740 20 client.15237 trim_cache size 0 max 16384 2024-04-26T20:27:10.074 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:27:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:27:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 4, 2024-04-26T20:27:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24451, 2024-04-26T20:27:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-04-26T20:27:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-04-26T20:27:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-04-26T20:27:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 109.038944606, 2024-04-26T20:27:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 24, 2024-04-26T20:27:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2024-04-26T20:27:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2024-04-26T20:27:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 137.62263344499999 2024-04-26T20:27:10.075 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:27:10.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 -- 172.21.15.70:0/4232557597 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9f480a3c40 msgr2=0x7f9f480a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9f480a3c40 0x7f9f480a6100 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9f580be040 tx=0x7f9f5808fb40 comp rx=0 tx=0).stop 2024-04-26T20:27:10.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 -- 172.21.15.70:0/4232557597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f60102bc0 msgr2=0x7f9f6019f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f60102bc0 0x7f9f6019f180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009dc0 tx=0x7f9f58003c20 comp rx=0 tx=0).stop 2024-04-26T20:27:10.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 -- 172.21.15.70:0/4232557597 shutdown_connections 2024-04-26T20:27:10.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f9f480a3c40 0x7f9f480a6100 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f60102bc0 0x7f9f6019f180 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f60102200 0x7f9f60198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 --2- 172.21.15.70:0/4232557597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f60101010 0x7f9f60197bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 -- 172.21.15.70:0/4232557597 >> 172.21.15.70:0/4232557597 conn(0x7f9f600fc580 msgr2=0x7f9f601058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 -- 172.21.15.70:0/4232557597 shutdown_connections 2024-04-26T20:27:10.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.064+0000 7f9f65c1d640 1 -- 172.21.15.70:0/4232557597 wait complete. 2024-04-26T20:27:10.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-26T20:27:10.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.175+0000 7fcfd359e640 1 -- 172.21.15.70:0/2060202125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfd4102890 msgr2=0x7fcfd4102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.175+0000 7fcfd359e640 1 --2- 172.21.15.70:0/2060202125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfd4102890 0x7fcfd4102d10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc009900 tx=0x7fcfbc02a410 comp rx=0 tx=0).stop 2024-04-26T20:27:10.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 -- 172.21.15.70:0/2060202125 shutdown_connections 2024-04-26T20:27:10.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 --2- 172.21.15.70:0/2060202125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfd4103250 0x7fcfd4109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 --2- 172.21.15.70:0/2060202125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfd4102890 0x7fcfd4102d10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 --2- 172.21.15.70:0/2060202125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd41016a0 0x7fcfd4101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 -- 172.21.15.70:0/2060202125 >> 172.21.15.70:0/2060202125 conn(0x7fcfd40fcc10 msgr2=0x7fcfd40ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 -- 172.21.15.70:0/2060202125 shutdown_connections 2024-04-26T20:27:10.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 -- 172.21.15.70:0/2060202125 wait complete. 2024-04-26T20:27:10.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 Processor -- start 2024-04-26T20:27:10.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 -- start start 2024-04-26T20:27:10.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfd41016a0 0x7fcfd4198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4102890 0x7fcfd4198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfd4103250 0x7fcfd41a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd410e410 con 0x7fcfd4103250 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd410e290 con 0x7fcfd41016a0 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.176+0000 7fcfd359e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd410e590 con 0x7fcfd4102890 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfd4103250 0x7fcfd41a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfd4103250 0x7fcfd41a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35834/0 (socket says 172.21.15.70:35834) 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd2d9d640 1 -- 172.21.15.70:0/2391088378 learned_addr learned my addr 172.21.15.70:0/2391088378 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4102890 0x7fcfd4198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd259c640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfd41016a0 0x7fcfd4198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd2d9d640 1 -- 172.21.15.70:0/2391088378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4102890 msgr2=0x7fcfd4198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd2d9d640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4102890 0x7fcfd4198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd2d9d640 1 -- 172.21.15.70:0/2391088378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfd41016a0 msgr2=0x7fcfd4198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd2d9d640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfd41016a0 0x7fcfd4198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd2d9d640 1 -- 172.21.15.70:0/2391088378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd41a0690 con 0x7fcfd4103250 2024-04-26T20:27:10.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4102890 0x7fcfd4198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:10.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd2d9d640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfd4103250 0x7fcfd41a0020 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00eaa0 tx=0x7fcfcc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfcb7fe640 1 -- 172.21.15.70:0/2391088378 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc00cdb0 con 0x7fcfd4103250 2024-04-26T20:27:10.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd359e640 1 -- 172.21.15.70:0/2391088378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd41a0980 con 0x7fcfd4103250 2024-04-26T20:27:10.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfcb7fe640 1 -- 172.21.15.70:0/2391088378 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfcc005020 con 0x7fcfd4103250 2024-04-26T20:27:10.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfd359e640 1 -- 172.21.15.70:0/2391088378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd41a0ed0 con 0x7fcfd4103250 2024-04-26T20:27:10.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.177+0000 7fcfcb7fe640 1 -- 172.21.15.70:0/2391088378 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0116d0 con 0x7fcfd4103250 2024-04-26T20:27:10.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfcb7fe640 1 -- 172.21.15.70:0/2391088378 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fcfcc0051d0 con 0x7fcfd4103250 2024-04-26T20:27:10.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfdb9f0740 1 Processor -- start 2024-04-26T20:27:10.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfdb9f0740 1 -- start start 2024-04-26T20:27:10.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba38a0 0x555f2fba3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fba8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba9400 0x555f2fbab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555f2fb08740 con 0x555f2fba4290 2024-04-26T20:27:10.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555f2faa43a0 con 0x555f2fba38a0 2024-04-26T20:27:10.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f2fb04700 con 0x555f2fba9400 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfd259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fba8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfd259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fba8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35844/0 (socket says 172.21.15.70:35844) 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.180+0000 7fcfd259c640 1 -- 172.21.15.70:0/572952982 learned_addr learned my addr 172.21.15.70:0/572952982 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfcb7fe640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcfc00a3cc0 0x7fcfc00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/572952982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba38a0 0x555f2fba3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/572952982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba9400 0x555f2fbab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfd259c640 1 -- 172.21.15.70:0/572952982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba9400 msgr2=0x555f2fbab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfd259c640 1 --2- 172.21.15.70:0/572952982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba9400 0x555f2fbab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfd259c640 1 -- 172.21.15.70:0/572952982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba38a0 msgr2=0x555f2fba3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfd259c640 1 --2- 172.21.15.70:0/572952982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba38a0 0x555f2fba3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfd259c640 1 -- 172.21.15.70:0/572952982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f2fac0750 con 0x555f2fba4290 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/572952982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba9400 0x555f2fbab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:10.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfd2d9d640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcfc00a3cc0 0x7fcfc00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfd259c640 1 --2- 172.21.15.70:0/572952982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fba8d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400bd10 tx=0x7fcfc400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd730a276176998f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfcb7fe640 1 -- 172.21.15.70:0/2391088378 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fcfcc0d07c0 con 0x7fcfd4103250 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfc8ff9640 1 -- 172.21.15.70:0/572952982 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4015070 con 0x555f2fba4290 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfc8ff9640 1 -- 172.21.15.70:0/572952982 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfc401a930 con 0x555f2fba4290 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.181+0000 7fcfc8ff9640 1 -- 172.21.15.70:0/572952982 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4011980 con 0x555f2fba4290 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/572952982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 msgr2=0x555f2fba8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfd2d9d640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcfc00a3cc0 0x7fcfc00a6180 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0a5070 tx=0x7fcfcc06f470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/572952982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fba8d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400bd10 tx=0x7fcfc400f730 comp rx=0 tx=0).stop 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/572952982 shutdown_connections 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/572952982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba9400 0x555f2fbab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/572952982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fba8d90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/572952982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba38a0 0x555f2fba3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/572952982 >> 172.21.15.70:0/572952982 conn(0x555f2fb9ef10 msgr2=0x555f2fb9f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/572952982 shutdown_connections 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/572952982 wait complete. 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 -- start start 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 Processor -- start 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba38a0 0x555f2fbadcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fbae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba9400 0x555f2fbb5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555f2fbac3b0 con 0x555f2fba4290 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555f2fa8ffe0 con 0x555f2fba38a0 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.182+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f2fbac530 con 0x555f2fba9400 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfdb9f0740 10 client.0 _ll_register_callbacks cb 0x555f2faa6150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfd259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fbae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfd259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fbae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35860/0 (socket says 172.21.15.70:35860) 2024-04-26T20:27:10.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfd259c640 1 -- 172.21.15.70:0/3889328577 learned_addr learned my addr 172.21.15.70:0/3889328577 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba38a0 0x555f2fbadcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfd259c640 1 -- 172.21.15.70:0/3889328577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba9400 msgr2=0x555f2fbb5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfd259c640 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba9400 0x555f2fbb5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfd259c640 1 -- 172.21.15.70:0/3889328577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba38a0 msgr2=0x555f2fbadcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfd259c640 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba38a0 0x555f2fbadcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfd259c640 1 -- 172.21.15.70:0/3889328577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f2f81a2d0 con 0x555f2fba4290 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfd259c640 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fbae210 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400bce0 tx=0x7fcfc401a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c411ddde51b615c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/3889328577 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4028060 con 0x555f2fba4290 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/3889328577 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fcfc401acf0 con 0x555f2fba4290 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/3889328577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfc401a930 con 0x555f2fba4290 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/3889328577 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcfc4015070 con 0x555f2fba4290 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfdb9f0740 10 client.15249 fetch_fsmap learned FSMap version 24 2024-04-26T20:27:10.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/3889328577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555f2f8e46b0 con 0x555f2fba4290 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.183+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/3889328577 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfc401a930 con 0x555f2fba4290 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.184+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/3889328577 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fcfc4011b00 con 0x555f2fba4290 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.184+0000 7fcfdb9f0740 10 client.15249 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.184+0000 7fcfdb9f0740 10 client.15249 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.184+0000 7fcfdb9f0740 20 client.15249 populate_metadata read hostname 'smithi070' 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.184+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x555f2fbba210 0x555f2fbbb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.184+0000 7fcfdb9f0740 4 client.15249 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.184+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/3889328577 --> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f2fb16350 con 0x555f2fbba210 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.184+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x555f2fbba210 0x555f2fbbb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.184+0000 7fcfb9ffb640 10 client.15249 ms_handle_connect on v2:172.21.15.80:6836/3487724503 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.184+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x555f2fbba210 0x555f2fbbb680 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9b2a3962f594aa52 server_cookie=1a9a3e529e7ad9ef in_seq=0 out_seq=0 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/3889328577 <== mds.3 v2:172.21.15.80:6836/3487724503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555f2fb16350 con 0x555f2fbba210 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfb9ffb640 10 client.15249 handle_command_reply: tid=0 2024-04-26T20:27:10.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 1 client.15249 shutdown 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/3889328577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 msgr2=0x555f2fbae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fbae210 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400bce0 tx=0x7fcfc401a690 comp rx=0 tx=0).stop 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/3889328577 shutdown_connections 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x555f2fbba210 0x555f2fbbb680 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba9400 0x555f2fbb5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4290 0x555f2fbae210 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfb9ffb640 0 client.15249 ms_handle_reset on v2:172.21.15.80:6836/3487724503 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/3889328577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba38a0 0x555f2fbadcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/3889328577 >> 172.21.15.70:0/3889328577 conn(0x555f2fb9ef10 msgr2=0x555f2fb9e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/3889328577 shutdown_connections 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/3889328577 wait complete. 2024-04-26T20:27:10.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.185+0000 7fcfdb9f0740 20 client.15249 trim_cache size 0 max 16384 2024-04-26T20:27:10.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfdb9f0740 1 Processor -- start 2024-04-26T20:27:10.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfdb9f0740 1 -- start start 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba38a0 0x555f2fba4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba9400 0x555f2fbb5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fba56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555f2fbb99c0 con 0x555f2fba4ec0 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555f2fbba090 con 0x555f2fba9400 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f2fbba760 con 0x555f2fba38a0 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfcbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fba56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfcbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fba56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35868/0 (socket says 172.21.15.70:35868) 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfcbfff640 1 -- 172.21.15.70:0/2252323771 learned_addr learned my addr 172.21.15.70:0/2252323771 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/2252323771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba38a0 0x555f2fba4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfcbfff640 1 -- 172.21.15.70:0/2252323771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba38a0 msgr2=0x555f2fba4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/2252323771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba38a0 0x555f2fba4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfcbfff640 1 -- 172.21.15.70:0/2252323771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba9400 msgr2=0x555f2fbb5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/2252323771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba9400 0x555f2fbb5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.203+0000 7fcfcbfff640 1 -- 172.21.15.70:0/2252323771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f2fba8960 con 0x555f2fba4ec0 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/2252323771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fba56b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc02a450 tx=0x7fcfbc031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3eacd2d08e4eab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfbbfff640 1 -- 172.21.15.70:0/2252323771 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc04c030 con 0x555f2fba4ec0 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfbbfff640 1 -- 172.21.15.70:0/2252323771 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfbc042070 con 0x555f2fba4ec0 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfbbfff640 1 -- 172.21.15.70:0/2252323771 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc035040 con 0x555f2fba4ec0 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2252323771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 msgr2=0x555f2fba56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/2252323771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fba56b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc02a450 tx=0x7fcfbc031530 comp rx=0 tx=0).stop 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2252323771 shutdown_connections 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/2252323771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fba56b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/2252323771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba9400 0x555f2fbb5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/2252323771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba38a0 0x555f2fba4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2252323771 >> 172.21.15.70:0/2252323771 conn(0x555f2fb9ef10 msgr2=0x555f2fb9f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2252323771 shutdown_connections 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.204+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2252323771 wait complete. 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfdb9f0740 1 -- start start 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfdb9f0740 1 Processor -- start 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba38a0 0x555f2fbb4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fbb5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfdb9f0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba9400 0x555f2fbb15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555f2fbbb500 con 0x555f2fba4ec0 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555f2fbbae30 con 0x555f2fba9400 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfdb9f0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f2fbbbbd0 con 0x555f2fba38a0 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfdb9f0740 10 client.0 _ll_register_callbacks cb 0x7fcfc400bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfd259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fbb5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfd259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fbb5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35880/0 (socket says 172.21.15.70:35880) 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfd259c640 1 -- 172.21.15.70:0/2508034959 learned_addr learned my addr 172.21.15.70:0/2508034959 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba38a0 0x555f2fbb4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfd259c640 1 -- 172.21.15.70:0/2508034959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba38a0 msgr2=0x555f2fbb4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfd259c640 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba38a0 0x555f2fbb4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfd259c640 1 -- 172.21.15.70:0/2508034959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba9400 msgr2=0x555f2fbb15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfd259c640 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba9400 0x555f2fbb15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfd259c640 1 -- 172.21.15.70:0/2508034959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f2fbb1d10 con 0x555f2fba4ec0 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfd259c640 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fbb5040 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400bd10 tx=0x7fcfc4004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17290fd834fab77e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.205+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/2508034959 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4028070 con 0x555f2fba4ec0 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/2508034959 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fcfc401a880 con 0x555f2fba4ec0 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2508034959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfbc042070 con 0x555f2fba4ec0 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/2508034959 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcfc400b3a0 con 0x555f2fba4ec0 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfdb9f0740 10 client.15255 fetch_fsmap learned FSMap version 24 2024-04-26T20:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2508034959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555f2fc20ec0 con 0x555f2fba4ec0 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/2508034959 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfbc042070 con 0x555f2fba4ec0 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/2508034959 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fcfc4035020 con 0x555f2fba4ec0 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfdb9f0740 10 client.15255 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfdb9f0740 10 client.15255 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfdb9f0740 20 client.15255 populate_metadata read hostname 'smithi070' 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x555f2fc25ab0 0x555f2fc247c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfdb9f0740 4 client.15255 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2508034959 --> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] -- command(tid 0: {"prefix": "status"}) -- 0x555f2fb101c0 con 0x555f2fc25ab0 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.206+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x555f2fc25ab0 0x555f2fc247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfb9ffb640 10 client.15255 ms_handle_connect on v2:172.21.15.80:6836/3487724503 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfcbfff640 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x555f2fc25ab0 0x555f2fc247c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b14981535c6fdfae server_cookie=606949f4bf492950 in_seq=0 out_seq=0 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfb9ffb640 1 -- 172.21.15.70:0/2508034959 <== mds.3 v2:172.21.15.80:6836/3487724503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x555f2fb101c0 con 0x555f2fc25ab0 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfb9ffb640 10 client.15255 handle_command_reply: tid=0 2024-04-26T20:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 1 client.15255 shutdown 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2508034959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 msgr2=0x555f2fbb5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fbb5040 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400bd10 tx=0x7fcfc4004a80 comp rx=0 tx=0).stop 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2508034959 shutdown_connections 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.80:6836/3487724503,v1:172.21.15.80:6837/3487724503] conn(0x555f2fc25ab0 0x555f2fc247c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555f2fba9400 0x555f2fbb15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f2fba4ec0 0x555f2fbb5040 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfb9ffb640 0 client.15255 ms_handle_reset on v2:172.21.15.80:6836/3487724503 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 1 --2- 172.21.15.70:0/2508034959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f2fba38a0 0x555f2fbb4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2508034959 >> 172.21.15.70:0/2508034959 conn(0x555f2fb9ef10 msgr2=0x555f2fba56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2508034959 shutdown_connections 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 1 -- 172.21.15.70:0/2508034959 wait complete. 2024-04-26T20:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfdb9f0740 20 client.15255 trim_cache size 0 max 16384 2024-04-26T20:27:10.216 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:27:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:27:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 3, 2024-04-26T20:27:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24461, 2024-04-26T20:27:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-04-26T20:27:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-04-26T20:27:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-04-26T20:27:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 110.191890016, 2024-04-26T20:27:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 24, 2024-04-26T20:27:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2024-04-26T20:27:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2024-04-26T20:27:10.217 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 131.764877695 2024-04-26T20:27:10.217 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:27:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfd359e640 1 -- 172.21.15.70:0/2391088378 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcfc00a3cc0 msgr2=0x7fcfc00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfd359e640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcfc00a3cc0 0x7fcfc00a6180 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0a5070 tx=0x7fcfcc06f470 comp rx=0 tx=0).stop 2024-04-26T20:27:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfd359e640 1 -- 172.21.15.70:0/2391088378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfd4103250 msgr2=0x7fcfd41a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.207+0000 7fcfd359e640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfd4103250 0x7fcfd41a0020 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00eaa0 tx=0x7fcfcc00ef60 comp rx=0 tx=0).stop 2024-04-26T20:27:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.208+0000 7fcfd359e640 1 -- 172.21.15.70:0/2391088378 shutdown_connections 2024-04-26T20:27:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.208+0000 7fcfd359e640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fcfc00a3cc0 0x7fcfc00a6180 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.208+0000 7fcfd359e640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfd4103250 0x7fcfd41a0020 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.208+0000 7fcfd359e640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4102890 0x7fcfd4198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.208+0000 7fcfd359e640 1 --2- 172.21.15.70:0/2391088378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfd41016a0 0x7fcfd4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.208+0000 7fcfd359e640 1 -- 172.21.15.70:0/2391088378 >> 172.21.15.70:0/2391088378 conn(0x7fcfd40fcc10 msgr2=0x7fcfd4105b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.208+0000 7fcfd359e640 1 -- 172.21.15.70:0/2391088378 shutdown_connections 2024-04-26T20:27:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.208+0000 7fcfd359e640 1 -- 172.21.15.70:0/2391088378 wait complete. 2024-04-26T20:27:10.219 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T20:27:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 -- 172.21.15.70:0/1649199350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4004102a60 msgr2=0x7f4004102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 --2- 172.21.15.70:0/1649199350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4004102a60 0x7f4004102ee0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009900 tx=0x7f3ff402a410 comp rx=0 tx=0).stop 2024-04-26T20:27:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 -- 172.21.15.70:0/1649199350 shutdown_connections 2024-04-26T20:27:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 --2- 172.21.15.70:0/1649199350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4004103420 0x7f4004109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 --2- 172.21.15.70:0/1649199350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4004102a60 0x7f4004102ee0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 --2- 172.21.15.70:0/1649199350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4004101870 0x7f4004101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 -- 172.21.15.70:0/1649199350 >> 172.21.15.70:0/1649199350 conn(0x7f40040fce00 msgr2=0x7f40040ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 -- 172.21.15.70:0/1649199350 shutdown_connections 2024-04-26T20:27:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 -- 172.21.15.70:0/1649199350 wait complete. 2024-04-26T20:27:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 Processor -- start 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 -- start start 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4004101870 0x7f400406a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4004102a60 0x7f400419d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4004103420 0x7f400419ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f400410d4d0 con 0x7f4004101870 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f400410d350 con 0x7f4004103420 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.317+0000 7f400c093640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f400410d650 con 0x7f4004102a60 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f4009e2f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4004101870 0x7f400406a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f4009e2f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4004101870 0x7f400406a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35898/0 (socket says 172.21.15.70:35898) 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f4009e2f640 1 -- 172.21.15.70:0/3543211874 learned_addr learned my addr 172.21.15.70:0/3543211874 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f400a630640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4004103420 0x7f400419ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f4009e2f640 1 -- 172.21.15.70:0/3543211874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4004102a60 msgr2=0x7f400419d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f4009e2f640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4004102a60 0x7f400419d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f4009e2f640 1 -- 172.21.15.70:0/3543211874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4004103420 msgr2=0x7f400419ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f4009e2f640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4004103420 0x7f400419ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f4009e2f640 1 -- 172.21.15.70:0/3543211874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40041a0880 con 0x7f4004101870 2024-04-26T20:27:10.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f4009e2f640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4004101870 0x7f400406a7c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f400000d770 tx=0x7f400000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f3ffaffd640 1 -- 172.21.15.70:0/3543211874 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000017070 con 0x7f4004101870 2024-04-26T20:27:10.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f3ffaffd640 1 -- 172.21.15.70:0/3543211874 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4000009c30 con 0x7f4004101870 2024-04-26T20:27:10.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f400c093640 1 -- 172.21.15.70:0/3543211874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40041a0b70 con 0x7f4004101870 2024-04-26T20:27:10.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f3ffaffd640 1 -- 172.21.15.70:0/3543211874 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000003d70 con 0x7f4004101870 2024-04-26T20:27:10.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.318+0000 7f400c093640 1 -- 172.21.15.70:0/3543211874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40041a1110 con 0x7f4004101870 2024-04-26T20:27:10.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.320+0000 7f3ffaffd640 1 -- 172.21.15.70:0/3543211874 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f4000003f10 con 0x7f4004101870 2024-04-26T20:27:10.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.320+0000 7f400eda9740 1 Processor -- start 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400eda9740 1 -- start start 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400eda9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c424ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400eda9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c425080 0x55e44c429b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400eda9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c42a1f0 0x55e44c42c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400eda9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e44c389740 con 0x55e44c424690 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400eda9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e44c3253a0 con 0x55e44c42a1f0 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400eda9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e44c385700 con 0x55e44c425080 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400a630640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c424ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400a630640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c424ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35900/0 (socket says 172.21.15.70:35900) 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f3ffaffd640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3ff00a3cc0 0x7f3ff00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400a630640 1 -- 172.21.15.70:0/1167920150 learned_addr learned my addr 172.21.15.70:0/1167920150 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f4009e2f640 1 --2- 172.21.15.70:0/1167920150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c425080 0x55e44c429b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400962e640 1 --2- 172.21.15.70:0/1167920150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c42a1f0 0x55e44c42c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400a630640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3ff00a3cc0 0x7f3ff00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f3ffaffd640 1 -- 172.21.15.70:0/3543211874 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f40000cff00 con 0x7f4004101870 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400a630640 1 -- 172.21.15.70:0/1167920150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c425080 msgr2=0x55e44c429b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400a630640 1 --2- 172.21.15.70:0/1167920150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c425080 0x55e44c429b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400a630640 1 -- 172.21.15.70:0/1167920150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c42a1f0 msgr2=0x55e44c42c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400a630640 1 --2- 172.21.15.70:0/1167920150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c42a1f0 0x55e44c42c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400a630640 1 -- 172.21.15.70:0/1167920150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44c341750 con 0x55e44c424690 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f4009e2f640 1 --2- 172.21.15.70:0/1167920150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c425080 0x55e44c429b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.321+0000 7f400a630640 1 --2- 172.21.15.70:0/1167920150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c424ab0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc013a50 tx=0x7f3ffc013f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663694b779e294a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f3feffff640 1 -- 172.21.15.70:0/1167920150 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc013050 con 0x55e44c424690 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f400a630640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3ff00a3cc0 0x7f3ff00a6180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc021000 tx=0x7f3ffc01f000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f3feffff640 1 -- 172.21.15.70:0/1167920150 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ffc022070 con 0x55e44c424690 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f3feffff640 1 -- 172.21.15.70:0/1167920150 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc0126b0 con 0x55e44c424690 2024-04-26T20:27:10.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f400eda9740 1 -- 172.21.15.70:0/1167920150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 msgr2=0x55e44c424ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f400eda9740 1 --2- 172.21.15.70:0/1167920150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c424ab0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc013a50 tx=0x7f3ffc013f10 comp rx=0 tx=0).stop 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f400eda9740 1 -- 172.21.15.70:0/1167920150 shutdown_connections 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f400eda9740 1 --2- 172.21.15.70:0/1167920150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c42a1f0 0x55e44c42c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f400eda9740 1 --2- 172.21.15.70:0/1167920150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c425080 0x55e44c429b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f400eda9740 1 --2- 172.21.15.70:0/1167920150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c424ab0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f400eda9740 1 -- 172.21.15.70:0/1167920150 >> 172.21.15.70:0/1167920150 conn(0x55e44c41fd00 msgr2=0x55e44c420100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.322+0000 7f400eda9740 1 -- 172.21.15.70:0/1167920150 shutdown_connections 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400eda9740 1 -- 172.21.15.70:0/1167920150 wait complete. 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400eda9740 1 -- start start 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400eda9740 1 Processor -- start 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400eda9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c424690 0x55e44c42ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400eda9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c425080 0x55e44c42efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400eda9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c42a1f0 0x55e44c436010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400eda9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e44c42d1a0 con 0x55e44c425080 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400eda9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e44c310fe0 con 0x55e44c424690 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400eda9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e44c42d320 con 0x55e44c42a1f0 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400eda9740 10 client.0 _ll_register_callbacks cb 0x55e44c327150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400962e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c425080 0x55e44c42efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400962e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c425080 0x55e44c42efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35908/0 (socket says 172.21.15.70:35908) 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f400962e640 1 -- 172.21.15.70:0/2793315851 learned_addr learned my addr 172.21.15.70:0/2793315851 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.323+0000 7f4009e2f640 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c424690 0x55e44c42ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400a630640 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c42a1f0 0x55e44c436010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400962e640 1 -- 172.21.15.70:0/2793315851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c42a1f0 msgr2=0x55e44c436010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400962e640 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c42a1f0 0x55e44c436010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400962e640 1 -- 172.21.15.70:0/2793315851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c424690 msgr2=0x55e44c42ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400962e640 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c424690 0x55e44c42ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400962e640 1 -- 172.21.15.70:0/2793315851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44c09b2d0 con 0x55e44c425080 2024-04-26T20:27:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f4009e2f640 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c424690 0x55e44c42ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400962e640 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c425080 0x55e44c42efd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009900 tx=0x7f3ff4032f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a701653d7d3874c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f3fed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f3fed7fa640 1 -- 172.21.15.70:0/2793315851 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4040070 con 0x55e44c425080 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f3fed7fa640 1 -- 172.21.15.70:0/2793315851 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f3ff4004230 con 0x55e44c425080 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400eda9740 1 -- 172.21.15.70:0/2793315851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ffc022070 con 0x55e44c425080 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f3fed7fa640 1 -- 172.21.15.70:0/2793315851 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3ff4035040 con 0x55e44c425080 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400eda9740 10 client.15267 fetch_fsmap learned FSMap version 24 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400eda9740 1 -- 172.21.15.70:0/2793315851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e44c1656b0 con 0x55e44c425080 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f3fed7fa640 1 -- 172.21.15.70:0/2793315851 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ffc022070 con 0x55e44c425080 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f3fed7fa640 1 -- 172.21.15.70:0/2793315851 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f3ff4004a90 con 0x55e44c425080 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400eda9740 10 client.15267 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400eda9740 10 client.15267 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.324+0000 7f400eda9740 20 client.15267 populate_metadata read hostname 'smithi070' 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.325+0000 7f400eda9740 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x55e44c43b530 0x55e44c43c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.325+0000 7f400eda9740 4 client.15267 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.325+0000 7f400eda9740 1 -- 172.21.15.70:0/2793315851 --> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e44c397350 con 0x55e44c43b530 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.325+0000 7f4009e2f640 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x55e44c43b530 0x55e44c43c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.325+0000 7f4009e2f640 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x55e44c43b530 0x55e44c43c9a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8327708097fa98b8 server_cookie=6cb84191b6d22052 in_seq=0 out_seq=0 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.325+0000 7f3fed7fa640 10 client.15267 ms_handle_connect on v2:172.21.15.98:6836/3751464822 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f3fed7fa640 1 -- 172.21.15.70:0/2793315851 <== mds.2 v2:172.21.15.98:6836/3751464822 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e44c397350 con 0x55e44c43b530 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f3fed7fa640 10 client.15267 handle_command_reply: tid=0 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 1 client.15267 shutdown 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 1 -- 172.21.15.70:0/2793315851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c425080 msgr2=0x55e44c42efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c425080 0x55e44c42efd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009900 tx=0x7f3ff4032f50 comp rx=0 tx=0).stop 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 1 -- 172.21.15.70:0/2793315851 shutdown_connections 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x55e44c43b530 0x55e44c43c9a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c42a1f0 0x55e44c436010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c425080 0x55e44c42efd0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 1 --2- 172.21.15.70:0/2793315851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c424690 0x55e44c42ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f3fed7fa640 0 client.15267 ms_handle_reset on v2:172.21.15.98:6836/3751464822 2024-04-26T20:27:10.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 1 -- 172.21.15.70:0/2793315851 >> 172.21.15.70:0/2793315851 conn(0x55e44c41fd00 msgr2=0x55e44c41ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 1 -- 172.21.15.70:0/2793315851 shutdown_connections 2024-04-26T20:27:10.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 1 -- 172.21.15.70:0/2793315851 wait complete. 2024-04-26T20:27:10.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.326+0000 7f400eda9740 20 client.15267 trim_cache size 0 max 16384 2024-04-26T20:27:10.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400eda9740 1 Processor -- start 2024-04-26T20:27:10.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400eda9740 1 -- start start 2024-04-26T20:27:10.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400eda9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c424690 0x55e44c42e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400eda9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c425080 0x55e44c435fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400eda9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c42a1f0 0x55e44c42ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400eda9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e44c43ace0 con 0x55e44c42a1f0 2024-04-26T20:27:10.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400eda9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e44c43b3b0 con 0x55e44c425080 2024-04-26T20:27:10.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400eda9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e44c43ba80 con 0x55e44c424690 2024-04-26T20:27:10.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400a630640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c42a1f0 0x55e44c42ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400a630640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c42a1f0 0x55e44c42ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35924/0 (socket says 172.21.15.70:35924) 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400a630640 1 -- 172.21.15.70:0/2739523169 learned_addr learned my addr 172.21.15.70:0/2739523169 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400962e640 1 --2- 172.21.15.70:0/2739523169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c425080 0x55e44c435fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400a630640 1 -- 172.21.15.70:0/2739523169 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c424690 msgr2=0x55e44c42e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400a630640 1 --2- 172.21.15.70:0/2739523169 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c424690 0x55e44c42e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400a630640 1 -- 172.21.15.70:0/2739523169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c425080 msgr2=0x55e44c435fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400a630640 1 --2- 172.21.15.70:0/2739523169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c425080 0x55e44c435fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400a630640 1 -- 172.21.15.70:0/2739523169 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44c4242d0 con 0x55e44c42a1f0 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.344+0000 7f400962e640 1 --2- 172.21.15.70:0/2739523169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c425080 0x55e44c435fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f400a630640 1 --2- 172.21.15.70:0/2739523169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c42a1f0 0x55e44c42ebe0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc011fc0 tx=0x7f3ffc005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff1c19db53c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f3fef7fe640 1 -- 172.21.15.70:0/2739523169 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc012650 con 0x55e44c42a1f0 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f3fef7fe640 1 -- 172.21.15.70:0/2739523169 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ffc022040 con 0x55e44c42a1f0 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f3fef7fe640 1 -- 172.21.15.70:0/2739523169 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc012950 con 0x55e44c42a1f0 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f400eda9740 1 -- 172.21.15.70:0/2739523169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c42a1f0 msgr2=0x55e44c42ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f400eda9740 1 --2- 172.21.15.70:0/2739523169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c42a1f0 0x55e44c42ebe0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc011fc0 tx=0x7f3ffc005bd0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f400eda9740 1 -- 172.21.15.70:0/2739523169 shutdown_connections 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f400eda9740 1 --2- 172.21.15.70:0/2739523169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c42a1f0 0x55e44c42ebe0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f400eda9740 1 --2- 172.21.15.70:0/2739523169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c425080 0x55e44c435fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f400eda9740 1 --2- 172.21.15.70:0/2739523169 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c424690 0x55e44c42e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f400eda9740 1 -- 172.21.15.70:0/2739523169 >> 172.21.15.70:0/2739523169 conn(0x55e44c41fd00 msgr2=0x55e44c4264b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f400eda9740 1 -- 172.21.15.70:0/2739523169 shutdown_connections 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.345+0000 7f400eda9740 1 -- 172.21.15.70:0/2739523169 wait complete. 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f400eda9740 1 -- start start 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f400eda9740 1 Processor -- start 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f400eda9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c4359a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f400eda9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c425080 0x55e44c435ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f400eda9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c42a1f0 0x55e44c432440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f400eda9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e44c43c820 con 0x55e44c424690 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f400eda9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e44c43c150 con 0x55e44c425080 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f400eda9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e44c43cef0 con 0x55e44c42a1f0 2024-04-26T20:27:10.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f400eda9740 10 client.0 _ll_register_callbacks cb 0x7f3ff4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f4009e2f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c4359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f4009e2f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c4359a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35934/0 (socket says 172.21.15.70:35934) 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f4009e2f640 1 -- 172.21.15.70:0/3186363673 learned_addr learned my addr 172.21.15.70:0/3186363673 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f4009e2f640 1 -- 172.21.15.70:0/3186363673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c42a1f0 msgr2=0x55e44c432440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f4009e2f640 1 --2- 172.21.15.70:0/3186363673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c42a1f0 0x55e44c432440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f4009e2f640 1 -- 172.21.15.70:0/3186363673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c425080 msgr2=0x55e44c435ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f4009e2f640 1 --2- 172.21.15.70:0/3186363673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c425080 0x55e44c435ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.346+0000 7f4009e2f640 1 -- 172.21.15.70:0/3186363673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44c432c70 con 0x55e44c424690 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f4009e2f640 1 --2- 172.21.15.70:0/3186363673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c4359a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f40000cd870 tx=0x7f4000020c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6ff5bac31f8e21 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f3fed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f3fed7fa640 1 -- 172.21.15.70:0/3186363673 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40000b4070 con 0x55e44c424690 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f3fed7fa640 1 -- 172.21.15.70:0/3186363673 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f400009a310 con 0x55e44c424690 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f400eda9740 1 -- 172.21.15.70:0/3186363673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ffc022040 con 0x55e44c424690 2024-04-26T20:27:10.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f3fed7fa640 1 -- 172.21.15.70:0/3186363673 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4000020040 con 0x55e44c424690 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f400eda9740 10 client.15273 fetch_fsmap learned FSMap version 24 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f400eda9740 1 -- 172.21.15.70:0/3186363673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e44c4a2290 con 0x55e44c424690 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f3fed7fa640 1 -- 172.21.15.70:0/3186363673 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ffc022040 con 0x55e44c424690 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f3fed7fa640 1 -- 172.21.15.70:0/3186363673 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f40000d1040 con 0x55e44c424690 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f400eda9740 10 client.15273 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f400eda9740 10 client.15273 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f400eda9740 20 client.15273 populate_metadata read hostname 'smithi070' 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f400eda9740 1 --2- 172.21.15.70:0/3186363673 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x55e44c4a6f00 0x55e44c4a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f400eda9740 4 client.15273 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.347+0000 7f400eda9740 1 -- 172.21.15.70:0/3186363673 --> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] -- command(tid 0: {"prefix": "status"}) -- 0x55e44c3911c0 con 0x55e44c4a6f00 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400962e640 1 --2- 172.21.15.70:0/3186363673 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x55e44c4a6f00 0x55e44c4a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400962e640 1 --2- 172.21.15.70:0/3186363673 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x55e44c4a6f00 0x55e44c4a5c10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b03a07f622dbf110 server_cookie=43b23663c359ef4c in_seq=0 out_seq=0 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f3fed7fa640 10 client.15273 ms_handle_connect on v2:172.21.15.98:6836/3751464822 2024-04-26T20:27:10.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f3fed7fa640 1 -- 172.21.15.70:0/3186363673 <== mds.2 v2:172.21.15.98:6836/3751464822 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e44c3911c0 con 0x55e44c4a6f00 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f3fed7fa640 10 client.15273 handle_command_reply: tid=0 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 1 client.15273 shutdown 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 1 -- 172.21.15.70:0/3186363673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 msgr2=0x55e44c4359a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 1 --2- 172.21.15.70:0/3186363673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c4359a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f40000cd870 tx=0x7f4000020c30 comp rx=0 tx=0).stop 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 1 -- 172.21.15.70:0/3186363673 shutdown_connections 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 1 --2- 172.21.15.70:0/3186363673 >> [v2:172.21.15.98:6836/3751464822,v1:172.21.15.98:6837/3751464822] conn(0x55e44c4a6f00 0x55e44c4a5c10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 1 --2- 172.21.15.70:0/3186363673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44c42a1f0 0x55e44c432440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 1 --2- 172.21.15.70:0/3186363673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e44c425080 0x55e44c435ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f3fed7fa640 0 client.15273 ms_handle_reset on v2:172.21.15.98:6836/3751464822 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 1 --2- 172.21.15.70:0/3186363673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e44c424690 0x55e44c4359a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 1 -- 172.21.15.70:0/3186363673 >> 172.21.15.70:0/3186363673 conn(0x55e44c41fd00 msgr2=0x55e44c42e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 1 -- 172.21.15.70:0/3186363673 shutdown_connections 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 1 -- 172.21.15.70:0/3186363673 wait complete. 2024-04-26T20:27:10.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.348+0000 7f400eda9740 20 client.15273 trim_cache size 0 max 16384 2024-04-26T20:27:10.356 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:27:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:27:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-04-26T20:27:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24463, 2024-04-26T20:27:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-04-26T20:27:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-04-26T20:27:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-04-26T20:27:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 111.341297615, 2024-04-26T20:27:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 24, 2024-04-26T20:27:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2024-04-26T20:27:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2024-04-26T20:27:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 135.02610904400001 2024-04-26T20:27:10.357 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:27:10.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 -- 172.21.15.70:0/3543211874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3ff00a3cc0 msgr2=0x7f3ff00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3ff00a3cc0 0x7f3ff00a6180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc021000 tx=0x7f3ffc01f000 comp rx=0 tx=0).stop 2024-04-26T20:27:10.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 -- 172.21.15.70:0/3543211874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4004101870 msgr2=0x7f400406a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4004101870 0x7f400406a7c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f400000d770 tx=0x7f400000dc30 comp rx=0 tx=0).stop 2024-04-26T20:27:10.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 -- 172.21.15.70:0/3543211874 shutdown_connections 2024-04-26T20:27:10.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f3ff00a3cc0 0x7f3ff00a6180 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4004103420 0x7f400419ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4004102a60 0x7f400419d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 --2- 172.21.15.70:0/3543211874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4004101870 0x7f400406a7c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 -- 172.21.15.70:0/3543211874 >> 172.21.15.70:0/3543211874 conn(0x7f40040fce00 msgr2=0x7f4004105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 -- 172.21.15.70:0/3543211874 shutdown_connections 2024-04-26T20:27:10.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.349+0000 7f400c093640 1 -- 172.21.15.70:0/3543211874 wait complete. 2024-04-26T20:27:10.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-26T20:27:10.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.459+0000 7f91ce189640 1 -- 172.21.15.70:0/1502655984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c8105d40 msgr2=0x7f91c8108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.459+0000 7f91ce189640 1 --2- 172.21.15.70:0/1502655984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c8105d40 0x7f91c8108130 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009900 tx=0x7f91bc02a410 comp rx=0 tx=0).stop 2024-04-26T20:27:10.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.459+0000 7f91ce189640 1 -- 172.21.15.70:0/1502655984 shutdown_connections 2024-04-26T20:27:10.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.459+0000 7f91ce189640 1 --2- 172.21.15.70:0/1502655984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c8108670 0x7f91c810aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.459+0000 7f91ce189640 1 --2- 172.21.15.70:0/1502655984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c8105d40 0x7f91c8108130 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.459+0000 7f91ce189640 1 --2- 172.21.15.70:0/1502655984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c8103410 0x7f91c8105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.459+0000 7f91ce189640 1 -- 172.21.15.70:0/1502655984 >> 172.21.15.70:0/1502655984 conn(0x7f91c80fce00 msgr2=0x7f91c80ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.459+0000 7f91ce189640 1 -- 172.21.15.70:0/1502655984 shutdown_connections 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.459+0000 7f91ce189640 1 -- 172.21.15.70:0/1502655984 wait complete. 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91ce189640 1 Processor -- start 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91ce189640 1 -- start start 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91ce189640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c8103410 0x7f91c8102d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91ce189640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c8105d40 0x7f91c81013c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91ce189640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c8108670 0x7f91c8101900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91ce189640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91c810e5f0 con 0x7f91c8105d40 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91ce189640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f91c810e470 con 0x7f91c8103410 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91ce189640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f91c810e770 con 0x7f91c8108670 2024-04-26T20:27:10.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91c6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c8105d40 0x7f91c81013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91c6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c8105d40 0x7f91c81013c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35950/0 (socket says 172.21.15.70:35950) 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91c6ffd640 1 -- 172.21.15.70:0/869693869 learned_addr learned my addr 172.21.15.70:0/869693869 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91c77fe640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c8103410 0x7f91c8102d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91c7fff640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c8108670 0x7f91c8101900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91c6ffd640 1 -- 172.21.15.70:0/869693869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c8108670 msgr2=0x7f91c8101900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91c6ffd640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c8108670 0x7f91c8101900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91c6ffd640 1 -- 172.21.15.70:0/869693869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c8103410 msgr2=0x7f91c8102d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91c6ffd640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c8103410 0x7f91c8102d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91c6ffd640 1 -- 172.21.15.70:0/869693869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c8102190 con 0x7f91c8105d40 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.460+0000 7f91c6ffd640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c8105d40 0x7f91c81013c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f91bc006010 tx=0x7f91bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.461+0000 7f91c4ff9640 1 -- 172.21.15.70:0/869693869 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc03f030 con 0x7f91c8105d40 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.461+0000 7f91c4ff9640 1 -- 172.21.15.70:0/869693869 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91bc003cd0 con 0x7f91c8105d40 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.461+0000 7f91c4ff9640 1 -- 172.21.15.70:0/869693869 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc035070 con 0x7f91c8105d40 2024-04-26T20:27:10.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.461+0000 7f91ce189640 1 -- 172.21.15.70:0/869693869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c81a2db0 con 0x7f91c8105d40 2024-04-26T20:27:10.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.461+0000 7f91ce189640 1 -- 172.21.15.70:0/869693869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c81a3270 con 0x7f91c8105d40 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91c4ff9640 1 -- 172.21.15.70:0/869693869 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f91bc042030 con 0x7f91c8105d40 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91d0f7d740 1 Processor -- start 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91d0f7d740 1 -- start start 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e95690 0x5604c8e95ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e96080 0x5604c8e9ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e9b1f0 0x5604c8e9d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91c4ff9640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91b00a3cc0 0x7f91b00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5604c8dfa740 con 0x5604c8e95690 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5604c8d963a0 con 0x5604c8e96080 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5604c8df6700 con 0x5604c8e9b1f0 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e95690 0x5604c8e95ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e95690 0x5604c8e95ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35956/0 (socket says 172.21.15.70:35956) 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91c7fff640 1 -- 172.21.15.70:0/2922630352 learned_addr learned my addr 172.21.15.70:0/2922630352 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91c7fff640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91b00a3cc0 0x7f91b00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91c4ff9640 1 -- 172.21.15.70:0/869693869 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f91bc0f0a30 con 0x7f91c8105d40 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.463+0000 7f91c77fe640 1 --2- 172.21.15.70:0/2922630352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e96080 0x5604c8e9ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91c7fff640 1 -- 172.21.15.70:0/2922630352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e9b1f0 msgr2=0x5604c8e9d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91c6ffd640 1 --2- 172.21.15.70:0/2922630352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e9b1f0 0x5604c8e9d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91c7fff640 1 --2- 172.21.15.70:0/2922630352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e9b1f0 0x5604c8e9d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91c7fff640 1 -- 172.21.15.70:0/2922630352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e96080 msgr2=0x5604c8e9ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91c7fff640 1 --2- 172.21.15.70:0/2922630352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e96080 0x5604c8e9ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91c7fff640 1 -- 172.21.15.70:0/2922630352 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c8db2750 con 0x5604c8e95690 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91c77fe640 1 --2- 172.21.15.70:0/2922630352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e96080 0x5604c8e9ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91c7fff640 1 --2- 172.21.15.70:0/2922630352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e95690 0x5604c8e95ab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009270 tx=0x7f91c00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a091d76f8b6906a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91c7fff640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91b00a3cc0 0x7f91b00a6180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f91c0011cb0 tx=0x7f91c001c000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91adffb640 1 -- 172.21.15.70:0/2922630352 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c000cce0 con 0x5604c8e95690 2024-04-26T20:27:10.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91adffb640 1 -- 172.21.15.70:0/2922630352 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91c000ce80 con 0x5604c8e95690 2024-04-26T20:27:10.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.464+0000 7f91adffb640 1 -- 172.21.15.70:0/2922630352 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0004290 con 0x5604c8e95690 2024-04-26T20:27:10.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 -- 172.21.15.70:0/2922630352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e95690 msgr2=0x5604c8e95ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/2922630352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e95690 0x5604c8e95ab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009270 tx=0x7f91c00117b0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 -- 172.21.15.70:0/2922630352 shutdown_connections 2024-04-26T20:27:10.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/2922630352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e9b1f0 0x5604c8e9d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/2922630352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e96080 0x5604c8e9ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/2922630352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e95690 0x5604c8e95ab0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 -- 172.21.15.70:0/2922630352 >> 172.21.15.70:0/2922630352 conn(0x5604c8e90d00 msgr2=0x5604c8e91100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 -- 172.21.15.70:0/2922630352 shutdown_connections 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 -- 172.21.15.70:0/2922630352 wait complete. 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 -- start start 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 Processor -- start 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e95690 0x5604c8e9fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e96080 0x5604c8ea0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5604c8e9e140 con 0x5604c8e96080 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5604c8d81fe0 con 0x5604c8e95690 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5604c8e9e2c0 con 0x5604c8e9b1f0 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.465+0000 7f91d0f7d740 10 client.0 _ll_register_callbacks cb 0x5604c8d98150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91c6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e96080 0x5604c8ea0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91c6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e96080 0x5604c8ea0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35964/0 (socket says 172.21.15.70:35964) 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91c6ffd640 1 -- 172.21.15.70:0/3249416376 learned_addr learned my addr 172.21.15.70:0/3249416376 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91c77fe640 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e95690 0x5604c8e9fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91c6ffd640 1 -- 172.21.15.70:0/3249416376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e9b1f0 msgr2=0x5604c8ea70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91c6ffd640 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91c6ffd640 1 -- 172.21.15.70:0/3249416376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e95690 msgr2=0x5604c8e9fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91c6ffd640 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e95690 0x5604c8e9fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91c6ffd640 1 -- 172.21.15.70:0/3249416376 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c8b0c2d0 con 0x5604c8e96080 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91c77fe640 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e95690 0x5604c8e9fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91c6ffd640 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e96080 0x5604c8ea0080 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0bc8a0 tx=0x7f91bc0bca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a59d64576b5a63 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91a6ffd640 1 -- 172.21.15.70:0/3249416376 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc049050 con 0x5604c8e96080 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91a6ffd640 1 -- 172.21.15.70:0/3249416376 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f91bc0dd0b0 con 0x5604c8e96080 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91d0f7d740 1 -- 172.21.15.70:0/3249416376 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604c8e08350 con 0x5604c8e96080 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91a6ffd640 1 -- 172.21.15.70:0/3249416376 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f91bc004490 con 0x5604c8e96080 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91d0f7d740 10 client.15285 fetch_fsmap learned FSMap version 24 2024-04-26T20:27:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91d0f7d740 1 -- 172.21.15.70:0/3249416376 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5604c8bd66b0 con 0x5604c8e96080 2024-04-26T20:27:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91a6ffd640 1 -- 172.21.15.70:0/3249416376 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x5604c8e08350 con 0x5604c8e96080 2024-04-26T20:27:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.466+0000 7f91a6ffd640 1 -- 172.21.15.70:0/3249416376 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f91bc0b9210 con 0x5604c8e96080 2024-04-26T20:27:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.467+0000 7f91d0f7d740 10 client.15285 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:27:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.467+0000 7f91d0f7d740 10 client.15285 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T20:27:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.467+0000 7f91d0f7d740 20 client.15285 populate_metadata read hostname 'smithi070' 2024-04-26T20:27:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.467+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x5604c8eac5a0 0x5604c8eada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.467+0000 7f91d0f7d740 4 client.15285 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.467+0000 7f91d0f7d740 1 -- 172.21.15.70:0/3249416376 --> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604c8e021c0 con 0x5604c8eac5a0 2024-04-26T20:27:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.467+0000 7f91c77fe640 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x5604c8eac5a0 0x5604c8eada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.467+0000 7f91a6ffd640 10 client.15285 ms_handle_connect on v2:172.21.15.98:6838/4073846722 2024-04-26T20:27:10.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.467+0000 7f91c77fe640 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x5604c8eac5a0 0x5604c8eada10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2349a22ce17efa3 server_cookie=b6599edf1236d1b2 in_seq=0 out_seq=0 2024-04-26T20:27:10.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91a6ffd640 1 -- 172.21.15.70:0/3249416376 <== mds.1 v2:172.21.15.98:6838/4073846722 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5604c8e021c0 con 0x5604c8eac5a0 2024-04-26T20:27:10.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91a6ffd640 10 client.15285 handle_command_reply: tid=0 2024-04-26T20:27:10.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 1 client.15285 shutdown 2024-04-26T20:27:10.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 1 -- 172.21.15.70:0/3249416376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e96080 msgr2=0x5604c8ea0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e96080 0x5604c8ea0080 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0bc8a0 tx=0x7f91bc0bca30 comp rx=0 tx=0).stop 2024-04-26T20:27:10.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 1 -- 172.21.15.70:0/3249416376 shutdown_connections 2024-04-26T20:27:10.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x5604c8eac5a0 0x5604c8eada10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e96080 0x5604c8ea0080 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91a6ffd640 0 client.15285 ms_handle_reset on v2:172.21.15.98:6838/4073846722 2024-04-26T20:27:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/3249416376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e95690 0x5604c8e9fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 1 -- 172.21.15.70:0/3249416376 >> 172.21.15.70:0/3249416376 conn(0x5604c8e90d00 msgr2=0x5604c8e8ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 1 -- 172.21.15.70:0/3249416376 shutdown_connections 2024-04-26T20:27:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 1 -- 172.21.15.70:0/3249416376 wait complete. 2024-04-26T20:27:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.468+0000 7f91d0f7d740 20 client.15285 trim_cache size 0 max 16384 2024-04-26T20:27:10.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.486+0000 7f91d0f7d740 1 Processor -- start 2024-04-26T20:27:10.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.486+0000 7f91d0f7d740 1 -- start start 2024-04-26T20:27:10.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.486+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e95690 0x5604c8eab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.486+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e96080 0x5604c8eab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.486+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5604c8eabd50 con 0x5604c8e9b1f0 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5604c8eac420 con 0x5604c8e96080 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5604c8eacaf0 con 0x5604c8e95690 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35980/0 (socket says 172.21.15.70:35980) 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91c7fff640 1 -- 172.21.15.70:0/332479268 learned_addr learned my addr 172.21.15.70:0/332479268 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91c7fff640 1 -- 172.21.15.70:0/332479268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e95690 msgr2=0x5604c8eab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91c7fff640 1 --2- 172.21.15.70:0/332479268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e95690 0x5604c8eab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91c7fff640 1 -- 172.21.15.70:0/332479268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e96080 msgr2=0x5604c8eab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91c7fff640 1 --2- 172.21.15.70:0/332479268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e96080 0x5604c8eab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91c7fff640 1 -- 172.21.15.70:0/332479268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c8e96910 con 0x5604c8e9b1f0 2024-04-26T20:27:10.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91c7fff640 1 --2- 172.21.15.70:0/332479268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea7080 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f91c0014670 tx=0x7f91c0014d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35462da54fa59c49 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91ad7fa640 1 -- 172.21.15.70:0/332479268 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0009ce0 con 0x5604c8e9b1f0 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91ad7fa640 1 -- 172.21.15.70:0/332479268 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91c0004500 con 0x5604c8e9b1f0 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.487+0000 7f91ad7fa640 1 -- 172.21.15.70:0/332479268 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0005280 con 0x5604c8e9b1f0 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 -- 172.21.15.70:0/332479268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 msgr2=0x5604c8ea7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/332479268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea7080 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f91c0014670 tx=0x7f91c0014d40 comp rx=0 tx=0).stop 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 -- 172.21.15.70:0/332479268 shutdown_connections 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/332479268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea7080 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/332479268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e96080 0x5604c8eab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/332479268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e95690 0x5604c8eab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 -- 172.21.15.70:0/332479268 >> 172.21.15.70:0/332479268 conn(0x5604c8e90d00 msgr2=0x5604c8e910e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 -- 172.21.15.70:0/332479268 shutdown_connections 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 -- 172.21.15.70:0/332479268 wait complete. 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 -- start start 2024-04-26T20:27:10.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 Processor -- start 2024-04-26T20:27:10.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e95690 0x5604c8ea30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e96080 0x5604c8ea3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5604c8ead890 con 0x5604c8e9b1f0 2024-04-26T20:27:10.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5604c8ead1c0 con 0x5604c8e95690 2024-04-26T20:27:10.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.488+0000 7f91d0f7d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5604c8eadf60 con 0x5604c8e96080 2024-04-26T20:27:10.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91d0f7d740 10 client.0 _ll_register_callbacks cb 0x7f91bc0f0cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:10.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35988/0 (socket says 172.21.15.70:35988) 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91c7fff640 1 -- 172.21.15.70:0/1237837496 learned_addr learned my addr 172.21.15.70:0/1237837496 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91c77fe640 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e95690 0x5604c8ea30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91c7fff640 1 -- 172.21.15.70:0/1237837496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e96080 msgr2=0x5604c8ea3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91c7fff640 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e96080 0x5604c8ea3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91c7fff640 1 -- 172.21.15.70:0/1237837496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e95690 msgr2=0x5604c8ea30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91c7fff640 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e95690 0x5604c8ea30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91c7fff640 1 -- 172.21.15.70:0/1237837496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c8ea6c20 con 0x5604c8e9b1f0 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91c7fff640 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea6630 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009ef0 tx=0x7f91c0009320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3544a76807835600 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91a6ffd640 1 -- 172.21.15.70:0/1237837496 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0009590 con 0x5604c8e9b1f0 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91a6ffd640 1 -- 172.21.15.70:0/1237837496 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f91c00048c0 con 0x5604c8e9b1f0 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91d0f7d740 1 -- 172.21.15.70:0/1237837496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91c0004500 con 0x5604c8e9b1f0 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91a6ffd640 1 -- 172.21.15.70:0/1237837496 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f91c0004b00 con 0x5604c8e9b1f0 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91d0f7d740 10 client.15291 fetch_fsmap learned FSMap version 24 2024-04-26T20:27:10.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91d0f7d740 1 -- 172.21.15.70:0/1237837496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5604c8f12dd0 con 0x5604c8e9b1f0 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.489+0000 7f91a6ffd640 1 -- 172.21.15.70:0/1237837496 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91c0004500 con 0x5604c8e9b1f0 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91a6ffd640 1 -- 172.21.15.70:0/1237837496 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f91c002e020 con 0x5604c8e9b1f0 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91d0f7d740 10 client.15291 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91d0f7d740 10 client.15291 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91d0f7d740 20 client.15291 populate_metadata read hostname 'smithi070' 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x5604c8f172c0 0x5604c8f15fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91d0f7d740 4 client.15291 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91d0f7d740 1 -- 172.21.15.70:0/1237837496 --> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] -- command(tid 0: {"prefix": "status"}) -- 0x5604c8d7d9a0 con 0x5604c8f172c0 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91c77fe640 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x5604c8f172c0 0x5604c8f15fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91a6ffd640 10 client.15291 ms_handle_connect on v2:172.21.15.98:6838/4073846722 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91c77fe640 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x5604c8f172c0 0x5604c8f15fd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72d61e0fc3489eaa server_cookie=46c613f2d1782aca in_seq=0 out_seq=0 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91a6ffd640 1 -- 172.21.15.70:0/1237837496 <== mds.1 v2:172.21.15.98:6838/4073846722 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5604c8d7d9a0 con 0x5604c8f172c0 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91a6ffd640 10 client.15291 handle_command_reply: tid=0 2024-04-26T20:27:10.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.490+0000 7f91d0f7d740 1 client.15291 shutdown 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91d0f7d740 1 -- 172.21.15.70:0/1237837496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 msgr2=0x5604c8ea6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea6630 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009ef0 tx=0x7f91c0009320 comp rx=0 tx=0).stop 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91d0f7d740 1 -- 172.21.15.70:0/1237837496 shutdown_connections 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.98:6838/4073846722,v1:172.21.15.98:6839/4073846722] conn(0x5604c8f172c0 0x5604c8f15fd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604c8e9b1f0 0x5604c8ea6630 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91a6ffd640 0 client.15291 ms_handle_reset on v2:172.21.15.98:6838/4073846722 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604c8e96080 0x5604c8ea3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91d0f7d740 1 --2- 172.21.15.70:0/1237837496 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604c8e95690 0x5604c8ea30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91d0f7d740 1 -- 172.21.15.70:0/1237837496 >> 172.21.15.70:0/1237837496 conn(0x5604c8e90d00 msgr2=0x5604c8e974e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91d0f7d740 1 -- 172.21.15.70:0/1237837496 shutdown_connections 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91d0f7d740 1 -- 172.21.15.70:0/1237837496 wait complete. 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91d0f7d740 20 client.15291 trim_cache size 0 max 16384 2024-04-26T20:27:10.501 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24481, 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 112.50416937200001, 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 24, 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 129.24528736600001 2024-04-26T20:27:10.502 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 -- 172.21.15.70:0/869693869 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91b00a3cc0 msgr2=0x7f91b00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91b00a3cc0 0x7f91b00a6180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f91c0011cb0 tx=0x7f91c001c000 comp rx=0 tx=0).stop 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 -- 172.21.15.70:0/869693869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c8105d40 msgr2=0x7f91c81013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c8105d40 0x7f91c81013c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f91bc006010 tx=0x7f91bc0042f0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 -- 172.21.15.70:0/869693869 shutdown_connections 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f91b00a3cc0 0x7f91b00a6180 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c8108670 0x7f91c8101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c8105d40 0x7f91c81013c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 --2- 172.21.15.70:0/869693869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c8103410 0x7f91c8102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 -- 172.21.15.70:0/869693869 >> 172.21.15.70:0/869693869 conn(0x7f91c80fce00 msgr2=0x7f91c8103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 -- 172.21.15.70:0/869693869 shutdown_connections 2024-04-26T20:27:10.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.491+0000 7f91ce189640 1 -- 172.21.15.70:0/869693869 wait complete. 2024-04-26T20:27:10.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.603+0000 7f1872940640 1 -- 172.21.15.70:0/2453825822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c1009e0 msgr2=0x7f186c100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.603+0000 7f1872940640 1 --2- 172.21.15.70:0/2453825822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c1009e0 0x7f186c100e60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1860009900 tx=0x7f186002a410 comp rx=0 tx=0).stop 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.603+0000 7f1872940640 1 -- 172.21.15.70:0/2453825822 shutdown_connections 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.603+0000 7f1872940640 1 --2- 172.21.15.70:0/2453825822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f186c1013a0 0x7f186c10af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.603+0000 7f1872940640 1 --2- 172.21.15.70:0/2453825822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c1009e0 0x7f186c100e60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.603+0000 7f1872940640 1 --2- 172.21.15.70:0/2453825822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f186c103f70 0x7f186c104390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.603+0000 7f1872940640 1 -- 172.21.15.70:0/2453825822 >> 172.21.15.70:0/2453825822 conn(0x7f186c0fc560 msgr2=0x7f186c0fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.603+0000 7f1872940640 1 -- 172.21.15.70:0/2453825822 shutdown_connections 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.603+0000 7f1872940640 1 -- 172.21.15.70:0/2453825822 wait complete. 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.603+0000 7f1872940640 1 Processor -- start 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.603+0000 7f1872940640 1 -- start start 2024-04-26T20:27:10.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1872940640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f186c1009e0 0x7f186c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1872940640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f186c1013a0 0x7f186c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1872940640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c103f70 0x7f186c1a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1872940640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f186c10e750 con 0x7f186c103f70 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1872940640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f186c10e5d0 con 0x7f186c1013a0 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1872940640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f186c10e8d0 con 0x7f186c1009e0 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1870edd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c103f70 0x7f186c1a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1870edd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c103f70 0x7f186c1a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36012/0 (socket says 172.21.15.70:36012) 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1870edd640 1 -- 172.21.15.70:0/2859571211 learned_addr learned my addr 172.21.15.70:0/2859571211 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f186bfff640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f186c1009e0 0x7f186c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1870edd640 1 -- 172.21.15.70:0/2859571211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f186c1009e0 msgr2=0x7f186c198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1870edd640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f186c1009e0 0x7f186c198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f186c1013a0 0x7f186c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1870edd640 1 -- 172.21.15.70:0/2859571211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f186c1013a0 msgr2=0x7f186c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1870edd640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f186c1013a0 0x7f186c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1870edd640 1 -- 172.21.15.70:0/2859571211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c1a0a50 con 0x7f186c103f70 2024-04-26T20:27:10.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f186bfff640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f186c1009e0 0x7f186c198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:10.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f186c1013a0 0x7f186c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:10.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1870edd640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c103f70 0x7f186c1a03e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f186400b970 tx=0x7f186400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f18697fa640 1 -- 172.21.15.70:0/2859571211 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864019070 con 0x7f186c103f70 2024-04-26T20:27:10.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1872940640 1 -- 172.21.15.70:0/2859571211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186c1a0d40 con 0x7f186c103f70 2024-04-26T20:27:10.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f18697fa640 1 -- 172.21.15.70:0/2859571211 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f186400cb40 con 0x7f186c103f70 2024-04-26T20:27:10.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f18697fa640 1 -- 172.21.15.70:0/2859571211 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864007650 con 0x7f186c103f70 2024-04-26T20:27:10.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.604+0000 7f1872940640 1 -- 172.21.15.70:0/2859571211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f186c1a1260 con 0x7f186c103f70 2024-04-26T20:27:10.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.606+0000 7f18697fa640 1 -- 172.21.15.70:0/2859571211 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f186401c070 con 0x7f186c103f70 2024-04-26T20:27:10.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f187565b740 1 Processor -- start 2024-04-26T20:27:10.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f187565b740 1 -- start start 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f187565b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8e9690 0x56298e8e9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f187565b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8ea080 0x56298e8eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f187565b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ef1f0 0x56298e8f1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f187565b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56298e84e740 con 0x56298e8ea080 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f187565b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56298e7ea3a0 con 0x56298e8ef1f0 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f187565b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56298e84a700 con 0x56298e8e9690 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f18697fa640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f18540a3c40 0x7f18540a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f186b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8e9690 0x56298e8e9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f186b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8e9690 0x56298e8e9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.70:45696/0 (socket says 172.21.15.70:45696) 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f186b7fe640 1 -- 172.21.15.70:0/3534541610 learned_addr learned my addr 172.21.15.70:0/3534541610 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f186b7fe640 1 --2- 172.21.15.70:0/3534541610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ef1f0 0x56298e8f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f186bfff640 1 --2- 172.21.15.70:0/3534541610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8ea080 0x56298e8eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f1870edd640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f18540a3c40 0x7f18540a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f18697fa640 1 -- 172.21.15.70:0/2859571211 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f18640cfaf0 con 0x7f186c103f70 2024-04-26T20:27:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f186b7fe640 1 -- 172.21.15.70:0/3534541610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ef1f0 msgr2=0x56298e8f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f186b7fe640 1 --2- 172.21.15.70:0/3534541610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ef1f0 0x56298e8f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f186b7fe640 1 -- 172.21.15.70:0/3534541610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8ea080 msgr2=0x56298e8eeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f186b7fe640 1 --2- 172.21.15.70:0/3534541610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8ea080 0x56298e8eeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f186b7fe640 1 -- 172.21.15.70:0/3534541610 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56298e806750 con 0x56298e8e9690 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.607+0000 7f186bfff640 1 --2- 172.21.15.70:0/3534541610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8ea080 0x56298e8eeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f186b7fe640 1 --2- 172.21.15.70:0/3534541610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8e9690 0x56298e8e9ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1860004640 tx=0x7f1860000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48b40ed2a7a35185 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f1870edd640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f18540a3c40 0x7f18540a6100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f18640981d0 tx=0x7f1864096710 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f18527fc640 1 -- 172.21.15.70:0/3534541610 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860045070 con 0x56298e8e9690 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f18527fc640 1 -- 172.21.15.70:0/3534541610 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1860005030 con 0x56298e8e9690 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f18527fc640 1 -- 172.21.15.70:0/3534541610 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860035040 con 0x56298e8e9690 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f187565b740 1 -- 172.21.15.70:0/3534541610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8e9690 msgr2=0x56298e8e9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f187565b740 1 --2- 172.21.15.70:0/3534541610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8e9690 0x56298e8e9ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1860004640 tx=0x7f1860000bc0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f187565b740 1 -- 172.21.15.70:0/3534541610 shutdown_connections 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f187565b740 1 --2- 172.21.15.70:0/3534541610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ef1f0 0x56298e8f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f187565b740 1 --2- 172.21.15.70:0/3534541610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8ea080 0x56298e8eeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f187565b740 1 --2- 172.21.15.70:0/3534541610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8e9690 0x56298e8e9ab0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f187565b740 1 -- 172.21.15.70:0/3534541610 >> 172.21.15.70:0/3534541610 conn(0x56298e8e4d00 msgr2=0x56298e8e5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f187565b740 1 -- 172.21.15.70:0/3534541610 shutdown_connections 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.608+0000 7f187565b740 1 -- 172.21.15.70:0/3534541610 wait complete. 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f187565b740 1 -- start start 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f187565b740 1 Processor -- start 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f187565b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f187565b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ea080 0x56298e8f4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f187565b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ef1f0 0x56298e8fb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f187565b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56298e8f2140 con 0x56298e8e9690 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f187565b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56298e7d5fe0 con 0x56298e8ea080 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f187565b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56298e8f22c0 con 0x56298e8ef1f0 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f187565b740 10 client.0 _ll_register_callbacks cb 0x56298e7ec150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f186b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f186b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36042/0 (socket says 172.21.15.70:36042) 2024-04-26T20:27:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f186b7fe640 1 -- 172.21.15.70:0/2079918683 learned_addr learned my addr 172.21.15.70:0/2079918683 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f186b7fe640 1 -- 172.21.15.70:0/2079918683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ef1f0 msgr2=0x56298e8fb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2079918683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ef1f0 0x56298e8fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f186b7fe640 1 -- 172.21.15.70:0/2079918683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ea080 msgr2=0x56298e8f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2079918683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ea080 0x56298e8f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.609+0000 7f186b7fe640 1 -- 172.21.15.70:0/2079918683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56298e5602d0 con 0x56298e8e9690 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2079918683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f3ae0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f18600092a0 tx=0x7f1860032b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9dc11d3d6bfb0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f184b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f184b7fe640 1 -- 172.21.15.70:0/2079918683 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186004d070 con 0x56298e8e9690 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f184b7fe640 1 -- 172.21.15.70:0/2079918683 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f1860004b00 con 0x56298e8e9690 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f187565b740 1 -- 172.21.15.70:0/2079918683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1860005030 con 0x56298e8e9690 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f184b7fe640 1 -- 172.21.15.70:0/2079918683 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1860059050 con 0x56298e8e9690 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f187565b740 10 client.15303 fetch_fsmap learned FSMap version 24 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f187565b740 1 -- 172.21.15.70:0/2079918683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56298e62a6b0 con 0x56298e8e9690 2024-04-26T20:27:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f184b7fe640 1 -- 172.21.15.70:0/2079918683 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1860005030 con 0x56298e8e9690 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f184b7fe640 1 -- 172.21.15.70:0/2079918683 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f186003a040 con 0x56298e8e9690 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f187565b740 10 client.15303 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f187565b740 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f187565b740 20 client.15303 populate_metadata read hostname 'smithi070' 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f187565b740 1 --2- 172.21.15.70:0/2079918683 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56298e8fffd0 0x56298e901440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f187565b740 4 client.15303 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.610+0000 7f187565b740 1 -- 172.21.15.70:0/2079918683 --> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56298e85c350 con 0x56298e8fffd0 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.611+0000 7f186bfff640 1 --2- 172.21.15.70:0/2079918683 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56298e8fffd0 0x56298e901440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.611+0000 7f186bfff640 1 --2- 172.21.15.70:0/2079918683 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56298e8fffd0 0x56298e901440 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce6e7a5c348fd6d4 server_cookie=dcc11db6a20aaed4 in_seq=0 out_seq=0 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.611+0000 7f184b7fe640 10 client.15303 ms_handle_connect on v2:172.21.15.80:6838/4099319394 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f184b7fe640 1 -- 172.21.15.70:0/2079918683 <== mds.0 v2:172.21.15.80:6838/4099319394 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56298e85c350 con 0x56298e8fffd0 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f184b7fe640 10 client.15303 handle_command_reply: tid=0 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 1 client.15303 shutdown 2024-04-26T20:27:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 1 -- 172.21.15.70:0/2079918683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 msgr2=0x56298e8f3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 1 --2- 172.21.15.70:0/2079918683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f3ae0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f18600092a0 tx=0x7f1860032b50 comp rx=0 tx=0).stop 2024-04-26T20:27:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 1 -- 172.21.15.70:0/2079918683 shutdown_connections 2024-04-26T20:27:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 1 --2- 172.21.15.70:0/2079918683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ef1f0 0x56298e8fb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 1 --2- 172.21.15.70:0/2079918683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ea080 0x56298e8f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 1 --2- 172.21.15.70:0/2079918683 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56298e8fffd0 0x56298e901440 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 1 --2- 172.21.15.70:0/2079918683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f3ae0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f184b7fe640 0 client.15303 ms_handle_reset on v2:172.21.15.80:6838/4099319394 2024-04-26T20:27:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 1 -- 172.21.15.70:0/2079918683 >> 172.21.15.70:0/2079918683 conn(0x56298e8e4d00 msgr2=0x56298e8e3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 1 -- 172.21.15.70:0/2079918683 shutdown_connections 2024-04-26T20:27:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 1 -- 172.21.15.70:0/2079918683 wait complete. 2024-04-26T20:27:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.612+0000 7f187565b740 20 client.15303 trim_cache size 0 max 16384 2024-04-26T20:27:10.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f187565b740 1 Processor -- start 2024-04-26T20:27:10.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f187565b740 1 -- start start 2024-04-26T20:27:10.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f187565b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f187565b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ea080 0x56298e8fb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f187565b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ef1f0 0x56298e8f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f187565b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56298e8ff780 con 0x56298e8e9690 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f187565b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56298e8ffe50 con 0x56298e8ef1f0 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f187565b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56298e900520 con 0x56298e8ea080 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f186b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f186b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36048/0 (socket says 172.21.15.70:36048) 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f186b7fe640 1 -- 172.21.15.70:0/2545982791 learned_addr learned my addr 172.21.15.70:0/2545982791 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f186b7fe640 1 -- 172.21.15.70:0/2545982791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ea080 msgr2=0x56298e8fb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2545982791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ea080 0x56298e8fb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f186b7fe640 1 -- 172.21.15.70:0/2545982791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ef1f0 msgr2=0x56298e8f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2545982791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ef1f0 0x56298e8f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f186b7fe640 1 -- 172.21.15.70:0/2545982791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56298e8f4ad0 con 0x56298e8e9690 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.630+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2545982791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f36f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1860005920 tx=0x7f1860031bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6576380bd2dbc624 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f1851ffb640 1 -- 172.21.15.70:0/2545982791 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860062070 con 0x56298e8e9690 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f1851ffb640 1 -- 172.21.15.70:0/2545982791 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1860056030 con 0x56298e8e9690 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f1851ffb640 1 -- 172.21.15.70:0/2545982791 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186004d040 con 0x56298e8e9690 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f187565b740 1 -- 172.21.15.70:0/2545982791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 msgr2=0x56298e8f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f187565b740 1 --2- 172.21.15.70:0/2545982791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f36f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1860005920 tx=0x7f1860031bf0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f187565b740 1 -- 172.21.15.70:0/2545982791 shutdown_connections 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f187565b740 1 --2- 172.21.15.70:0/2545982791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ef1f0 0x56298e8f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f187565b740 1 --2- 172.21.15.70:0/2545982791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ea080 0x56298e8fb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f187565b740 1 --2- 172.21.15.70:0/2545982791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8f36f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f187565b740 1 -- 172.21.15.70:0/2545982791 >> 172.21.15.70:0/2545982791 conn(0x56298e8e4d00 msgr2=0x56298e8f26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f187565b740 1 -- 172.21.15.70:0/2545982791 shutdown_connections 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f187565b740 1 -- 172.21.15.70:0/2545982791 wait complete. 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.631+0000 7f187565b740 1 -- start start 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f187565b740 1 Processor -- start 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f187565b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8faf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f187565b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ea080 0x56298e8f7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f187565b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ef1f0 0x56298e8f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f187565b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56298e9012c0 con 0x56298e8e9690 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f187565b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56298e900bf0 con 0x56298e8ea080 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f187565b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56298e901990 con 0x56298e8ef1f0 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f187565b740 10 client.0 _ll_register_callbacks cb 0x7f185c00a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f186b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8faf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f186b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8faf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36050/0 (socket says 172.21.15.70:36050) 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f186b7fe640 1 -- 172.21.15.70:0/2857492315 learned_addr learned my addr 172.21.15.70:0/2857492315 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ef1f0 0x56298e8f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f186b7fe640 1 -- 172.21.15.70:0/2857492315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ef1f0 msgr2=0x56298e8f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ef1f0 0x56298e8f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f186b7fe640 1 -- 172.21.15.70:0/2857492315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ea080 msgr2=0x56298e8f7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f186bfff640 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ea080 0x56298e8f7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ea080 0x56298e8f7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f186b7fe640 1 -- 172.21.15.70:0/2857492315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56298e965f80 con 0x56298e8e9690 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f186b7fe640 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8faf90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f18600092a0 tx=0x7f18600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea30222c539fbfa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f184b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f184b7fe640 1 -- 172.21.15.70:0/2857492315 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860042070 con 0x56298e8e9690 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f184b7fe640 1 -- 172.21.15.70:0/2857492315 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f1860031f00 con 0x56298e8e9690 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.632+0000 7f187565b740 1 -- 172.21.15.70:0/2857492315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1860056030 con 0x56298e8e9690 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f184b7fe640 1 -- 172.21.15.70:0/2857492315 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1860062040 con 0x56298e8e9690 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f187565b740 10 client.15309 fetch_fsmap learned FSMap version 24 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f187565b740 1 -- 172.21.15.70:0/2857492315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56298e967250 con 0x56298e8e9690 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f184b7fe640 1 -- 172.21.15.70:0/2857492315 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1860056030 con 0x56298e8e9690 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f184b7fe640 1 -- 172.21.15.70:0/2857492315 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f1860065070 con 0x56298e8e9690 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f187565b740 10 client.15309 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f187565b740 10 client.15309 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f187565b740 20 client.15309 populate_metadata read hostname 'smithi070' 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f187565b740 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56298e96bc30 0x56298e96a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f187565b740 4 client.15309 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f187565b740 1 -- 172.21.15.70:0/2857492315 --> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] -- command(tid 0: {"prefix": "status"}) -- 0x56298e8561c0 con 0x56298e96bc30 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.633+0000 7f186bfff640 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56298e96bc30 0x56298e96a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f184b7fe640 10 client.15309 ms_handle_connect on v2:172.21.15.80:6838/4099319394 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f186bfff640 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56298e96bc30 0x56298e96a940 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d30fcb5217b6391 server_cookie=7de20dbf1065d51 in_seq=0 out_seq=0 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f184b7fe640 1 -- 172.21.15.70:0/2857492315 <== mds.0 v2:172.21.15.80:6838/4099319394 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x56298e8561c0 con 0x56298e96bc30 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f184b7fe640 10 client.15309 handle_command_reply: tid=0 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 1 client.15309 shutdown 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 1 -- 172.21.15.70:0/2857492315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 msgr2=0x56298e8faf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8faf90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f18600092a0 tx=0x7f18600057f0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 1 -- 172.21.15.70:0/2857492315 shutdown_connections 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56298e8ef1f0 0x56298e8f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56298e8ea080 0x56298e8f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.80:6838/4099319394,v1:172.21.15.80:6839/4099319394] conn(0x56298e96bc30 0x56298e96a940 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 1 --2- 172.21.15.70:0/2857492315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56298e8e9690 0x56298e8faf90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f184b7fe640 0 client.15309 ms_handle_reset on v2:172.21.15.80:6838/4099319394 2024-04-26T20:27:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 1 -- 172.21.15.70:0/2857492315 >> 172.21.15.70:0/2857492315 conn(0x56298e8e4d00 msgr2=0x56298e8f36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 1 -- 172.21.15.70:0/2857492315 shutdown_connections 2024-04-26T20:27:10.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 1 -- 172.21.15.70:0/2857492315 wait complete. 2024-04-26T20:27:10.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.634+0000 7f187565b740 20 client.15309 trim_cache size 0 max 16384 2024-04-26T20:27:10.642 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:27:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "cc0136ee-0409-11ef-bc93-c7b262605968", 2024-04-26T20:27:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-04-26T20:27:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24488, 2024-04-26T20:27:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-04-26T20:27:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-04-26T20:27:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-04-26T20:27:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 114.635527814, 2024-04-26T20:27:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 24, 2024-04-26T20:27:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2024-04-26T20:27:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2024-04-26T20:27:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 120.429447333 2024-04-26T20:27:10.643 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:27:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 -- 172.21.15.70:0/2859571211 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f18540a3c40 msgr2=0x7f18540a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f18540a3c40 0x7f18540a6100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f18640981d0 tx=0x7f1864096710 comp rx=0 tx=0).stop 2024-04-26T20:27:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 -- 172.21.15.70:0/2859571211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c103f70 msgr2=0x7f186c1a03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c103f70 0x7f186c1a03e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f186400b970 tx=0x7f186400be30 comp rx=0 tx=0).stop 2024-04-26T20:27:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 -- 172.21.15.70:0/2859571211 shutdown_connections 2024-04-26T20:27:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f18540a3c40 0x7f18540a6100 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c103f70 0x7f186c1a03e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f186c1013a0 0x7f186c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 --2- 172.21.15.70:0/2859571211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f186c1009e0 0x7f186c198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 -- 172.21.15.70:0/2859571211 >> 172.21.15.70:0/2859571211 conn(0x7f186c0fc560 msgr2=0x7f186c107080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 -- 172.21.15.70:0/2859571211 shutdown_connections 2024-04-26T20:27:10.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.635+0000 7f1872940640 1 -- 172.21.15.70:0/2859571211 wait complete. 2024-04-26T20:27:10.647 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T20:27:10.656 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T20:27:10.656 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T20:27:10.657 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T20:27:10.657 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-26T20:27:10.657 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T20:27:10.658 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T20:27:10.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-26T20:27:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.755+0000 7ff14c304640 1 -- 172.21.15.70:0/51516655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff144108670 msgr2=0x7ff14410aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.755+0000 7ff14c304640 1 --2- 172.21.15.70:0/51516655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff144108670 0x7ff14410aac0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009ca0 tx=0x7ff13c02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.755+0000 7ff14c304640 1 -- 172.21.15.70:0/51516655 shutdown_connections 2024-04-26T20:27:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.755+0000 7ff14c304640 1 --2- 172.21.15.70:0/51516655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff144108670 0x7ff14410aac0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.755+0000 7ff14c304640 1 --2- 172.21.15.70:0/51516655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff144105d40 0x7ff144108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.755+0000 7ff14c304640 1 --2- 172.21.15.70:0/51516655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff144103410 0x7ff144105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.755+0000 7ff14c304640 1 -- 172.21.15.70:0/51516655 >> 172.21.15.70:0/51516655 conn(0x7ff1440fce00 msgr2=0x7ff1440ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.755+0000 7ff14c304640 1 -- 172.21.15.70:0/51516655 shutdown_connections 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.755+0000 7ff14c304640 1 -- 172.21.15.70:0/51516655 wait complete. 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14c304640 1 Processor -- start 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14c304640 1 -- start start 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14c304640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff144103410 0x7ff144198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14c304640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff144105d40 0x7ff1441991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14c304640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff144108670 0x7ff1441a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14c304640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff14410e610 con 0x7ff144105d40 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14c304640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff14410e490 con 0x7ff144108670 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14c304640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff14410e790 con 0x7ff144103410 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14989f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff144105d40 0x7ff1441991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14989f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff144105d40 0x7ff1441991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36060/0 (socket says 172.21.15.70:36060) 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14989f640 1 -- 172.21.15.70:0/1087323566 learned_addr learned my addr 172.21.15.70:0/1087323566 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14a0a0640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff144103410 0x7ff144198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14a8a1640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff144108670 0x7ff1441a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14989f640 1 -- 172.21.15.70:0/1087323566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff144103410 msgr2=0x7ff144198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14989f640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff144103410 0x7ff144198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14989f640 1 -- 172.21.15.70:0/1087323566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff144108670 msgr2=0x7ff1441a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14989f640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff144108670 0x7ff1441a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.756+0000 7ff14989f640 1 -- 172.21.15.70:0/1087323566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1441a0890 con 0x7ff144105d40 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.757+0000 7ff14a0a0640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff144103410 0x7ff144198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.757+0000 7ff14a8a1640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff144108670 0x7ff1441a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.757+0000 7ff14989f640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff144105d40 0x7ff1441991c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff13400d740 tx=0x7ff13400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.757+0000 7ff13b7fe640 1 -- 172.21.15.70:0/1087323566 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff134017070 con 0x7ff144105d40 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.757+0000 7ff13b7fe640 1 -- 172.21.15.70:0/1087323566 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff13400de50 con 0x7ff144105d40 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.757+0000 7ff14c304640 1 -- 172.21.15.70:0/1087323566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1441a0b80 con 0x7ff144105d40 2024-04-26T20:27:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.757+0000 7ff13b7fe640 1 -- 172.21.15.70:0/1087323566 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff134004d90 con 0x7ff144105d40 2024-04-26T20:27:10.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.757+0000 7ff14c304640 1 -- 172.21.15.70:0/1087323566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1441a1080 con 0x7ff144105d40 2024-04-26T20:27:10.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.758+0000 7ff14c304640 1 -- 172.21.15.70:0/1087323566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1440fe8f0 con 0x7ff144105d40 2024-04-26T20:27:10.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.759+0000 7ff13b7fe640 1 -- 172.21.15.70:0/1087323566 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff134004f30 con 0x7ff144105d40 2024-04-26T20:27:10.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.759+0000 7ff13b7fe640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff1300a3c30 0x7ff1300a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:10.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.759+0000 7ff14a0a0640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff1300a3c30 0x7ff1300a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:10.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.760+0000 7ff13b7fe640 1 -- 172.21.15.70:0/1087323566 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7ff1340d00b0 con 0x7ff144105d40 2024-04-26T20:27:10.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.760+0000 7ff14a0a0640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff1300a3c30 0x7ff1300a60f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff140005fd0 tx=0x7ff140005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:10.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.764+0000 7ff13b7fe640 1 -- 172.21.15.70:0/1087323566 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff13409c920 con 0x7ff144105d40 2024-04-26T20:27:10.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:10 smithi070 ceph-mon[29124]: pgmap v349: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:27:10.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:10 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3389219821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:27:10.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:10 smithi098 ceph-mon[32591]: pgmap v349: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:27:10.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:10 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3389219821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:27:10.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:10 smithi080 ceph-mon[32278]: pgmap v349: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:27:10.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:10 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3389219821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:27:10.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:10.991+0000 7ff14c304640 1 -- 172.21.15.70:0/1087323566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7ff14402dd20 con 0x7ff144105d40 2024-04-26T20:27:11.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.708+0000 7ff13b7fe640 1 -- 172.21.15.70:0/1087323566 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7ff13409c220 con 0x7ff144105d40 2024-04-26T20:27:11.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.711+0000 7ff14c304640 1 -- 172.21.15.70:0/1087323566 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff1300a3c30 msgr2=0x7ff1300a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:11.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.711+0000 7ff14c304640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff1300a3c30 0x7ff1300a60f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff140005fd0 tx=0x7ff140005850 comp rx=0 tx=0).stop 2024-04-26T20:27:11.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.711+0000 7ff14c304640 1 -- 172.21.15.70:0/1087323566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff144105d40 msgr2=0x7ff1441991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:11.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.711+0000 7ff14c304640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff144105d40 0x7ff1441991c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff13400d740 tx=0x7ff13400dc00 comp rx=0 tx=0).stop 2024-04-26T20:27:11.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.711+0000 7ff14c304640 1 -- 172.21.15.70:0/1087323566 shutdown_connections 2024-04-26T20:27:11.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.711+0000 7ff14c304640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7ff1300a3c30 0x7ff1300a60f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:11.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.711+0000 7ff14c304640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff144108670 0x7ff1441a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:11.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.711+0000 7ff14c304640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff144105d40 0x7ff1441991c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:11.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.711+0000 7ff14c304640 1 --2- 172.21.15.70:0/1087323566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff144103410 0x7ff144198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:11.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.711+0000 7ff14c304640 1 -- 172.21.15.70:0/1087323566 >> 172.21.15.70:0/1087323566 conn(0x7ff1440fce00 msgr2=0x7ff144103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:11.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.714+0000 7ff14c304640 1 -- 172.21.15.70:0/1087323566 shutdown_connections 2024-04-26T20:27:11.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.715+0000 7ff14c304640 1 -- 172.21.15.70:0/1087323566 wait complete. 2024-04-26T20:27:11.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-26T20:27:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.857+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2633954669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05b01018b0 msgr2=0x7f05b0101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.857+0000 7f05b4cc4640 1 --2- 172.21.15.70:0/2633954669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05b01018b0 0x7f05b0101cd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009900 tx=0x7f05a002a410 comp rx=0 tx=0).stop 2024-04-26T20:27:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.857+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2633954669 shutdown_connections 2024-04-26T20:27:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.857+0000 7f05b4cc4640 1 --2- 172.21.15.70:0/2633954669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b0103460 0x7f05b0109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.857+0000 7f05b4cc4640 1 --2- 172.21.15.70:0/2633954669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b0102aa0 0x7f05b0102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.857+0000 7f05b4cc4640 1 --2- 172.21.15.70:0/2633954669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05b01018b0 0x7f05b0101cd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.857+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2633954669 >> 172.21.15.70:0/2633954669 conn(0x7f05b00fce40 msgr2=0x7f05b00ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:11.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.857+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2633954669 shutdown_connections 2024-04-26T20:27:11.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.857+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2633954669 wait complete. 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05b4cc4640 1 Processor -- start 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05b4cc4640 1 -- start start 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05b4cc4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b01018b0 0x7f05b006bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05b4cc4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05b0102aa0 0x7f05b019d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05b4cc4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b0103460 0x7f05b01a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05b4cc4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010d560 con 0x7f05b0102aa0 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05b4cc4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010d3e0 con 0x7f05b0103460 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05b4cc4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010d6e0 con 0x7f05b01018b0 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05add9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05b0102aa0 0x7f05b019d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05add9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05b0102aa0 0x7f05b019d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36104/0 (socket says 172.21.15.70:36104) 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05add9b640 1 -- 172.21.15.70:0/2110498111 learned_addr learned my addr 172.21.15.70:0/2110498111 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05ae59c640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b01018b0 0x7f05b006bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05aed9d640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b0103460 0x7f05b01a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05add9b640 1 -- 172.21.15.70:0/2110498111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b01018b0 msgr2=0x7f05b006bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05add9b640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b01018b0 0x7f05b006bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05add9b640 1 -- 172.21.15.70:0/2110498111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b0103460 msgr2=0x7f05b01a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05add9b640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b0103460 0x7f05b01a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.858+0000 7f05add9b640 1 -- 172.21.15.70:0/2110498111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b01a0920 con 0x7f05b0102aa0 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.859+0000 7f05add9b640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05b0102aa0 0x7f05b019d9f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f05a400d950 tx=0x7f05a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.859+0000 7f059f7fe640 1 -- 172.21.15.70:0/2110498111 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4017070 con 0x7f05b0102aa0 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.859+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2110498111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b01a0bb0 con 0x7f05b0102aa0 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.859+0000 7f059f7fe640 1 -- 172.21.15.70:0/2110498111 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f05a4009c30 con 0x7f05b0102aa0 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.859+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2110498111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b01a1100 con 0x7f05b0102aa0 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.859+0000 7f059f7fe640 1 -- 172.21.15.70:0/2110498111 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4020060 con 0x7f05b0102aa0 2024-04-26T20:27:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.860+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2110498111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b0108bd0 con 0x7f05b0102aa0 2024-04-26T20:27:11.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.861+0000 7f059f7fe640 1 -- 172.21.15.70:0/2110498111 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 138714+0+0 (secure 0 0 0) 0x7f05a40109c0 con 0x7f05b0102aa0 2024-04-26T20:27:11.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.861+0000 7f059f7fe640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05980a3c80 0x7f05980a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:11.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.862+0000 7f05ae59c640 1 -- 172.21.15.70:0/2110498111 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05980a3c80 msgr2=0x7f05980a6140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/828657527 2024-04-26T20:27:11.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.862+0000 7f059f7fe640 1 -- 172.21.15.70:0/2110498111 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f05a40d0700 con 0x7f05b0102aa0 2024-04-26T20:27:11.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.862+0000 7f05ae59c640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05980a3c80 0x7f05980a6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:27:11.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:11.865+0000 7f059f7fe640 1 -- 172.21.15.70:0/2110498111 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f05a4009de0 con 0x7f05b0102aa0 2024-04-26T20:27:11.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:11 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1087323566' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T20:27:11.958 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:11 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: ignoring --setuser ceph since I am not root 2024-04-26T20:27:11.958 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:11 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: ignoring --setgroup ceph since I am not root 2024-04-26T20:27:11.958 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:11 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:11.887+0000 7f5c70981200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:27:11.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:11 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1087323566' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T20:27:11.969 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: ignoring --setuser ceph since I am not root 2024-04-26T20:27:11.969 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: ignoring --setgroup ceph since I am not root 2024-04-26T20:27:11.970 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:11 smithi080 ceph-mgr[33663]: -- 172.21.15.80:0/2417227649 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555e2698c5a0 con 0x555e26960800 2024-04-26T20:27:11.970 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:11.890+0000 7f520aeca200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:27:12.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:11 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1087323566' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T20:27:12.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:11 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: ignoring --setuser ceph since I am not root 2024-04-26T20:27:12.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:11 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: ignoring --setgroup ceph since I am not root 2024-04-26T20:27:12.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:11 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:11.918+0000 7ff93a43e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:27:12.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.049+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2110498111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f05b002dad0 con 0x7f05b0102aa0 2024-04-26T20:27:12.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.052+0000 7f059f7fe640 1 -- 172.21.15.70:0/2110498111 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) ==== 138+0+0 (secure 0 0 0) 0x7f05a409c920 con 0x7f05b0102aa0 2024-04-26T20:27:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2110498111 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05980a3c80 msgr2=0x7f05980a6140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:27:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05980a3c80 0x7f05980a6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2110498111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05b0102aa0 msgr2=0x7f05b019d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05b0102aa0 0x7f05b019d9f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f05a400d950 tx=0x7f05a400de10 comp rx=0 tx=0).stop 2024-04-26T20:27:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2110498111 shutdown_connections 2024-04-26T20:27:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f05980a3c80 0x7f05980a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b0103460 0x7f05b01a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05b0102aa0 0x7f05b019d9f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 --2- 172.21.15.70:0/2110498111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b01018b0 0x7f05b006bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2110498111 >> 172.21.15.70:0/2110498111 conn(0x7f05b00fce40 msgr2=0x7f05b0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2110498111 shutdown_connections 2024-04-26T20:27:12.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.054+0000 7f05b4cc4640 1 -- 172.21.15.70:0/2110498111 wait complete. 2024-04-26T20:27:12.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-26T20:27:12.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.166+0000 7fb2ac47b640 1 -- 172.21.15.70:0/3516771089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2a41034b0 msgr2=0x7fb2a41058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:12.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.166+0000 7fb2ac47b640 1 --2- 172.21.15.70:0/3516771089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2a41034b0 0x7fb2a41058a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009900 tx=0x7fb2a002a410 comp rx=0 tx=0).stop 2024-04-26T20:27:12.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.166+0000 7fb2ac47b640 1 -- 172.21.15.70:0/3516771089 shutdown_connections 2024-04-26T20:27:12.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.166+0000 7fb2ac47b640 1 --2- 172.21.15.70:0/3516771089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a4108710 0x7fb2a410ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.166+0000 7fb2ac47b640 1 --2- 172.21.15.70:0/3516771089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2a4105de0 0x7fb2a41081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.166+0000 7fb2ac47b640 1 --2- 172.21.15.70:0/3516771089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2a41034b0 0x7fb2a41058a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.166+0000 7fb2ac47b640 1 -- 172.21.15.70:0/3516771089 >> 172.21.15.70:0/3516771089 conn(0x7fb2a40fce00 msgr2=0x7fb2a40ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.166+0000 7fb2ac47b640 1 -- 172.21.15.70:0/3516771089 shutdown_connections 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.166+0000 7fb2ac47b640 1 -- 172.21.15.70:0/3516771089 wait complete. 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2ac47b640 1 Processor -- start 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2ac47b640 1 -- start start 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2ac47b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2a41034b0 0x7fb2a4198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2ac47b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a4105de0 0x7fb2a41991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2ac47b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2a4108710 0x7fb2a41a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2ac47b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a410e660 con 0x7fb2a41034b0 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2ac47b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a410e4e0 con 0x7fb2a4108710 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2ac47b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a410e7e0 con 0x7fb2a4105de0 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2aa217640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2a41034b0 0x7fb2a4198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2aa217640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2a41034b0 0x7fb2a4198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36132/0 (socket says 172.21.15.70:36132) 2024-04-26T20:27:12.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2aa217640 1 -- 172.21.15.70:0/1648411863 learned_addr learned my addr 172.21.15.70:0/1648411863 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2a9a16640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a4105de0 0x7fb2a41991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2aaa18640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2a4108710 0x7fb2a41a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2aa217640 1 -- 172.21.15.70:0/1648411863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a4105de0 msgr2=0x7fb2a41991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.167+0000 7fb2aa217640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a4105de0 0x7fb2a41991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.168+0000 7fb2aa217640 1 -- 172.21.15.70:0/1648411863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2a4108710 msgr2=0x7fb2a41a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.168+0000 7fb2aa217640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2a4108710 0x7fb2a41a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.168+0000 7fb2aa217640 1 -- 172.21.15.70:0/1648411863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a41a08f0 con 0x7fb2a41034b0 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.168+0000 7fb2aa217640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2a41034b0 0x7fb2a4198cb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0005ab0 tx=0x7fb2a0032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.168+0000 7fb29b7fe640 1 -- 172.21.15.70:0/1648411863 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a003f030 con 0x7fb2a41034b0 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.168+0000 7fb2ac47b640 1 -- 172.21.15.70:0/1648411863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a41a0b80 con 0x7fb2a41034b0 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.168+0000 7fb29b7fe640 1 -- 172.21.15.70:0/1648411863 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2a0003ac0 con 0x7fb2a41034b0 2024-04-26T20:27:12.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.168+0000 7fb29b7fe640 1 -- 172.21.15.70:0/1648411863 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0035070 con 0x7fb2a41034b0 2024-04-26T20:27:12.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.168+0000 7fb2ac47b640 1 -- 172.21.15.70:0/1648411863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a41a10c0 con 0x7fb2a41034b0 2024-04-26T20:27:12.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.169+0000 7fb2ac47b640 1 -- 172.21.15.70:0/1648411863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a40fe8f0 con 0x7fb2a41034b0 2024-04-26T20:27:12.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.170+0000 7fb29b7fe640 1 -- 172.21.15.70:0/1648411863 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 138714+0+0 (secure 0 0 0) 0x7fb2a0042030 con 0x7fb2a41034b0 2024-04-26T20:27:12.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.171+0000 7fb29b7fe640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2900a3c80 0x7fb2900a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:12.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.171+0000 7fb2a9a16640 1 -- 172.21.15.70:0/1648411863 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2900a3c80 msgr2=0x7fb2900a6140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/828657527 2024-04-26T20:27:12.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.171+0000 7fb29b7fe640 1 -- 172.21.15.70:0/1648411863 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7fb2a00f0e90 con 0x7fb2a41034b0 2024-04-26T20:27:12.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.171+0000 7fb2a9a16640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2900a3c80 0x7fb2900a6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:27:12.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.178+0000 7fb29b7fe640 1 -- 172.21.15.70:0/1648411863 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb2a00bd0b0 con 0x7fb2a41034b0 2024-04-26T20:27:12.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.360+0000 7fb2ac47b640 1 -- 172.21.15.70:0/1648411863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fb2a40635a0 con 0x7fb2a41034b0 2024-04-26T20:27:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.364+0000 7fb29b7fe640 1 -- 172.21.15.70:0/1648411863 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7fb2a00c13b0 con 0x7fb2a41034b0 2024-04-26T20:27:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 -- 172.21.15.70:0/1648411863 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2900a3c80 msgr2=0x7fb2900a6140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:27:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2900a3c80 0x7fb2900a6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 -- 172.21.15.70:0/1648411863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2a41034b0 msgr2=0x7fb2a4198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2a41034b0 0x7fb2a4198cb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0005ab0 tx=0x7fb2a0032bc0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 -- 172.21.15.70:0/1648411863 shutdown_connections 2024-04-26T20:27:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7fb2900a3c80 0x7fb2900a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2a4108710 0x7fb2a41a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2a4105de0 0x7fb2a41991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 --2- 172.21.15.70:0/1648411863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2a41034b0 0x7fb2a4198cb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 -- 172.21.15.70:0/1648411863 >> 172.21.15.70:0/1648411863 conn(0x7fb2a40fce00 msgr2=0x7fb2a4103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 -- 172.21.15.70:0/1648411863 shutdown_connections 2024-04-26T20:27:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:12.366+0000 7fb2ac47b640 1 -- 172.21.15.70:0/1648411863 wait complete. 2024-04-26T20:27:12.377 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:12 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:12.107+0000 7ff93a43e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:27:12.377 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:12 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:12.218+0000 7ff93a43e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:27:12.378 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T20:27:12.402 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T20:27:12.402 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-26T20:27:12.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:27:12.402 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-04-26T20:27:12.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:27:12.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-04-26T20:27:12.458 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:12 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:12.073+0000 7f5c70981200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:27:12.458 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:12 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:12.175+0000 7f5c70981200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:27:12.469 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:12 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:12.075+0000 7f520aeca200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:27:12.469 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:12 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:12.175+0000 7f520aeca200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:27:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:Cannot find device "ceph-brx" 2024-04-26T20:27:12.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:27:12.486 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-04-26T20:27:12.486 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T20:27:12.486 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T20:27:12.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-26T20:27:12.710 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:12 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:12.536+0000 7ff93a43e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:27:12.710 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:12 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:12.624+0000 7ff93a43e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:27:12.769 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:27:12.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:12 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1087323566' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T20:27:12.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:12 smithi098 ceph-mon[32591]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-26T20:27:12.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:12 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2110498111' entity='client.admin' 2024-04-26T20:27:12.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:12 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1648411863' entity='client.admin' 2024-04-26T20:27:12.959 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:12 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:12.487+0000 7f5c70981200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:27:12.959 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:12 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:12.572+0000 7f5c70981200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:27:12.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:12 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1087323566' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T20:27:12.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:12 smithi080 ceph-mon[32278]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-26T20:27:12.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:12 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2110498111' entity='client.admin' 2024-04-26T20:27:12.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:12 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1648411863' entity='client.admin' 2024-04-26T20:27:12.970 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:12 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:12.481+0000 7f520aeca200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:27:12.970 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:12 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:12.563+0000 7f520aeca200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:27:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:12 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1087323566' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T20:27:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:12 smithi070 ceph-mon[29124]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-26T20:27:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:12 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2110498111' entity='client.admin' 2024-04-26T20:27:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:12 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1648411863' entity='client.admin' 2024-04-26T20:27:14.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:13 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:13.727+0000 7f520aeca200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:27:14.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:13 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:13.894+0000 7f520aeca200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:27:14.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:14 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:14.062+0000 7f520aeca200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:27:14.092 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:13 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:13.751+0000 7f5c70981200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:27:14.093 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:13 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:13.921+0000 7f5c70981200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:27:14.181 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:13 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:13.832+0000 7ff93a43e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:27:14.181 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:14 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:14.004+0000 7ff93a43e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:27:14.181 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:14 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:14.180+0000 7ff93a43e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:27:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.635+0000 7efc82cbf700 1 -- 172.21.15.70:0/2761580046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c1094b0 msgr2=0x7efc7c109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.635+0000 7efc82cbf700 1 --2- 172.21.15.70:0/2761580046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c1094b0 0x7efc7c109890 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efc70009990 tx=0x7efc70009ca0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.635+0000 7efc82cbf700 1 -- 172.21.15.70:0/2761580046 shutdown_connections 2024-04-26T20:27:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.635+0000 7efc82cbf700 1 --2- 172.21.15.70:0/2761580046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc7c1023b0 0x7efc7c1102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.635+0000 7efc82cbf700 1 --2- 172.21.15.70:0/2761580046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c1094b0 0x7efc7c109890 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.635+0000 7efc82cbf700 1 --2- 172.21.15.70:0/2761580046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c101a10 0x7efc7c101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.635+0000 7efc82cbf700 1 -- 172.21.15.70:0/2761580046 >> 172.21.15.70:0/2761580046 conn(0x7efc7c078990 msgr2=0x7efc7c0ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.635+0000 7efc82cbf700 1 -- 172.21.15.70:0/2761580046 shutdown_connections 2024-04-26T20:27:14.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.635+0000 7efc82cbf700 1 -- 172.21.15.70:0/2761580046 wait complete. 2024-04-26T20:27:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc82cbf700 1 Processor -- start 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc82cbf700 1 -- start start 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc82cbf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc7c101a10 0x7efc7c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc82cbf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c1023b0 0x7efc7c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc82cbf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c1094b0 0x7efc7c1999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc82cbf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1136e0 con 0x7efc7c1094b0 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc82cbf700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c113560 con 0x7efc7c1023b0 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc82cbf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c113860 con 0x7efc7c101a10 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc8125c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c1094b0 0x7efc7c1999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc80a5b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc7c101a10 0x7efc7c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc80a5b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc7c101a10 0x7efc7c19f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.70:45810/0 (socket says 172.21.15.70:45810) 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc8125c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c1094b0 0x7efc7c1999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36152/0 (socket says 172.21.15.70:36152) 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc80a5b700 1 -- 172.21.15.70:0/3872745763 learned_addr learned my addr 172.21.15.70:0/3872745763 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.636+0000 7efc7bfff700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c1023b0 0x7efc7c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc8125c700 1 -- 172.21.15.70:0/3872745763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc7c101a10 msgr2=0x7efc7c19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc8125c700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc7c101a10 0x7efc7c19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc8125c700 1 -- 172.21.15.70:0/3872745763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c1023b0 msgr2=0x7efc7c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc8125c700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c1023b0 0x7efc7c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc8125c700 1 -- 172.21.15.70:0/3872745763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7c19a120 con 0x7efc7c1094b0 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc80a5b700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc7c101a10 0x7efc7c19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc8125c700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c1094b0 0x7efc7c1999c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efc74007f10 tx=0x7efc7400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc79ffb700 1 -- 172.21.15.70:0/3872745763 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74004db0 con 0x7efc7c1094b0 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc82cbf700 1 -- 172.21.15.70:0/3872745763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7c19a410 con 0x7efc7c1094b0 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc79ffb700 1 -- 172.21.15.70:0/3872745763 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efc74003a00 con 0x7efc7c1094b0 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc79ffb700 1 -- 172.21.15.70:0/3872745763 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74004550 con 0x7efc7c1094b0 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.637+0000 7efc82cbf700 1 -- 172.21.15.70:0/3872745763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc7c1a66d0 con 0x7efc7c1094b0 2024-04-26T20:27:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.638+0000 7efc82cbf700 1 -- 172.21.15.70:0/3872745763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7c104d30 con 0x7efc7c1094b0 2024-04-26T20:27:14.641 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:14 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:14.346+0000 7f520aeca200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:27:14.641 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:14 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:14.437+0000 7f520aeca200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:27:14.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.639+0000 7efc79ffb700 1 -- 172.21.15.70:0/3872745763 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 138714+0+0 (secure 0 0 0) 0x7efc7401c020 con 0x7efc7c1094b0 2024-04-26T20:27:14.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.640+0000 7efc79ffb700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efc6c0a3d20 0x7efc6c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:14.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.640+0000 7efc80a5b700 1 -- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efc6c0a3d20 msgr2=0x7efc6c0a61e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/828657527 2024-04-26T20:27:14.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.640+0000 7efc79ffb700 1 -- 172.21.15.70:0/3872745763 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7efc740d0760 con 0x7efc7c1094b0 2024-04-26T20:27:14.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.640+0000 7efc80a5b700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efc6c0a3d20 0x7efc6c0a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:27:14.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.647+0000 7efc79ffb700 1 -- 172.21.15.70:0/3872745763 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7efc74023030 con 0x7efc7c1094b0 2024-04-26T20:27:14.675 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:14.091+0000 7f5c70981200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:27:14.675 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:14.379+0000 7f5c70981200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:27:14.675 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:14.472+0000 7f5c70981200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:27:14.675 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:14.674+0000 7f5c70981200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:27:14.784 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:14 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:14.475+0000 7ff93a43e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:27:14.784 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:14 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:14.571+0000 7ff93a43e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:27:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.841+0000 7efc80a5b700 1 -- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efc6c0a3d20 msgr2=0x7efc6c0a61e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/828657527 2024-04-26T20:27:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.841+0000 7efc80a5b700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efc6c0a3d20 0x7efc6c0a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:27:14.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.899+0000 7efc82cbf700 1 -- 172.21.15.70:0/3872745763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efc7c02e490 con 0x7efc7c1094b0 2024-04-26T20:27:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.900+0000 7efc79ffb700 1 -- 172.21.15.70:0/3872745763 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7efc74010070 con 0x7efc7c1094b0 2024-04-26T20:27:14.901 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T20:27:14.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 -- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efc6c0a3d20 msgr2=0x7efc6c0a61e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:27:14.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efc6c0a3d20 0x7efc6c0a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 -- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c1094b0 msgr2=0x7efc7c1999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:14.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c1094b0 0x7efc7c1999c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efc74007f10 tx=0x7efc7400d3b0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 -- 172.21.15.70:0/3872745763 shutdown_connections 2024-04-26T20:27:14.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7efc6c0a3d20 0x7efc6c0a61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c1094b0 0x7efc7c1999c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc7c101a10 0x7efc7c19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 --2- 172.21.15.70:0/3872745763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c1023b0 0x7efc7c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:14.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 -- 172.21.15.70:0/3872745763 >> 172.21.15.70:0/3872745763 conn(0x7efc7c078990 msgr2=0x7efc7c100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:14.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 -- 172.21.15.70:0/3872745763 shutdown_connections 2024-04-26T20:27:14.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:14.902+0000 7efc82cbf700 1 -- 172.21.15.70:0/3872745763 wait complete. 2024-04-26T20:27:14.952 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:14.867+0000 7f5c70981200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:27:14.952 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:14 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:14.636+0000 7f520aeca200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:27:14.953 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:14 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:14.828+0000 7f520aeca200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:27:15.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:14 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3872745763' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T20:27:15.218 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:14 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3872745763' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T20:27:15.219 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:14 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:14.784+0000 7ff93a43e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:27:15.219 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:14 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:14.992+0000 7ff93a43e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:27:15.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:14 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3872745763' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T20:27:15.542 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T20:27:15.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:27:15.543 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2024-04-26T20:27:15.543 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T20:27:15.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T20:27:15.543 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T20:27:15.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T20:27:15.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:27:15.543 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:27:15.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:27:15.543 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2024-04-26T20:27:15.559 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:27:15.559 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:27:15.559 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:27:15.560 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T20:27:15.561 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42075sec preferred_lft 42075sec 2024-04-26T20:27:15.561 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::2ea7:886d:22e:bb6f/64 scope link noprefixroute 2024-04-26T20:27:15.561 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:27:15.561 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T20:27:15.561 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:27:15.561 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-04-26T20:27:15.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2024-04-26T20:27:15.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2024-04-26T20:27:15.562 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2024-04-26T20:27:15.562 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T20:27:15.562 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-04-26T20:27:15.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:27:15.719 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:15.423+0000 7f520aeca200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:27:15.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:27:15.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:27:15.764 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:27:15.775 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:15 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:15.609+0000 7ff93a43e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:27:15.787 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-04-26T20:27:15.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:27:15.789 DEBUG:teuthology.orchestra.run.smithi070:> route 2024-04-26T20:27:15.868 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2024-04-26T20:27:15.868 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:27:15.868 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T20:27:15.868 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T20:27:15.868 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:27:15.869 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:27:15.869 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-04-26T20:27:15.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T20:27:15.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T20:27:15.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T20:27:15.869 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-04-26T20:27:15.898 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:15.474+0000 7f5c70981200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:27:15.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:27:16.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:27:16.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:27:16.138 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-04-26T20:27:16.139 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:15.839+0000 7f520aeca200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:27:16.139 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:15.936+0000 7f520aeca200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:27:16.139 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:16 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:16.137+0000 7f520aeca200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:27:16.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:27:16.154 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2024-04-26T20:27:16.200 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:15.897+0000 7f5c70981200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:27:16.200 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:15.996+0000 7f5c70981200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:27:16.200 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:16 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:16.199+0000 7f5c70981200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:27:16.208 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:27:16.209 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-04-26T20:27:16.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T20:27:16.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T20:27:16.209 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-04-26T20:27:16.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:27:16.304 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:16 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:16.067+0000 7ff93a43e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:27:16.305 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:16 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:16.172+0000 7ff93a43e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:27:16.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:27:16.325 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T20:27:16.326 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:27:16.326 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-04-26T20:27:16.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T20:27:16.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T20:27:16.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T20:27:16.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T20:27:16.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T20:27:16.326 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-04-26T20:27:16.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:27:16.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:27:16.450 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:27:16.450 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-04-26T20:27:16.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2024-04-26T20:27:16.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T20:27:16.450 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-04-26T20:27:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:27:16.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:27:16.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:27:16.529 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T20:27:16.543 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:27:16.544 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:27:16.544 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:27:16.598 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-26T20:27:16.599 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-26T20:27:16.599 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/a3f80044-8f15-4eae-ab09-8a4de526b198 2024-04-26T20:27:16.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:27:16.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/a3f80044-8f15-4eae-ab09-8a4de526b198 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-04-26T20:27:16.659 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:16 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:16.388+0000 7ff93a43e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:27:16.688 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-04-26T20:27:16.688 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-04-26T20:27:16.688 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-04-26T20:27:16.784 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-04-26T20:27:16.784 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-04-26T20:27:16.784 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-04-26T20:27:16.784 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:6789,172.21.15.80:6789,172.21.15.98:6789" 2024-04-26T20:27:16.784 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.70:6789,172.21.15.80:6789,172.21.15.98:6789:/volumes/qa/sv_1/a3f80044-8f15-4eae-ab09-8a4de526b198 2024-04-26T20:27:16.784 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=cc0136ee-0409-11ef-bc93-c7b262605968" will pass to kernel 2024-04-26T20:27:16.785 INFO:teuthology.orchestra.run.smithi070.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T20:27:16.785 INFO:teuthology.orchestra.run.smithi070.stdout: You just mounted a file system that supports labels which does not 2024-04-26T20:27:16.785 INFO:teuthology.orchestra.run.smithi070.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T20:27:16.785 INFO:teuthology.orchestra.run.smithi070.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T20:27:16.785 INFO:teuthology.orchestra.run.smithi070.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T20:27:16.787 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T20:27:16.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:27:16.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:27:16.852 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:27:16.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:27:16.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:27:16.950 INFO:teuthology.orchestra.run.smithi070.stdout:client15354 2024-04-26T20:27:16.950 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:27:16.950 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:27:16.967 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:27:16.969 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:16 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:16.652+0000 7f520aeca200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:27:16.969 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:16 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:16.742+0000 7f520aeca200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:27:17.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:27:17.056 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:16 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:16.719+0000 7f5c70981200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:27:17.057 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:16 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:16.811+0000 7f5c70981200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:27:17.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:27:17.064 INFO:teuthology.orchestra.run.smithi070.stdout:client15354 2024-04-26T20:27:17.064 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:27:17.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:27:17.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:27:17.121 INFO:teuthology.orchestra.run.smithi070.stdout:client15354 2024-04-26T20:27:17.121 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/cc0136ee-0409-11ef-bc93-c7b262605968.client15354/status') 2024-04-26T20:27:17.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:27:17.180 INFO:teuthology.orchestra.run.smithi070.stdout:instance: client.15354 (3)192.168.0.1:0/529748136 2024-04-26T20:27:17.180 INFO:teuthology.orchestra.run.smithi070.stdout:blocklisted: false 2024-04-26T20:27:17.180 INFO:teuthology.orchestra.run.smithi070.stderr:0+1 records in 2024-04-26T20:27:17.181 INFO:teuthology.orchestra.run.smithi070.stderr:0+1 records out 2024-04-26T20:27:17.181 INFO:teuthology.orchestra.run.smithi070.stderr:69 bytes copied, 3.6891e-05 s, 1.9 MB/s 2024-04-26T20:27:17.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:27:17.189 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T20:27:17.197 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T20:27:17.198 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T20:27:17.198 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-04-26T20:27:17.204 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:16 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:16.941+0000 7ff93a43e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:27:17.204 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:17 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:17.041+0000 7ff93a43e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:27:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.300+0000 7f9753f9d640 1 -- 172.21.15.70:0/3194497339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f974c101890 msgr2=0x7f974c101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.300+0000 7f9753f9d640 1 --2- 172.21.15.70:0/3194497339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f974c101890 0x7f974c101cb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9740009900 tx=0x7f974002a410 comp rx=0 tx=0).stop 2024-04-26T20:27:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.300+0000 7f9753f9d640 1 -- 172.21.15.70:0/3194497339 shutdown_connections 2024-04-26T20:27:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.300+0000 7f9753f9d640 1 --2- 172.21.15.70:0/3194497339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f974c103440 0x7f974c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.300+0000 7f9753f9d640 1 --2- 172.21.15.70:0/3194497339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f974c102a80 0x7f974c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.300+0000 7f9753f9d640 1 --2- 172.21.15.70:0/3194497339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f974c101890 0x7f974c101cb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.300+0000 7f9753f9d640 1 -- 172.21.15.70:0/3194497339 >> 172.21.15.70:0/3194497339 conn(0x7f974c0fce00 msgr2=0x7f974c0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.300+0000 7f9753f9d640 1 -- 172.21.15.70:0/3194497339 shutdown_connections 2024-04-26T20:27:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.300+0000 7f9753f9d640 1 -- 172.21.15.70:0/3194497339 wait complete. 2024-04-26T20:27:17.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.300+0000 7f9753f9d640 1 Processor -- start 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.300+0000 7f9753f9d640 1 -- start start 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9753f9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f974c101890 0x7f974c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9753f9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f974c102a80 0x7f974c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9753f9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f974c103440 0x7f974c1a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9753f9d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f974c10e600 con 0x7f974c101890 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9753f9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f974c10e480 con 0x7f974c102a80 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9753f9d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f974c10e780 con 0x7f974c103440 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9751d39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f974c101890 0x7f974c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9751d39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f974c101890 0x7f974c198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36180/0 (socket says 172.21.15.70:36180) 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9751d39640 1 -- 172.21.15.70:0/1711617551 learned_addr learned my addr 172.21.15.70:0/1711617551 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f975253a640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f974c103440 0x7f974c1a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9751538640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f974c102a80 0x7f974c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9751d39640 1 -- 172.21.15.70:0/1711617551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f974c103440 msgr2=0x7f974c1a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9751d39640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f974c103440 0x7f974c1a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9751d39640 1 -- 172.21.15.70:0/1711617551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f974c102a80 msgr2=0x7f974c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:17.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9751d39640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f974c102a80 0x7f974c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9751d39640 1 -- 172.21.15.70:0/1711617551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c1a0930 con 0x7f974c101890 2024-04-26T20:27:17.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f9751d39640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f974c101890 0x7f974c198d70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9740006010 tx=0x7f97400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:17.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.301+0000 7f973effd640 1 -- 172.21.15.70:0/1711617551 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974003f030 con 0x7f974c101890 2024-04-26T20:27:17.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.302+0000 7f9753f9d640 1 -- 172.21.15.70:0/1711617551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974c1a0bc0 con 0x7f974c101890 2024-04-26T20:27:17.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.302+0000 7f973effd640 1 -- 172.21.15.70:0/1711617551 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9740003cd0 con 0x7f974c101890 2024-04-26T20:27:17.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.302+0000 7f973effd640 1 -- 172.21.15.70:0/1711617551 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740035070 con 0x7f974c101890 2024-04-26T20:27:17.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.302+0000 7f9753f9d640 1 -- 172.21.15.70:0/1711617551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974c1a10b0 con 0x7f974c101890 2024-04-26T20:27:17.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.303+0000 7f9753f9d640 1 -- 172.21.15.70:0/1711617551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f974c108cd0 con 0x7f974c101890 2024-04-26T20:27:17.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.304+0000 7f973effd640 1 -- 172.21.15.70:0/1711617551 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 138714+0+0 (secure 0 0 0) 0x7f9740042030 con 0x7f974c101890 2024-04-26T20:27:17.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.304+0000 7f973effd640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f97380a3c80 0x7f97380a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:17.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.304+0000 7f9751538640 1 -- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f97380a3c80 msgr2=0x7f97380a6140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/828657527 2024-04-26T20:27:17.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.304+0000 7f973effd640 1 -- 172.21.15.70:0/1711617551 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f97400f0e90 con 0x7f974c101890 2024-04-26T20:27:17.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.304+0000 7f9751538640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f97380a3c80 0x7f97380a6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:27:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.308+0000 7f973effd640 1 -- 172.21.15.70:0/1711617551 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f97400bd0b0 con 0x7f974c101890 2024-04-26T20:27:17.322 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:16 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:16.982+0000 7f520aeca200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:27:17.322 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:17 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:17.113+0000 7f520aeca200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:27:17.322 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:17 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:17.207+0000 7f520aeca200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:27:17.322 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:17 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:17.321+0000 7f520aeca200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:27:17.402 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:17.055+0000 7f5c70981200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:27:17.402 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:17.190+0000 7f5c70981200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:27:17.402 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:17.285+0000 7f5c70981200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:27:17.402 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:17.400+0000 7f5c70981200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:27:17.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.505+0000 7f9751538640 1 -- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f97380a3c80 msgr2=0x7f97380a6140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/828657527 2024-04-26T20:27:17.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.505+0000 7f9751538640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f97380a3c80 0x7f97380a6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:27:17.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.532+0000 7f9753f9d640 1 -- 172.21.15.70:0/1711617551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f974c02dcf0 con 0x7f974c101890 2024-04-26T20:27:17.534 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:17 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:17.311+0000 7ff93a43e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:27:17.534 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:17 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:17.450+0000 7ff93a43e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:27:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.584+0000 7f973effd640 1 -- 172.21.15.70:0/1711617551 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f97400c13b0 con 0x7f974c101890 2024-04-26T20:27:17.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 -- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f97380a3c80 msgr2=0x7f97380a6140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:27:17.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f97380a3c80 0x7f97380a6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 -- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f974c101890 msgr2=0x7f974c198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:17.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f974c101890 0x7f974c198d70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9740006010 tx=0x7f97400042f0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 -- 172.21.15.70:0/1711617551 shutdown_connections 2024-04-26T20:27:17.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f97380a3c80 0x7f97380a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f974c103440 0x7f974c1a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f974c102a80 0x7f974c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 --2- 172.21.15.70:0/1711617551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f974c101890 0x7f974c198d70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 -- 172.21.15.70:0/1711617551 >> 172.21.15.70:0/1711617551 conn(0x7f974c0fce00 msgr2=0x7f974c105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:17.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 -- 172.21.15.70:0/1711617551 shutdown_connections 2024-04-26T20:27:17.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.587+0000 7f9753f9d640 1 -- 172.21.15.70:0/1711617551 wait complete. 2024-04-26T20:27:17.600 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-26T20:27:17.611 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T20:27:17.619 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T20:27:17.619 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T20:27:17.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-26T20:27:17.704 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:17 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1711617551' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T20:27:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.743+0000 7f11bdc15640 1 -- 172.21.15.70:0/3858005009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11b8105da0 msgr2=0x7f11b8108190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.743+0000 7f11bdc15640 1 --2- 172.21.15.70:0/3858005009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11b8105da0 0x7f11b8108190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009900 tx=0x7f11a802a410 comp rx=0 tx=0).stop 2024-04-26T20:27:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.743+0000 7f11bdc15640 1 -- 172.21.15.70:0/3858005009 shutdown_connections 2024-04-26T20:27:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.743+0000 7f11bdc15640 1 --2- 172.21.15.70:0/3858005009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11b81086d0 0x7f11b810aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.743+0000 7f11bdc15640 1 --2- 172.21.15.70:0/3858005009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11b8105da0 0x7f11b8108190 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.743+0000 7f11bdc15640 1 --2- 172.21.15.70:0/3858005009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11b8103470 0x7f11b8105860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.743+0000 7f11bdc15640 1 -- 172.21.15.70:0/3858005009 >> 172.21.15.70:0/3858005009 conn(0x7f11b80fce00 msgr2=0x7f11b80ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.743+0000 7f11bdc15640 1 -- 172.21.15.70:0/3858005009 shutdown_connections 2024-04-26T20:27:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.743+0000 7f11bdc15640 1 -- 172.21.15.70:0/3858005009 wait complete. 2024-04-26T20:27:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11bdc15640 1 Processor -- start 2024-04-26T20:27:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11bdc15640 1 -- start start 2024-04-26T20:27:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11bdc15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11b8103470 0x7f11b8102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11bdc15640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11b8105da0 0x7f11b8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11bdc15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11b81086d0 0x7f11b8101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11bdc15640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f11b810e5f0 con 0x7f11b81086d0 2024-04-26T20:27:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11bdc15640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f11b810e470 con 0x7f11b8103470 2024-04-26T20:27:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11bdc15640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f11b810e770 con 0x7f11b8105da0 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11b6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11b8105da0 0x7f11b8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11b81086d0 0x7f11b8101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11b6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11b8105da0 0x7f11b8101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.70:45852/0 (socket says 172.21.15.70:45852) 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11b6ffd640 1 -- 172.21.15.70:0/3411666683 learned_addr learned my addr 172.21.15.70:0/3411666683 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.744+0000 7f11b77fe640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11b8103470 0x7f11b8102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11b6ffd640 1 -- 172.21.15.70:0/3411666683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11b8103470 msgr2=0x7f11b8102de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11b6ffd640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f11b8103470 0x7f11b8102de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11b6ffd640 1 -- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11b81086d0 msgr2=0x7f11b8101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11b6ffd640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11b81086d0 0x7f11b8101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11b6ffd640 1 -- 172.21.15.70:0/3411666683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b81021f0 con 0x7f11b8105da0 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11b7fff640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11b81086d0 0x7f11b8101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11b6ffd640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11b8105da0 0x7f11b8101420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f11a8006010 tx=0x7f11a80042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a803f030 con 0x7f11b8105da0 2024-04-26T20:27:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11bdc15640 1 -- 172.21.15.70:0/3411666683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b81a2d80 con 0x7f11b8105da0 2024-04-26T20:27:17.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11a8003cd0 con 0x7f11b8105da0 2024-04-26T20:27:17.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8035070 con 0x7f11b8105da0 2024-04-26T20:27:17.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.745+0000 7f11bdc15640 1 -- 172.21.15.70:0/3411666683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b81a3210 con 0x7f11b8105da0 2024-04-26T20:27:17.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.746+0000 7f11bdc15640 1 -- 172.21.15.70:0/3411666683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b80fe8f0 con 0x7f11b8105da0 2024-04-26T20:27:17.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.747+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138714+0+0 (secure 0 0 0) 0x7f11a8042030 con 0x7f11b8105da0 2024-04-26T20:27:17.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.748+0000 7f11b4ff9640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11a00a3c80 0x7f11a00a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:17.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.748+0000 7f11b77fe640 1 -- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11a00a3c80 msgr2=0x7f11a00a6140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/828657527 2024-04-26T20:27:17.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.748+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8248+0+0 (secure 0 0 0) 0x7f11a8070080 con 0x7f11b8105da0 2024-04-26T20:27:17.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.748+0000 7f11b77fe640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11a00a3c80 0x7f11a00a6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:27:17.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.751+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f11a80bcdf0 con 0x7f11b8105da0 2024-04-26T20:27:17.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.949+0000 7f11b77fe640 1 -- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11a00a3c80 msgr2=0x7f11a00a6140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/828657527 2024-04-26T20:27:17.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.949+0000 7f11b77fe640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11a00a3c80 0x7f11a00a6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:27:17.958 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:17.703+0000 7f5c70981200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:27:17.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:17.960+0000 7f11bdc15640 1 -- 172.21.15.70:0/3411666683 --> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f11b8062d70 con 0x7f11a00a3c80 2024-04-26T20:27:17.969 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:17 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:17.618+0000 7f520aeca200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:27:17.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:17 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1711617551' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T20:27:17.992 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:17 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1711617551' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T20:27:17.992 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:17 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:17.552+0000 7ff93a43e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:27:17.993 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:17 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:17.676+0000 7ff93a43e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:27:17.993 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:17 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:17.991+0000 7ff93a43e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:27:18.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:18.350+0000 7f11b77fe640 1 -- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11a00a3c80 msgr2=0x7f11a00a6140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/828657527 2024-04-26T20:27:18.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:18.350+0000 7f11b77fe640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11a00a3c80 0x7f11a00a6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T20:27:18.469 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:18.211+0000 7f520aeca200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:27:18.469 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y[33659]: 2024-04-26T20:27:18.423+0000 7f520aeca200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:27:18.591 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:18.309+0000 7f5c70981200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:27:18.591 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z[34455]: 2024-04-26T20:27:18.526+0000 7f5c70981200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:27:18.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:18.603+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 19) ==== 138714+0+0 (secure 0 0 0) 0x7f11a80b9460 con 0x7f11b8105da0 2024-04-26T20:27:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:18.844+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 <== mon.1 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 20) ==== 138331+0+0 (secure 0 0 0) 0x7f11a80ee7c0 con 0x7f11b8105da0 2024-04-26T20:27:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:18.844+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11a00a3c80 msgr2=0x7f11a00a6140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:27:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:18.844+0000 7f11b4ff9640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/828657527,v1:172.21.15.70:6801/828657527] conn(0x7f11a00a3c80 0x7f11a00a6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:18.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1711617551' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T20:27:18.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:27:18.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: Standby manager daemon y restarted 2024-04-26T20:27:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: Standby manager daemon y started 2024-04-26T20:27:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T20:27:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:27:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T20:27:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:27:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: Standby manager daemon z restarted 2024-04-26T20:27:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: Standby manager daemon z started 2024-04-26T20:27:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T20:27:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:27:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T20:27:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:18 smithi098 ceph-mon[32591]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:27:18.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1711617551' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: Standby manager daemon y restarted 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: Standby manager daemon y started 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: Standby manager daemon z restarted 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: Standby manager daemon z started 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T20:27:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:18 smithi080 ceph-mon[32278]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:27:19.010 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1711617551' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: Standby manager daemon y restarted 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: Standby manager daemon y started 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.80:0/445190242' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: Standby manager daemon z restarted 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: Standby manager daemon z started 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T20:27:19.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-mon[29124]: from='mgr.? 172.21.15.98:0/2033081796' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:27:19.012 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:18.605+0000 7ff93a43e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:27:19.012 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:18 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:18.829+0000 7ff93a43e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:27:19.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:19.088+0000 7ff89c5df700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:19.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:19.088+0000 7ff89c5df700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:19.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:19.088+0000 7ff89c5df700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:19.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:19.088+0000 7ff89c5df700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:19.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:19.088+0000 7ff89c5df700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:19.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:19.091+0000 7ff8995d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:19.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:19.091+0000 7ff8995d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:19.285 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:19.091+0000 7ff8995d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:19.286 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:19.091+0000 7ff8995d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:19.286 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:27:19.091+0000 7ff8995d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:19.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.848+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 <== mon.1 v2:172.21.15.98:3300/0 9 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f11a80c4010 con 0x7f11b8105da0 2024-04-26T20:27:19.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.849+0000 7f11b4ff9640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f11a0035260 0x7f11a0035640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:19.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.849+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 --> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f11a8042ec0 con 0x7f11a0035260 2024-04-26T20:27:19.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.852+0000 7f11b77fe640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f11a0035260 0x7f11a0035640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:19.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.853+0000 7f11b77fe640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f11a0035260 0x7f11a0035640 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0097f0 tx=0x7f11ac005f90 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:19.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.917+0000 7f11b4ff9640 1 -- 172.21.15.70:0/3411666683 <== mgr.15333 v2:172.21.15.70:6800/212113189 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f11a8042ec0 con 0x7f11a0035260 2024-04-26T20:27:19.917 INFO:teuthology.orchestra.run.smithi070.stdout:Schedule set for path / 2024-04-26T20:27:19.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.918+0000 7f11bdc15640 1 -- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f11a0035260 msgr2=0x7f11a0035640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:19.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.918+0000 7f11bdc15640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f11a0035260 0x7f11a0035640 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0097f0 tx=0x7f11ac005f90 comp rx=0 tx=0).stop 2024-04-26T20:27:19.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.918+0000 7f11bdc15640 1 -- 172.21.15.70:0/3411666683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11b8105da0 msgr2=0x7f11b8101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:19.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.919+0000 7f11bdc15640 1 --2- 172.21.15.70:0/3411666683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11b8105da0 0x7f11b8101420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f11a8006010 tx=0x7f11a80042f0 comp rx=0 tx=0).stop 2024-04-26T20:27:19.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.919+0000 7f11b7fff640 1 -- 172.21.15.70:0/3411666683 reap_dead start 2024-04-26T20:27:19.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.919+0000 7f11bdc15640 1 -- 172.21.15.70:0/3411666683 shutdown_connections 2024-04-26T20:27:19.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.919+0000 7f11bdc15640 1 -- 172.21.15.70:0/3411666683 >> 172.21.15.70:0/3411666683 conn(0x7f11b80fce00 msgr2=0x7f11b8103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:19.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.919+0000 7f11bdc15640 1 -- 172.21.15.70:0/3411666683 shutdown_connections 2024-04-26T20:27:19.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:19.919+0000 7f11bdc15640 1 -- 172.21.15.70:0/3411666683 wait complete. 2024-04-26T20:27:19.930 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-26T20:27:19.930 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: Active manager daemon x restarted 2024-04-26T20:27:19.930 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: Activating manager daemon x 2024-04-26T20:27:19.930 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T20:27:19.930 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: mgrmap e20: x(active, starting, since 0.011861s), standbys: z, y 2024-04-26T20:27:19.930 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:27:19.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:27:19.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:27:19.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:27:19.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:27:19.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:27:19.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: Manager daemon x is now available 2024-04-26T20:27:19.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:19.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:27:19.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:27:19.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:27:19.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:19 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:27:19.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: Active manager daemon x restarted 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: Activating manager daemon x 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: mgrmap e20: x(active, starting, since 0.011861s), standbys: z, y 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:27:19.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:27:19.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: Manager daemon x is now available 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:19.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:27:19.962 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:27:19.962 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:27:19.962 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:19 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:27:19.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-26T20:27:19.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: Active manager daemon x restarted 2024-04-26T20:27:19.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: Activating manager daemon x 2024-04-26T20:27:19.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T20:27:19.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: mgrmap e20: x(active, starting, since 0.011861s), standbys: z, y 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:27:19.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:27:19.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:27:19.973 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:27:19.973 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:27:19.973 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:27:19.973 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:27:19.973 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: Manager daemon x is now available 2024-04-26T20:27:19.973 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:19.973 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:27:19.973 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:27:19.973 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:27:19.973 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:19 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:27:20.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.037+0000 7fe86459d640 1 -- 172.21.15.70:0/958146707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c101890 msgr2=0x7fe85c101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.037+0000 7fe86459d640 1 --2- 172.21.15.70:0/958146707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c101890 0x7fe85c101cb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe858009900 tx=0x7fe85802a410 comp rx=0 tx=0).stop 2024-04-26T20:27:20.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.037+0000 7fe86459d640 1 -- 172.21.15.70:0/958146707 shutdown_connections 2024-04-26T20:27:20.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.037+0000 7fe86459d640 1 --2- 172.21.15.70:0/958146707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe85c103440 0x7fe85c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.037+0000 7fe86459d640 1 --2- 172.21.15.70:0/958146707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe85c102a80 0x7fe85c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.037+0000 7fe86459d640 1 --2- 172.21.15.70:0/958146707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c101890 0x7fe85c101cb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.037+0000 7fe86459d640 1 -- 172.21.15.70:0/958146707 >> 172.21.15.70:0/958146707 conn(0x7fe85c0fce00 msgr2=0x7fe85c0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:20.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.037+0000 7fe86459d640 1 -- 172.21.15.70:0/958146707 shutdown_connections 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.037+0000 7fe86459d640 1 -- 172.21.15.70:0/958146707 wait complete. 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe86459d640 1 Processor -- start 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe86459d640 1 -- start start 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe86459d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c101890 0x7fe85c06acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe86459d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe85c102a80 0x7fe85c19da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe86459d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe85c103440 0x7fe85c1a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe86459d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c10d4f0 con 0x7fe85c101890 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe86459d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c10d370 con 0x7fe85c103440 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe86459d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c10d670 con 0x7fe85c102a80 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe862339640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c101890 0x7fe85c06acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe862339640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c101890 0x7fe85c06acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53986/0 (socket says 172.21.15.70:53986) 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe862339640 1 -- 172.21.15.70:0/1496349162 learned_addr learned my addr 172.21.15.70:0/1496349162 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe862b3a640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe85c103440 0x7fe85c1a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe861b38640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe85c102a80 0x7fe85c19da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe862339640 1 -- 172.21.15.70:0/1496349162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe85c102a80 msgr2=0x7fe85c19da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe862339640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe85c102a80 0x7fe85c19da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe862339640 1 -- 172.21.15.70:0/1496349162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe85c103440 msgr2=0x7fe85c1a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe862339640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe85c103440 0x7fe85c1a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe862339640 1 -- 172.21.15.70:0/1496349162 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c1a0970 con 0x7fe85c101890 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.038+0000 7fe861b38640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe85c102a80 0x7fe85c19da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.039+0000 7fe862339640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c101890 0x7fe85c06acc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe858006010 tx=0x7fe8580043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.039+0000 7fe8537fe640 1 -- 172.21.15.70:0/1496349162 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85803f030 con 0x7fe85c101890 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.039+0000 7fe86459d640 1 -- 172.21.15.70:0/1496349162 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85c1a0ba0 con 0x7fe85c101890 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.039+0000 7fe8537fe640 1 -- 172.21.15.70:0/1496349162 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe858003cd0 con 0x7fe85c101890 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.039+0000 7fe8537fe640 1 -- 172.21.15.70:0/1496349162 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858035070 con 0x7fe85c101890 2024-04-26T20:27:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.039+0000 7fe86459d640 1 -- 172.21.15.70:0/1496349162 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85c1a10e0 con 0x7fe85c101890 2024-04-26T20:27:20.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.040+0000 7fe86459d640 1 -- 172.21.15.70:0/1496349162 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85c108cc0 con 0x7fe85c101890 2024-04-26T20:27:20.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.041+0000 7fe8537fe640 1 -- 172.21.15.70:0/1496349162 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7fe858042030 con 0x7fe85c101890 2024-04-26T20:27:20.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.041+0000 7fe8537fe640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fe8480a3990 0x7fe8480a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.041+0000 7fe861b38640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fe8480a3990 0x7fe8480a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.041+0000 7fe8537fe640 1 -- 172.21.15.70:0/1496349162 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8549+0+0 (secure 0 0 0) 0x7fe8580f08d0 con 0x7fe85c101890 2024-04-26T20:27:20.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.042+0000 7fe861b38640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fe8480a3990 0x7fe8480a5e50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe85c06aa30 tx=0x7fe84c005d30 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:20.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.046+0000 7fe8537fe640 1 -- 172.21.15.70:0/1496349162 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fe8580bd460 con 0x7fe85c101890 2024-04-26T20:27:20.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.262+0000 7fe86459d640 1 -- 172.21.15.70:0/1496349162 --> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fe85c062ed0 con 0x7fe8480a3990 2024-04-26T20:27:20.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.318+0000 7fe8537fe640 1 -- 172.21.15.70:0/1496349162 <== mgr.15333 v2:172.21.15.70:6800/212113189 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fe85c062ed0 con 0x7fe8480a3990 2024-04-26T20:27:20.319 INFO:teuthology.orchestra.run.smithi070.stdout:Retention added to path / 2024-04-26T20:27:20.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 -- 172.21.15.70:0/1496349162 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fe8480a3990 msgr2=0x7fe8480a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fe8480a3990 0x7fe8480a5e50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe85c06aa30 tx=0x7fe84c005d30 comp rx=0 tx=0).stop 2024-04-26T20:27:20.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 -- 172.21.15.70:0/1496349162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c101890 msgr2=0x7fe85c06acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c101890 0x7fe85c06acc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe858006010 tx=0x7fe8580043b0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 -- 172.21.15.70:0/1496349162 shutdown_connections 2024-04-26T20:27:20.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fe8480a3990 0x7fe8480a5e50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe85c103440 0x7fe85c1a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe85c102a80 0x7fe85c19da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 --2- 172.21.15.70:0/1496349162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c101890 0x7fe85c06acc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 -- 172.21.15.70:0/1496349162 >> 172.21.15.70:0/1496349162 conn(0x7fe85c0fce00 msgr2=0x7fe85c105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:20.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 -- 172.21.15.70:0/1496349162 shutdown_connections 2024-04-26T20:27:20.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.320+0000 7fe86459d640 1 -- 172.21.15.70:0/1496349162 wait complete. 2024-04-26T20:27:20.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-26T20:27:20.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.434+0000 7f283543f640 1 -- 172.21.15.70:0/3394895585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28301029a0 msgr2=0x7f2830102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.434+0000 7f283543f640 1 --2- 172.21.15.70:0/3394895585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28301029a0 0x7f2830102dc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2820009900 tx=0x7f282002a410 comp rx=0 tx=0).stop 2024-04-26T20:27:20.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.434+0000 7f283543f640 1 -- 172.21.15.70:0/3394895585 shutdown_connections 2024-04-26T20:27:20.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.434+0000 7f283543f640 1 --2- 172.21.15.70:0/3394895585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2830104550 0x7f283010ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.434+0000 7f283543f640 1 --2- 172.21.15.70:0/3394895585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2830103b90 0x7f2830104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.434+0000 7f283543f640 1 --2- 172.21.15.70:0/3394895585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28301029a0 0x7f2830102dc0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.434+0000 7f283543f640 1 -- 172.21.15.70:0/3394895585 >> 172.21.15.70:0/3394895585 conn(0x7f28300fdf50 msgr2=0x7f2830100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.434+0000 7f283543f640 1 -- 172.21.15.70:0/3394895585 shutdown_connections 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.434+0000 7f283543f640 1 -- 172.21.15.70:0/3394895585 wait complete. 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.434+0000 7f283543f640 1 Processor -- start 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.434+0000 7f283543f640 1 -- start start 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f283543f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28301029a0 0x7f28300766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f283543f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2830103b90 0x7f2830074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f283543f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2830104550 0x7f2830075260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f283543f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f283010e600 con 0x7f28301029a0 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f283543f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f283010e480 con 0x7f2830103b90 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f283543f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f283010e780 con 0x7f2830104550 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28301029a0 0x7f28300766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28301029a0 0x7f28300766e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54002/0 (socket says 172.21.15.70:54002) 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282effd640 1 -- 172.21.15.70:0/119410509 learned_addr learned my addr 172.21.15.70:0/119410509 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282f7fe640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2830104550 0x7f2830075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f2827fff640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2830103b90 0x7f2830074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282effd640 1 -- 172.21.15.70:0/119410509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2830104550 msgr2=0x7f2830075260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282effd640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2830104550 0x7f2830075260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282effd640 1 -- 172.21.15.70:0/119410509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2830103b90 msgr2=0x7f2830074d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282effd640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2830103b90 0x7f2830074d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282effd640 1 -- 172.21.15.70:0/119410509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2830075af0 con 0x7f28301029a0 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282effd640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28301029a0 0x7f28300766e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2820006010 tx=0x7f28200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282cff9640 1 -- 172.21.15.70:0/119410509 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282003f030 con 0x7f28301029a0 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282cff9640 1 -- 172.21.15.70:0/119410509 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2820003cd0 con 0x7f28301029a0 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f283543f640 1 -- 172.21.15.70:0/119410509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28301a2da0 con 0x7f28301029a0 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f282cff9640 1 -- 172.21.15.70:0/119410509 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820035070 con 0x7f28301029a0 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.435+0000 7f283543f640 1 -- 172.21.15.70:0/119410509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28301a3200 con 0x7f28301029a0 2024-04-26T20:27:20.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.437+0000 7f283543f640 1 -- 172.21.15.70:0/119410509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2830109d90 con 0x7f28301029a0 2024-04-26T20:27:20.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.438+0000 7f282cff9640 1 -- 172.21.15.70:0/119410509 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f2820042030 con 0x7f28301029a0 2024-04-26T20:27:20.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.438+0000 7f282cff9640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f28100a3990 0x7f28100a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.439+0000 7f2827fff640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f28100a3990 0x7f28100a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.439+0000 7f282cff9640 1 -- 172.21.15.70:0/119410509 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8549+0+0 (secure 0 0 0) 0x7f28200f0750 con 0x7f28301029a0 2024-04-26T20:27:20.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.439+0000 7f2827fff640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f28100a3990 0x7f28100a5e50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2830076450 tx=0x7f281800a2d0 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:20.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.443+0000 7f282cff9640 1 -- 172.21.15.70:0/119410509 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f28200bcc90 con 0x7f28301029a0 2024-04-26T20:27:20.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.659+0000 7f283543f640 1 -- 172.21.15.70:0/119410509 --> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2830062d70 con 0x7f28100a3990 2024-04-26T20:27:20.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.667+0000 7f282cff9640 1 -- 172.21.15.70:0/119410509 <== mgr.15333 v2:172.21.15.70:6800/212113189 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f2830062d70 con 0x7f28100a3990 2024-04-26T20:27:20.668 INFO:teuthology.orchestra.run.smithi070.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-26T00:00:00", "created": "2024-04-26T20:27:19", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-26T20:27:20.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 -- 172.21.15.70:0/119410509 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f28100a3990 msgr2=0x7f28100a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f28100a3990 0x7f28100a5e50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2830076450 tx=0x7f281800a2d0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 -- 172.21.15.70:0/119410509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28301029a0 msgr2=0x7f28300766e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28301029a0 0x7f28300766e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2820006010 tx=0x7f28200042f0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 -- 172.21.15.70:0/119410509 shutdown_connections 2024-04-26T20:27:20.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f28100a3990 0x7f28100a5e50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2830104550 0x7f2830075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2830103b90 0x7f2830074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 --2- 172.21.15.70:0/119410509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28301029a0 0x7f28300766e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 -- 172.21.15.70:0/119410509 >> 172.21.15.70:0/119410509 conn(0x7f28300fdf50 msgr2=0x7f2830106f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:20.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 -- 172.21.15.70:0/119410509 shutdown_connections 2024-04-26T20:27:20.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.671+0000 7f283543f640 1 -- 172.21.15.70:0/119410509 wait complete. 2024-04-26T20:27:20.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-26T20:27:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.795+0000 7f4534f9e640 1 -- 172.21.15.70:0/3624762245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4530102aa0 msgr2=0x7f4530102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.795+0000 7f4534f9e640 1 --2- 172.21.15.70:0/3624762245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4530102aa0 0x7f4530102f20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4524009900 tx=0x7f452402a410 comp rx=0 tx=0).stop 2024-04-26T20:27:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.795+0000 7f4534f9e640 1 -- 172.21.15.70:0/3624762245 shutdown_connections 2024-04-26T20:27:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.795+0000 7f4534f9e640 1 --2- 172.21.15.70:0/3624762245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4530103460 0x7f4530109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.795+0000 7f4534f9e640 1 --2- 172.21.15.70:0/3624762245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4530102aa0 0x7f4530102f20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.795+0000 7f4534f9e640 1 --2- 172.21.15.70:0/3624762245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45301018b0 0x7f4530101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.795+0000 7f4534f9e640 1 -- 172.21.15.70:0/3624762245 >> 172.21.15.70:0/3624762245 conn(0x7f45300fce40 msgr2=0x7f45300ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.795+0000 7f4534f9e640 1 -- 172.21.15.70:0/3624762245 shutdown_connections 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.795+0000 7f4534f9e640 1 -- 172.21.15.70:0/3624762245 wait complete. 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f4534f9e640 1 Processor -- start 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f4534f9e640 1 -- start start 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f4534f9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45301018b0 0x7f4530105840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f4534f9e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4530102aa0 0x7f4530103e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f4534f9e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4530103460 0x7f45301043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f4534f9e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f453010d510 con 0x7f4530103460 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f4534f9e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f453010d390 con 0x7f45301018b0 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f4534f9e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f453010d690 con 0x7f4530102aa0 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f452ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4530103460 0x7f45301043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f452ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4530103460 0x7f45301043c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54024/0 (socket says 172.21.15.70:54024) 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f452ed9d640 1 -- 172.21.15.70:0/325076725 learned_addr learned my addr 172.21.15.70:0/325076725 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:27:20.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f452e59c640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45301018b0 0x7f4530105840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f452dd9b640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4530102aa0 0x7f4530103e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f452ed9d640 1 -- 172.21.15.70:0/325076725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4530102aa0 msgr2=0x7f4530103e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f452ed9d640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4530102aa0 0x7f4530103e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f452ed9d640 1 -- 172.21.15.70:0/325076725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45301018b0 msgr2=0x7f4530105840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f452ed9d640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45301018b0 0x7f4530105840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f452ed9d640 1 -- 172.21.15.70:0/325076725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4530104c50 con 0x7f4530103460 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.796+0000 7f452e59c640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45301018b0 0x7f4530105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.797+0000 7f452ed9d640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4530103460 0x7f45301043c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f452000e970 tx=0x7f452000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.797+0000 7f451f7fe640 1 -- 172.21.15.70:0/325076725 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452000ccc0 con 0x7f4530103460 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.797+0000 7f451f7fe640 1 -- 172.21.15.70:0/325076725 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f452000ce60 con 0x7f4530103460 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.797+0000 7f4534f9e640 1 -- 172.21.15.70:0/325076725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45301a2dc0 con 0x7f4530103460 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.797+0000 7f451f7fe640 1 -- 172.21.15.70:0/325076725 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520010430 con 0x7f4530103460 2024-04-26T20:27:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.797+0000 7f4534f9e640 1 -- 172.21.15.70:0/325076725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45301a3220 con 0x7f4530103460 2024-04-26T20:27:20.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.798+0000 7f4534f9e640 1 -- 172.21.15.70:0/325076725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45301a3510 con 0x7f4530103460 2024-04-26T20:27:20.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.799+0000 7f451f7fe640 1 -- 172.21.15.70:0/325076725 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f4520005020 con 0x7f4530103460 2024-04-26T20:27:20.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.800+0000 7f451f7fe640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f45180a3ae0 0x7f45180a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:20.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.800+0000 7f452e59c640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f45180a3ae0 0x7f45180a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:20.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.800+0000 7f451f7fe640 1 -- 172.21.15.70:0/325076725 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8549+0+0 (secure 0 0 0) 0x7f45200d0420 con 0x7f4530103460 2024-04-26T20:27:20.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.801+0000 7f452e59c640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f45180a3ae0 0x7f45180a5fa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4530102900 tx=0x7f4528009500 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:20.806+0000 7f451f7fe640 1 -- 172.21.15.70:0/325076725 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f452009cfb0 con 0x7f4530103460 2024-04-26T20:27:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:20 smithi098 ceph-mon[32591]: [26/Apr/2024:20:27:19] ENGINE Bus STARTING 2024-04-26T20:27:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:20 smithi098 ceph-mon[32591]: [26/Apr/2024:20:27:19] ENGINE Serving on http://172.21.15.70:8765 2024-04-26T20:27:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:20 smithi098 ceph-mon[32591]: [26/Apr/2024:20:27:19] ENGINE Serving on https://172.21.15.70:7150 2024-04-26T20:27:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:20 smithi098 ceph-mon[32591]: [26/Apr/2024:20:27:19] ENGINE Bus STARTED 2024-04-26T20:27:20.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:20 smithi098 ceph-mon[32591]: mgrmap e21: x(active, since 1.01842s), standbys: z, y 2024-04-26T20:27:20.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:20 smithi080 ceph-mon[32278]: [26/Apr/2024:20:27:19] ENGINE Bus STARTING 2024-04-26T20:27:20.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:20 smithi080 ceph-mon[32278]: [26/Apr/2024:20:27:19] ENGINE Serving on http://172.21.15.70:8765 2024-04-26T20:27:20.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:20 smithi080 ceph-mon[32278]: [26/Apr/2024:20:27:19] ENGINE Serving on https://172.21.15.70:7150 2024-04-26T20:27:20.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:20 smithi080 ceph-mon[32278]: [26/Apr/2024:20:27:19] ENGINE Bus STARTED 2024-04-26T20:27:20.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:20 smithi080 ceph-mon[32278]: mgrmap e21: x(active, since 1.01842s), standbys: z, y 2024-04-26T20:27:21.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:20 smithi070 ceph-mon[29124]: [26/Apr/2024:20:27:19] ENGINE Bus STARTING 2024-04-26T20:27:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:20 smithi070 ceph-mon[29124]: [26/Apr/2024:20:27:19] ENGINE Serving on http://172.21.15.70:8765 2024-04-26T20:27:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:20 smithi070 ceph-mon[29124]: [26/Apr/2024:20:27:19] ENGINE Serving on https://172.21.15.70:7150 2024-04-26T20:27:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:20 smithi070 ceph-mon[29124]: [26/Apr/2024:20:27:19] ENGINE Bus STARTED 2024-04-26T20:27:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:20 smithi070 ceph-mon[29124]: mgrmap e21: x(active, since 1.01842s), standbys: z, y 2024-04-26T20:27:21.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.058+0000 7f4534f9e640 1 -- 172.21.15.70:0/325076725 --> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f45300fefe0 con 0x7f45180a3ae0 2024-04-26T20:27:21.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.064+0000 7f451f7fe640 1 -- 172.21.15.70:0/325076725 <== mgr.15333 v2:172.21.15.70:6800/212113189 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f45300fefe0 con 0x7f45180a3ae0 2024-04-26T20:27:21.065 INFO:teuthology.orchestra.run.smithi070.stdout:/ 1m 6m3h 2024-04-26T20:27:21.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.066+0000 7f4534f9e640 1 -- 172.21.15.70:0/325076725 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f45180a3ae0 msgr2=0x7f45180a5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.066+0000 7f4534f9e640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f45180a3ae0 0x7f45180a5fa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4530102900 tx=0x7f4528009500 comp rx=0 tx=0).stop 2024-04-26T20:27:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.066+0000 7f4534f9e640 1 -- 172.21.15.70:0/325076725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4530103460 msgr2=0x7f45301043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.066+0000 7f4534f9e640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4530103460 0x7f45301043c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f452000e970 tx=0x7f452000ed70 comp rx=0 tx=0).stop 2024-04-26T20:27:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.067+0000 7f4534f9e640 1 -- 172.21.15.70:0/325076725 shutdown_connections 2024-04-26T20:27:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.067+0000 7f4534f9e640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f45180a3ae0 0x7f45180a5fa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.067+0000 7f4534f9e640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4530103460 0x7f45301043c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.067+0000 7f4534f9e640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4530102aa0 0x7f4530103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.067+0000 7f4534f9e640 1 --2- 172.21.15.70:0/325076725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45301018b0 0x7f4530105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.067+0000 7f4534f9e640 1 -- 172.21.15.70:0/325076725 >> 172.21.15.70:0/325076725 conn(0x7f45300fce40 msgr2=0x7f45300fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.067+0000 7f4534f9e640 1 -- 172.21.15.70:0/325076725 shutdown_connections 2024-04-26T20:27:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:27:21.067+0000 7f4534f9e640 1 -- 172.21.15.70:0/325076725 wait complete. 2024-04-26T20:27:21.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-26T20:27:21.105 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-26T20:27:21.115 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T20:27:21.140 INFO:tasks.workunit:Pulling workunits from ref bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:27:21.141 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T20:27:21.141 INFO:tasks.workunit:timeout=3h 2024-04-26T20:27:21.141 INFO:tasks.workunit:cleanup=True 2024-04-26T20:27:21.141 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T20:27:21.160 INFO:teuthology.orchestra.run.smithi070.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T20:27:21.160 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T20:27:21.160 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 73h/115d Inode: 1099511628283 Links: 2 2024-04-26T20:27:21.160 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:27:21.160 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-26T20:27:21.160 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-26 20:25:22.081145809 +0000 2024-04-26T20:27:21.160 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-26 20:25:22.081145809 +0000 2024-04-26T20:27:21.160 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-26 20:27:16.849210655 +0000 2024-04-26T20:27:21.160 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-04-26 20:25:22.081145809 +0000 2024-04-26T20:27:21.160 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T20:27:21.161 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T20:27:21.231 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:27:21.286 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T20:27:21.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:21 smithi098 ceph-mon[32591]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:21.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:21 smithi098 ceph-mon[32591]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:27:21.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:21 smithi098 ceph-mon[32591]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:21.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:21 smithi098 ceph-mon[32591]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:21.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:21 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:21.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:21 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:21.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:21 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:21.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:21 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:21.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:21 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:21.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:21 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:21.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:21 smithi080 ceph-mon[32278]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:21.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:21 smithi080 ceph-mon[32278]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:27:21.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:21 smithi080 ceph-mon[32278]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:21.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:21 smithi080 ceph-mon[32278]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:21.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:21 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:21.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:21 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:21.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:21 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:21.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:21 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:21.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:21 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:21.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:21 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:21 smithi070 ceph-mon[29124]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:22.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:21 smithi070 ceph-mon[29124]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:27:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:21 smithi070 ceph-mon[29124]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:21 smithi070 ceph-mon[29124]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:21 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:21 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:21 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:21 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:21 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:21 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.960 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:22.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:22 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:22.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:22.972 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:22 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:27:23.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:23.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:22 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:23.871 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Unable to set osd_memory_target on smithi098 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi070 to 176.2M 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Unable to set osd_memory_target on smithi070 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Updating smithi070:/etc/ceph/ceph.conf 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Updating smithi098:/etc/ceph/ceph.conf 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Updating smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:27:23.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:23.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:23 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.874 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T20:27:23.874 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-26T20:27:23.874 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-04-26T20:27:23.874 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Unable to set osd_memory_target on smithi098 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-26T20:27:23.874 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi070 to 176.2M 2024-04-26T20:27:23.874 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Unable to set osd_memory_target on smithi070 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:27:23.874 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Updating smithi070:/etc/ceph/ceph.conf 2024-04-26T20:27:23.874 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T20:27:23.874 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Updating smithi098:/etc/ceph/ceph.conf 2024-04-26T20:27:23.874 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Updating smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:27:23.874 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:23.875 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:23.876 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:23 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.936 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T20:27:23.936 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-26T20:27:23.936 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-04-26T20:27:23.936 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Unable to set osd_memory_target on smithi098 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-26T20:27:23.936 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi070 to 176.2M 2024-04-26T20:27:23.936 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Unable to set osd_memory_target on smithi070 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:27:23.936 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Updating smithi070:/etc/ceph/ceph.conf 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Updating smithi098:/etc/ceph/ceph.conf 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Updating smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:23.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:23.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:23.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:23.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:23 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:27:24.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:24 smithi098 ceph-mon[32591]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:27:24.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:24 smithi098 ceph-mon[32591]: Updating smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:27:24.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:24 smithi098 ceph-mon[32591]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:27:24.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:24 smithi098 ceph-mon[32591]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:27:24.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:24 smithi098 ceph-mon[32591]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-04-26T20:27:24.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:24 smithi080 ceph-mon[32278]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:27:24.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:24 smithi080 ceph-mon[32278]: Updating smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:27:24.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:24 smithi080 ceph-mon[32278]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:27:24.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:24 smithi080 ceph-mon[32278]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:27:24.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:24 smithi080 ceph-mon[32278]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-04-26T20:27:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:24 smithi070 ceph-mon[29124]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:27:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:24 smithi070 ceph-mon[29124]: Updating smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:27:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:24 smithi070 ceph-mon[29124]: Updating smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:27:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:24 smithi070 ceph-mon[29124]: Updating smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:27:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:24 smithi070 ceph-mon[29124]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-04-26T20:27:26.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:26 smithi098 ceph-mon[32591]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 91 KiB/s wr, 99 op/s 2024-04-26T20:27:26.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:26 smithi080 ceph-mon[32278]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 91 KiB/s wr, 99 op/s 2024-04-26T20:27:27.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:26 smithi070 ceph-mon[29124]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 91 KiB/s wr, 99 op/s 2024-04-26T20:27:28.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:28 smithi098 ceph-mon[32591]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 80 op/s 2024-04-26T20:27:28.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:28 smithi080 ceph-mon[32278]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 80 op/s 2024-04-26T20:27:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:28 smithi070 ceph-mon[29124]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 80 op/s 2024-04-26T20:27:30.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:30 smithi098 ceph-mon[32591]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-04-26T20:27:30.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:30 smithi080 ceph-mon[32278]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-04-26T20:27:31.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:30 smithi070 ceph-mon[29124]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-04-26T20:27:32.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:32 smithi098 ceph-mon[32591]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-04-26T20:27:32.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:32 smithi080 ceph-mon[32278]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-04-26T20:27:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:32 smithi070 ceph-mon[29124]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-04-26T20:27:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:34 smithi098 ceph-mon[32591]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-04-26T20:27:34.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:34 smithi080 ceph-mon[32278]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-04-26T20:27:35.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:34 smithi070 ceph-mon[29124]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-04-26T20:27:36.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:36 smithi098 ceph-mon[32591]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-04-26T20:27:36.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:36 smithi080 ceph-mon[32278]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-04-26T20:27:37.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:36 smithi070 ceph-mon[29124]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-04-26T20:27:38.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:38 smithi098 ceph-mon[32591]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-04-26T20:27:38.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:38 smithi080 ceph-mon[32278]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-04-26T20:27:39.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:38 smithi070 ceph-mon[29124]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-04-26T20:27:40.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:40 smithi098 ceph-mon[32591]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:27:40.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:40 smithi080 ceph-mon[32278]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:27:41.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:40 smithi070 ceph-mon[29124]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:27:42.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:42 smithi098 ceph-mon[32591]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T20:27:42.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:42 smithi080 ceph-mon[32278]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T20:27:43.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:42 smithi070 ceph-mon[29124]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T20:27:44.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:44 smithi098 ceph-mon[32591]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:44.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:44 smithi080 ceph-mon[32278]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:45.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:44 smithi070 ceph-mon[29124]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:46.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:46 smithi098 ceph-mon[32591]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:27:46.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:46 smithi080 ceph-mon[32278]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:27:47.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:46 smithi070 ceph-mon[29124]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:27:48.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:48 smithi098 ceph-mon[32591]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:27:48.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:48 smithi080 ceph-mon[32278]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:27:49.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:48 smithi070 ceph-mon[29124]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:27:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:50 smithi098 ceph-mon[32591]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:50.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:50 smithi080 ceph-mon[32278]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:51.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:50 smithi070 ceph-mon[29124]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:52.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:52 smithi098 ceph-mon[32591]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:27:52.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:52 smithi080 ceph-mon[32278]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:27:53.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:52 smithi070 ceph-mon[29124]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:27:54.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:54 smithi098 ceph-mon[32591]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:54.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:54 smithi080 ceph-mon[32278]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:55.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:54 smithi070 ceph-mon[29124]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:56.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:56 smithi098 ceph-mon[32591]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:27:56.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:56 smithi080 ceph-mon[32278]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:27:57.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:56 smithi070 ceph-mon[29124]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:27:58.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:27:58 smithi098 ceph-mon[32591]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:58.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:27:58 smithi080 ceph-mon[32278]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:27:59.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:27:58 smithi070 ceph-mon[29124]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:00.664 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:28:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:28:00.327+0000 7ff87a11b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:28:00.664 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:28:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:28:00.327+0000 7ff87a11b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:28:00.664 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:28:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:28:00.327+0000 7ff87a11b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:28:00.664 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:28:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:28:00.327+0000 7ff87a11b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:28:00.664 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:28:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x[29358]: 2024-04-26T20:28:00.327+0000 7ff87a11b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:28:00.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:00 smithi098 ceph-mon[32591]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:00.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:00 smithi080 ceph-mon[32278]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:01.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:00 smithi070 ceph-mon[29124]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:02.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:02 smithi098 ceph-mon[32591]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-04-26T20:28:02.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:02 smithi098 ceph-mon[32591]: mgrmap e24: x(active, since 42s), standbys: z, y 2024-04-26T20:28:02.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:02 smithi080 ceph-mon[32278]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-04-26T20:28:02.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:02 smithi080 ceph-mon[32278]: mgrmap e24: x(active, since 42s), standbys: z, y 2024-04-26T20:28:03.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:02 smithi070 ceph-mon[29124]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-04-26T20:28:03.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:02 smithi070 ceph-mon[29124]: mgrmap e24: x(active, since 42s), standbys: z, y 2024-04-26T20:28:04.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:04 smithi098 ceph-mon[32591]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-26T20:28:04.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:04 smithi080 ceph-mon[32278]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-26T20:28:05.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:04 smithi070 ceph-mon[29124]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-26T20:28:06.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:06 smithi098 ceph-mon[32591]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T20:28:06.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:06 smithi080 ceph-mon[32278]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T20:28:07.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:06 smithi070 ceph-mon[29124]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T20:28:08.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:08 smithi098 ceph-mon[32591]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T20:28:08.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:08 smithi080 ceph-mon[32278]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T20:28:09.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:08 smithi070 ceph-mon[29124]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T20:28:10.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:10 smithi098 ceph-mon[32591]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T20:28:10.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:10 smithi080 ceph-mon[32278]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T20:28:11.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:10 smithi070 ceph-mon[29124]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T20:28:12.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:12 smithi098 ceph-mon[32591]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T20:28:12.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:12 smithi080 ceph-mon[32278]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T20:28:13.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:12 smithi070 ceph-mon[29124]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T20:28:14.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:14 smithi098 ceph-mon[32591]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:28:14.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:14 smithi080 ceph-mon[32278]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:28:15.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:14 smithi070 ceph-mon[29124]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:28:16.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:16 smithi098 ceph-mon[32591]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T20:28:16.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:16 smithi080 ceph-mon[32278]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T20:28:17.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:16 smithi070 ceph-mon[29124]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T20:28:18.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:18 smithi098 ceph-mon[32591]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:28:18.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:18 smithi080 ceph-mon[32278]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:28:19.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:18 smithi070 ceph-mon[29124]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:28:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:20 smithi098 ceph-mon[32591]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:28:20.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:20 smithi080 ceph-mon[32278]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:28:21.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:20 smithi070 ceph-mon[29124]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:28:22.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:22 smithi098 ceph-mon[32591]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:28:22.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:22 smithi080 ceph-mon[32278]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:28:23.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:22 smithi070 ceph-mon[29124]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:28:23.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:23 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:28:23.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:23 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:28:24.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:23 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:28:24.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:24 smithi098 ceph-mon[32591]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:28:24.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:24 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:28:24.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:24 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:28:24.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:24 smithi080 ceph-mon[32278]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:28:24.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:24 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:28:24.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:24 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:28:25.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:24 smithi070 ceph-mon[29124]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:28:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:24 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:28:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:24 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:28:25.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:25 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:25.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:25 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:25.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:25 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:28:26.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:25 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:26.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:25 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:26.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:25 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:28:26.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:25 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:26.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:25 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:26.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:25 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:28:26.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:26 smithi080 ceph-mon[32278]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:28:27.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:26 smithi070 ceph-mon[29124]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:28:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:26 smithi098 ceph-mon[32591]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:28:28.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:28 smithi080 ceph-mon[32278]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:29.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:28 smithi070 ceph-mon[29124]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:29.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:28 smithi098 ceph-mon[32591]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:30.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:30 smithi080 ceph-mon[32278]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:31.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:30 smithi070 ceph-mon[29124]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:30 smithi098 ceph-mon[32591]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:33.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:32 smithi070 ceph-mon[29124]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:32 smithi098 ceph-mon[32591]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:33.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:32 smithi080 ceph-mon[32278]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:35.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:34 smithi070 ceph-mon[29124]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:35.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:34 smithi098 ceph-mon[32591]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:35.222 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:34 smithi080 ceph-mon[32278]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:37.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:36 smithi070 ceph-mon[29124]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:37.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:36 smithi098 ceph-mon[32591]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:37.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:36 smithi080 ceph-mon[32278]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:39.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:38 smithi070 ceph-mon[29124]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:38 smithi098 ceph-mon[32591]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:39.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:38 smithi080 ceph-mon[32278]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:41.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:40 smithi070 ceph-mon[29124]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:40 smithi098 ceph-mon[32591]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:41.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:40 smithi080 ceph-mon[32278]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:43.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:42 smithi070 ceph-mon[29124]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:42 smithi098 ceph-mon[32591]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:43.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:42 smithi080 ceph-mon[32278]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:45.001 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T20:28:45.001 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-04-26T20:28:45.001 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T20:28:45.001 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T20:28:45.001 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T20:28:45.001 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-04-26T20:28:45.001 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T20:28:45.001 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T20:28:45.002 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-04-26T20:28:45.002 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-04-26T20:28:45.002 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-04-26T20:28:45.002 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-04-26T20:28:45.002 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-04-26T20:28:45.002 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-04-26T20:28:45.002 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-04-26T20:28:45.002 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T20:28:45.002 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-04-26T20:28:45.002 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T20:28:45.007 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T20:28:45.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:44 smithi070 ceph-mon[29124]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:45.059 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T20:28:45.061 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T20:28:45.061 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T20:28:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:44 smithi098 ceph-mon[32591]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:44 smithi080 ceph-mon[32278]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:45.734 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T20:28:45.792 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T20:28:45.832 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T20:28:45.833 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T20:28:45.833 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T20:28:45.872 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T20:28:45.875 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:28:45.875 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T20:28:45.931 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-04-26T20:28:45.933 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-04-26T20:28:45.933 DEBUG:teuthology.orchestra.run.smithi070:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-04-26T20:28:45.992 INFO:tasks.workunit.client.0.smithi070.stderr:+ KERNEL=linux-4.0.5 2024-04-26T20:28:45.993 INFO:tasks.workunit.client.0.smithi070.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-04-26T20:28:47.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:46 smithi070 ceph-mon[29124]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:47.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:46 smithi098 ceph-mon[32591]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:47.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:46 smithi080 ceph-mon[32278]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:28:49.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:48 smithi070 ceph-mon[29124]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:49.130 INFO:tasks.workunit.client.0.smithi070.stderr:+ mkdir untar_tar 2024-04-26T20:28:49.132 INFO:tasks.workunit.client.0.smithi070.stderr:+ cd untar_tar 2024-04-26T20:28:49.132 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-04-26T20:28:49.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ 2024-04-26T20:28:49.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/00-INDEX 2024-04-26T20:28:49.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/ 2024-04-26T20:28:49.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/README 2024-04-26T20:28:49.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-04-26T20:28:49.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-04-26T20:28:49.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-04-26T20:28:49.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-04-26T20:28:49.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-04-26T20:28:49.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-04-26T20:28:49.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-04-26T20:28:49.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-04-26T20:28:49.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-04-26T20:28:49.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-04-26T20:28:49.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-04-26T20:28:49.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-04-26T20:28:49.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-04-26T20:28:49.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-04-26T20:28:49.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-04-26T20:28:49.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-04-26T20:28:49.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-04-26T20:28:49.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-04-26T20:28:49.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-04-26T20:28:49.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-04-26T20:28:49.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-04-26T20:28:49.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-04-26T20:28:49.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-04-26T20:28:49.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-04-26T20:28:49.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-04-26T20:28:49.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-04-26T20:28:49.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-04-26T20:28:49.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-04-26T20:28:49.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-04-26T20:28:49.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-04-26T20:28:49.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-04-26T20:28:49.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-04-26T20:28:49.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-04-26T20:28:49.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-04-26T20:28:49.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-04-26T20:28:49.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-04-26T20:28:49.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-04-26T20:28:49.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-04-26T20:28:49.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-04-26T20:28:49.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:48 smithi098 ceph-mon[32591]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:49.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-04-26T20:28:49.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-04-26T20:28:49.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-04-26T20:28:49.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-04-26T20:28:49.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-04-26T20:28:49.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-04-26T20:28:49.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-04-26T20:28:49.215 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-04-26T20:28:49.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-04-26T20:28:49.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-04-26T20:28:49.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-04-26T20:28:49.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:48 smithi080 ceph-mon[32278]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:49.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-04-26T20:28:49.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-04-26T20:28:49.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-04-26T20:28:49.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-04-26T20:28:49.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-04-26T20:28:49.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-04-26T20:28:49.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-04-26T20:28:49.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-04-26T20:28:49.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-04-26T20:28:49.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-04-26T20:28:49.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-04-26T20:28:49.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-04-26T20:28:49.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-04-26T20:28:49.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-04-26T20:28:49.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-04-26T20:28:49.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-04-26T20:28:49.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-04-26T20:28:49.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-04-26T20:28:49.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-04-26T20:28:49.238 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-04-26T20:28:49.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-04-26T20:28:49.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-04-26T20:28:49.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-04-26T20:28:49.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-04-26T20:28:49.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-04-26T20:28:49.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-04-26T20:28:49.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-04-26T20:28:49.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-04-26T20:28:49.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-04-26T20:28:49.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-04-26T20:28:49.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-04-26T20:28:49.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-04-26T20:28:49.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-04-26T20:28:49.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-04-26T20:28:49.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-04-26T20:28:49.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-04-26T20:28:49.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-04-26T20:28:49.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-04-26T20:28:49.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-04-26T20:28:49.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-04-26T20:28:49.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-04-26T20:28:49.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-04-26T20:28:49.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-04-26T20:28:49.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-04-26T20:28:49.263 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-04-26T20:28:49.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-04-26T20:28:49.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-04-26T20:28:49.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-04-26T20:28:49.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-04-26T20:28:49.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-04-26T20:28:49.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-04-26T20:28:49.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-04-26T20:28:49.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-04-26T20:28:49.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-04-26T20:28:49.273 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-04-26T20:28:49.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-04-26T20:28:49.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-04-26T20:28:49.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-04-26T20:28:49.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-04-26T20:28:49.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-04-26T20:28:49.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-04-26T20:28:49.280 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-04-26T20:28:49.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-04-26T20:28:49.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-04-26T20:28:49.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-04-26T20:28:49.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-04-26T20:28:49.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-04-26T20:28:49.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-04-26T20:28:49.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-04-26T20:28:49.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-04-26T20:28:49.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-04-26T20:28:49.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-04-26T20:28:49.291 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-04-26T20:28:49.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-04-26T20:28:49.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-04-26T20:28:49.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-04-26T20:28:49.295 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-04-26T20:28:49.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-04-26T20:28:49.297 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-04-26T20:28:49.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-04-26T20:28:49.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-04-26T20:28:49.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-04-26T20:28:49.301 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-04-26T20:28:49.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-04-26T20:28:49.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-04-26T20:28:49.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-04-26T20:28:49.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-04-26T20:28:49.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-04-26T20:28:49.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-04-26T20:28:49.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-04-26T20:28:49.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-04-26T20:28:49.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-04-26T20:28:49.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-04-26T20:28:49.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-04-26T20:28:49.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-04-26T20:28:49.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-04-26T20:28:49.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-04-26T20:28:49.316 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-04-26T20:28:49.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-04-26T20:28:49.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-04-26T20:28:49.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-04-26T20:28:49.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-04-26T20:28:49.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-04-26T20:28:49.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-04-26T20:28:49.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-04-26T20:28:49.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-04-26T20:28:49.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-04-26T20:28:49.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-04-26T20:28:49.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-04-26T20:28:49.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-04-26T20:28:49.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-04-26T20:28:49.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-04-26T20:28:49.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-04-26T20:28:49.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-04-26T20:28:49.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-04-26T20:28:49.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-04-26T20:28:49.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-04-26T20:28:49.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-04-26T20:28:49.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-04-26T20:28:49.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-04-26T20:28:49.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-04-26T20:28:49.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-04-26T20:28:49.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-04-26T20:28:49.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-04-26T20:28:49.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-04-26T20:28:49.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-04-26T20:28:49.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-04-26T20:28:49.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-04-26T20:28:49.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-04-26T20:28:49.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-04-26T20:28:49.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-04-26T20:28:49.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-04-26T20:28:49.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-04-26T20:28:49.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-04-26T20:28:49.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-04-26T20:28:49.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-04-26T20:28:49.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-04-26T20:28:49.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-04-26T20:28:49.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-04-26T20:28:49.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-04-26T20:28:49.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-04-26T20:28:49.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-04-26T20:28:49.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-04-26T20:28:49.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-04-26T20:28:49.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-04-26T20:28:50.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-04-26T20:28:50.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-04-26T20:28:50.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-04-26T20:28:50.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-04-26T20:28:50.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-04-26T20:28:50.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-04-26T20:28:50.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-04-26T20:28:50.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-04-26T20:28:50.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-04-26T20:28:50.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-04-26T20:28:50.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-04-26T20:28:50.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-04-26T20:28:50.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-04-26T20:28:50.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-04-26T20:28:50.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-04-26T20:28:50.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-04-26T20:28:50.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-04-26T20:28:50.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-04-26T20:28:50.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-04-26T20:28:50.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-04-26T20:28:50.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-04-26T20:28:50.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-04-26T20:28:50.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-04-26T20:28:50.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-04-26T20:28:50.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-04-26T20:28:50.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-04-26T20:28:50.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-04-26T20:28:50.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-04-26T20:28:50.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-04-26T20:28:50.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-04-26T20:28:50.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-04-26T20:28:50.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-04-26T20:28:50.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-04-26T20:28:50.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-04-26T20:28:50.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-04-26T20:28:50.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-04-26T20:28:50.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-04-26T20:28:50.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-04-26T20:28:50.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-04-26T20:28:50.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-04-26T20:28:50.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-04-26T20:28:50.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-04-26T20:28:50.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-04-26T20:28:50.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-04-26T20:28:50.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-04-26T20:28:50.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-04-26T20:28:50.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-04-26T20:28:50.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-04-26T20:28:50.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-04-26T20:28:50.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-04-26T20:28:50.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-04-26T20:28:50.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-04-26T20:28:50.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-04-26T20:28:50.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-04-26T20:28:50.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-04-26T20:28:50.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-04-26T20:28:50.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-04-26T20:28:50.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-04-26T20:28:50.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-04-26T20:28:50.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-04-26T20:28:50.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-04-26T20:28:50.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-04-26T20:28:50.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-04-26T20:28:50.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Changes 2024-04-26T20:28:50.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-04-26T20:28:50.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/CodingStyle 2024-04-26T20:28:50.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-04-26T20:28:50.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-04-26T20:28:50.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-04-26T20:28:50.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-04-26T20:28:50.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/ 2024-04-26T20:28:50.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-04-26T20:28:50.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-04-26T20:28:50.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-04-26T20:28:50.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-04-26T20:28:50.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-04-26T20:28:50.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-04-26T20:28:50.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-04-26T20:28:50.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-04-26T20:28:50.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-04-26T20:28:50.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-04-26T20:28:50.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-04-26T20:28:50.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-04-26T20:28:50.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-04-26T20:28:50.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-04-26T20:28:50.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-04-26T20:28:50.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-04-26T20:28:50.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-04-26T20:28:50.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-04-26T20:28:50.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-04-26T20:28:50.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-04-26T20:28:50.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-04-26T20:28:50.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-04-26T20:28:50.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-04-26T20:28:50.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-04-26T20:28:50.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-04-26T20:28:50.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-04-26T20:28:50.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-04-26T20:28:50.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-04-26T20:28:50.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-04-26T20:28:50.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-04-26T20:28:50.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-04-26T20:28:50.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-04-26T20:28:50.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-04-26T20:28:50.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-04-26T20:28:50.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-04-26T20:28:50.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-04-26T20:28:50.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-04-26T20:28:50.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-04-26T20:28:50.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-04-26T20:28:50.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-04-26T20:28:50.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-04-26T20:28:50.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-04-26T20:28:50.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-04-26T20:28:50.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-04-26T20:28:50.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-04-26T20:28:50.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-04-26T20:28:50.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-04-26T20:28:50.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-04-26T20:28:50.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-04-26T20:28:50.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-04-26T20:28:50.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-04-26T20:28:50.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-04-26T20:28:50.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-04-26T20:28:50.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-04-26T20:28:50.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-04-26T20:28:50.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-04-26T20:28:50.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-04-26T20:28:50.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-04-26T20:28:50.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-04-26T20:28:50.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-04-26T20:28:50.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-04-26T20:28:50.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-04-26T20:28:50.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-04-26T20:28:50.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-04-26T20:28:50.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-04-26T20:28:50.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-04-26T20:28:50.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-04-26T20:28:50.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-04-26T20:28:50.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-04-26T20:28:50.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-04-26T20:28:50.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-04-26T20:28:50.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-04-26T20:28:50.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-04-26T20:28:50.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-04-26T20:28:50.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-04-26T20:28:50.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-04-26T20:28:50.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-04-26T20:28:50.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-04-26T20:28:50.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-04-26T20:28:50.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-04-26T20:28:50.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-04-26T20:28:50.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-04-26T20:28:50.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-04-26T20:28:50.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-04-26T20:28:50.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-04-26T20:28:50.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-04-26T20:28:50.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-04-26T20:28:50.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-04-26T20:28:50.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-04-26T20:28:50.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-04-26T20:28:50.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-04-26T20:28:50.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-04-26T20:28:50.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-04-26T20:28:50.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-04-26T20:28:50.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-04-26T20:28:50.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-04-26T20:28:50.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-04-26T20:28:50.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-04-26T20:28:50.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-04-26T20:28:50.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-04-26T20:28:50.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-04-26T20:28:50.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-04-26T20:28:50.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-04-26T20:28:50.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-04-26T20:28:50.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-04-26T20:28:50.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-04-26T20:28:50.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-04-26T20:28:50.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-04-26T20:28:50.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-04-26T20:28:50.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-04-26T20:28:50.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-04-26T20:28:50.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-04-26T20:28:50.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-04-26T20:28:50.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-04-26T20:28:50.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-04-26T20:28:50.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-04-26T20:28:50.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-04-26T20:28:50.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-04-26T20:28:50.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-04-26T20:28:50.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-04-26T20:28:50.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-04-26T20:28:50.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-04-26T20:28:50.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-04-26T20:28:50.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-04-26T20:28:50.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-04-26T20:28:50.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-04-26T20:28:50.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-04-26T20:28:50.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-04-26T20:28:50.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-04-26T20:28:50.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-04-26T20:28:50.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-04-26T20:28:50.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-04-26T20:28:50.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-04-26T20:28:50.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-04-26T20:28:50.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-04-26T20:28:50.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-04-26T20:28:50.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-04-26T20:28:50.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-04-26T20:28:50.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-04-26T20:28:50.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-04-26T20:28:50.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-04-26T20:28:50.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-04-26T20:28:50.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-04-26T20:28:50.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-04-26T20:28:50.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-04-26T20:28:50.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-04-26T20:28:50.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-04-26T20:28:50.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-04-26T20:28:50.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-04-26T20:28:50.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-04-26T20:28:50.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-04-26T20:28:50.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-04-26T20:28:50.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-04-26T20:28:50.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-04-26T20:28:50.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-04-26T20:28:50.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-04-26T20:28:50.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-04-26T20:28:50.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-04-26T20:28:50.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-04-26T20:28:50.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-04-26T20:28:50.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-04-26T20:28:50.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-04-26T20:28:50.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-04-26T20:28:50.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-04-26T20:28:50.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-04-26T20:28:50.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-04-26T20:28:50.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-04-26T20:28:50.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-04-26T20:28:50.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-04-26T20:28:50.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-04-26T20:28:50.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-04-26T20:28:50.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-04-26T20:28:50.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-04-26T20:28:50.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-04-26T20:28:50.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-04-26T20:28:50.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-04-26T20:28:50.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-04-26T20:28:50.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-04-26T20:28:50.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-04-26T20:28:50.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-04-26T20:28:50.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-04-26T20:28:50.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-04-26T20:28:50.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-04-26T20:28:50.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-04-26T20:28:50.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-04-26T20:28:50.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-04-26T20:28:50.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-04-26T20:28:50.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-04-26T20:28:50.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-04-26T20:28:50.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-04-26T20:28:50.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-04-26T20:28:50.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-04-26T20:28:50.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-04-26T20:28:50.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-04-26T20:28:50.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-04-26T20:28:50.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-04-26T20:28:50.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-04-26T20:28:50.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-04-26T20:28:51.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:50 smithi070 ceph-mon[29124]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:51.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:50 smithi098 ceph-mon[32591]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:50 smithi080 ceph-mon[32278]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:28:51.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-04-26T20:28:51.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-04-26T20:28:51.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-04-26T20:28:51.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-04-26T20:28:51.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-04-26T20:28:51.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-04-26T20:28:51.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-04-26T20:28:51.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-04-26T20:28:51.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-04-26T20:28:51.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-04-26T20:28:51.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-04-26T20:28:51.943 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-04-26T20:28:51.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-04-26T20:28:51.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-04-26T20:28:51.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-04-26T20:28:51.947 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-04-26T20:28:51.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-04-26T20:28:51.949 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-04-26T20:28:51.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-04-26T20:28:51.951 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-04-26T20:28:51.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-04-26T20:28:51.953 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-04-26T20:28:51.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-04-26T20:28:51.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-04-26T20:28:51.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-04-26T20:28:51.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-04-26T20:28:51.958 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-04-26T20:28:51.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-04-26T20:28:51.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-04-26T20:28:51.961 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-04-26T20:28:51.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-04-26T20:28:51.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-04-26T20:28:51.966 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-04-26T20:28:51.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-04-26T20:28:51.968 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/ 2024-04-26T20:28:51.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-04-26T20:28:51.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-04-26T20:28:51.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-04-26T20:28:51.974 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-04-26T20:28:51.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-04-26T20:28:51.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-04-26T20:28:51.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-04-26T20:28:51.980 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-04-26T20:28:51.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-04-26T20:28:51.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/hex 2024-04-26T20:28:51.984 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/HOWTO 2024-04-26T20:28:51.986 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-04-26T20:28:51.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-04-26T20:28:51.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-04-26T20:28:51.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-04-26T20:28:51.992 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-04-26T20:28:51.994 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Makefile 2024-04-26T20:28:51.995 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-04-26T20:28:51.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/ 2024-04-26T20:28:51.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-04-26T20:28:52.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-04-26T20:28:52.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-04-26T20:28:52.003 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-04-26T20:28:52.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-04-26T20:28:52.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-04-26T20:28:52.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-04-26T20:28:52.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/ 2024-04-26T20:28:52.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-04-26T20:28:52.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-04-26T20:28:52.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-04-26T20:28:52.015 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-04-26T20:28:52.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-04-26T20:28:52.018 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-04-26T20:28:52.020 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-04-26T20:28:52.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-04-26T20:28:52.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-04-26T20:28:52.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-04-26T20:28:52.026 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-04-26T20:28:52.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-04-26T20:28:52.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-04-26T20:28:52.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-04-26T20:28:52.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-04-26T20:28:52.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-04-26T20:28:52.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-04-26T20:28:52.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-04-26T20:28:52.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SAK.txt 2024-04-26T20:28:52.035 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SM501.txt 2024-04-26T20:28:52.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-04-26T20:28:52.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-04-26T20:28:52.038 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-04-26T20:28:52.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-04-26T20:28:52.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-04-26T20:28:52.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/ 2024-04-26T20:28:52.041 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-04-26T20:28:52.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-04-26T20:28:52.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-04-26T20:28:52.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-04-26T20:28:52.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-04-26T20:28:52.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-04-26T20:28:52.047 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-04-26T20:28:52.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/ 2024-04-26T20:28:52.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-04-26T20:28:52.050 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-04-26T20:28:52.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-04-26T20:28:52.052 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-04-26T20:28:52.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-04-26T20:28:52.054 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-04-26T20:28:52.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-04-26T20:28:52.056 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-04-26T20:28:52.057 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-04-26T20:28:52.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-04-26T20:28:52.059 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-04-26T20:28:52.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-04-26T20:28:52.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-04-26T20:28:52.062 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/ 2024-04-26T20:28:52.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-04-26T20:28:52.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-04-26T20:28:52.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-04-26T20:28:52.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-04-26T20:28:52.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-04-26T20:28:52.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-04-26T20:28:52.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-04-26T20:28:52.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/ 2024-04-26T20:28:52.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-04-26T20:28:52.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-04-26T20:28:52.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-04-26T20:28:52.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Booting 2024-04-26T20:28:52.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-04-26T20:28:52.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-04-26T20:28:52.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-04-26T20:28:52.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-04-26T20:28:52.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-04-26T20:28:52.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-04-26T20:28:52.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-04-26T20:28:52.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-04-26T20:28:52.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-04-26T20:28:52.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-04-26T20:28:52.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Porting 2024-04-26T20:28:52.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/README 2024-04-26T20:28:52.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-04-26T20:28:52.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-04-26T20:28:52.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-04-26T20:28:52.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-04-26T20:28:52.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-04-26T20:28:52.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-04-26T20:28:52.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-04-26T20:28:52.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-04-26T20:28:52.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-04-26T20:28:52.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-04-26T20:28:52.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-04-26T20:28:52.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-04-26T20:28:52.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-04-26T20:28:52.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-04-26T20:28:52.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-04-26T20:28:52.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-04-26T20:28:52.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-04-26T20:28:52.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-04-26T20:28:52.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-04-26T20:28:52.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-04-26T20:28:52.104 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-04-26T20:28:52.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-04-26T20:28:52.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-04-26T20:28:52.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-04-26T20:28:52.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-04-26T20:28:52.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-04-26T20:28:52.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-04-26T20:28:52.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-04-26T20:28:52.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-04-26T20:28:52.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-04-26T20:28:52.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-04-26T20:28:52.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-04-26T20:28:52.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-04-26T20:28:52.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-04-26T20:28:52.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-04-26T20:28:52.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-04-26T20:28:52.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-04-26T20:28:52.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-04-26T20:28:52.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-04-26T20:28:52.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-04-26T20:28:52.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-04-26T20:28:52.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-04-26T20:28:52.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-04-26T20:28:52.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Setup 2024-04-26T20:28:52.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-04-26T20:28:52.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-04-26T20:28:52.126 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-04-26T20:28:52.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-04-26T20:28:52.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-04-26T20:28:52.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-04-26T20:28:52.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-04-26T20:28:52.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-04-26T20:28:52.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-04-26T20:28:52.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-04-26T20:28:52.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-04-26T20:28:52.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-04-26T20:28:52.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-04-26T20:28:52.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-04-26T20:28:52.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-04-26T20:28:52.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-04-26T20:28:52.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-04-26T20:28:52.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-04-26T20:28:52.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-04-26T20:28:52.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-04-26T20:28:52.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-04-26T20:28:52.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-04-26T20:28:52.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-04-26T20:28:52.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-04-26T20:28:52.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-04-26T20:28:52.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-04-26T20:28:52.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-04-26T20:28:52.149 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-04-26T20:28:52.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-04-26T20:28:52.151 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-04-26T20:28:52.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/ 2024-04-26T20:28:52.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-04-26T20:28:52.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-04-26T20:28:52.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-04-26T20:28:52.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-04-26T20:28:52.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-04-26T20:28:52.158 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-04-26T20:28:52.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-04-26T20:28:52.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-04-26T20:28:52.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-04-26T20:28:52.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-04-26T20:28:52.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-04-26T20:28:52.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-04-26T20:28:52.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/backlight/ 2024-04-26T20:28:52.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-04-26T20:28:52.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-04-26T20:28:52.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-04-26T20:28:52.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bcache.txt 2024-04-26T20:28:52.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-04-26T20:28:52.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/ 2024-04-26T20:28:52.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-04-26T20:28:52.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-04-26T20:28:52.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-04-26T20:28:52.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-04-26T20:28:52.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-04-26T20:28:52.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/ 2024-04-26T20:28:52.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-04-26T20:28:52.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-04-26T20:28:52.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-04-26T20:28:52.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-04-26T20:28:52.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-04-26T20:28:52.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-04-26T20:28:52.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-04-26T20:28:52.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-04-26T20:28:52.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-04-26T20:28:52.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-04-26T20:28:52.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-04-26T20:28:52.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/request.txt 2024-04-26T20:28:52.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-04-26T20:28:52.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-04-26T20:28:52.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-04-26T20:28:52.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/ 2024-04-26T20:28:52.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-04-26T20:28:52.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-04-26T20:28:52.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-04-26T20:28:52.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-04-26T20:28:52.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-04-26T20:28:52.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-04-26T20:28:52.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-04-26T20:28:52.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-04-26T20:28:52.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-04-26T20:28:52.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-04-26T20:28:52.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-04-26T20:28:52.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-04-26T20:28:52.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-04-26T20:28:52.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-04-26T20:28:52.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-04-26T20:28:52.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-04-26T20:28:52.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-04-26T20:28:52.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-04-26T20:28:52.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-04-26T20:28:52.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-04-26T20:28:52.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-04-26T20:28:52.215 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-04-26T20:28:52.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-04-26T20:28:52.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-04-26T20:28:52.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-04-26T20:28:52.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-04-26T20:28:52.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/ 2024-04-26T20:28:52.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-04-26T20:28:52.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-04-26T20:28:52.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-04-26T20:28:52.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-04-26T20:28:52.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-04-26T20:28:52.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/ 2024-04-26T20:28:52.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-04-26T20:28:52.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-04-26T20:28:52.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-04-26T20:28:52.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-04-26T20:28:52.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-04-26T20:28:52.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-04-26T20:28:52.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-04-26T20:28:52.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-04-26T20:28:52.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-04-26T20:28:52.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-04-26T20:28:52.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-04-26T20:28:52.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-04-26T20:28:52.238 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-04-26T20:28:52.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-04-26T20:28:52.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/clk.txt 2024-04-26T20:28:52.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-04-26T20:28:52.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/ 2024-04-26T20:28:52.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-04-26T20:28:52.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-04-26T20:28:52.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-04-26T20:28:52.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-04-26T20:28:52.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-04-26T20:28:52.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/console/ 2024-04-26T20:28:52.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/console/console.txt 2024-04-26T20:28:52.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-04-26T20:28:52.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-04-26T20:28:52.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-04-26T20:28:52.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-04-26T20:28:52.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-04-26T20:28:52.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-04-26T20:28:52.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-04-26T20:28:52.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-04-26T20:28:52.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-04-26T20:28:52.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-04-26T20:28:52.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-04-26T20:28:52.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-04-26T20:28:52.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-04-26T20:28:52.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-04-26T20:28:52.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-04-26T20:28:52.263 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-04-26T20:28:52.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-04-26T20:28:52.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-04-26T20:28:52.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-04-26T20:28:52.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-04-26T20:28:52.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crc32.txt 2024-04-26T20:28:52.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cris/ 2024-04-26T20:28:52.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cris/README 2024-04-26T20:28:52.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/ 2024-04-26T20:28:52.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-04-26T20:28:52.273 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-04-26T20:28:52.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-04-26T20:28:52.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-04-26T20:28:52.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-04-26T20:28:52.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-04-26T20:28:52.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-04-26T20:28:52.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-04-26T20:28:52.280 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-04-26T20:28:52.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/ 2024-04-26T20:28:52.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-04-26T20:28:52.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-04-26T20:28:52.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-04-26T20:28:52.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-04-26T20:28:52.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-04-26T20:28:52.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-04-26T20:28:52.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-04-26T20:28:52.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-04-26T20:28:52.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-04-26T20:28:52.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-04-26T20:28:52.291 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-04-26T20:28:52.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-04-26T20:28:52.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-04-26T20:28:52.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-04-26T20:28:52.295 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-04-26T20:28:52.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-04-26T20:28:52.297 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-04-26T20:28:52.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-04-26T20:28:52.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-04-26T20:28:52.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-04-26T20:28:52.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-04-26T20:28:52.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-04-26T20:28:52.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-04-26T20:28:52.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-04-26T20:28:52.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-04-26T20:28:52.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-04-26T20:28:52.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-04-26T20:28:52.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-04-26T20:28:52.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-04-26T20:28:52.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-04-26T20:28:52.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-04-26T20:28:52.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devices.txt 2024-04-26T20:28:52.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/ 2024-04-26T20:28:52.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-04-26T20:28:52.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-04-26T20:28:52.316 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-04-26T20:28:52.316 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-04-26T20:28:52.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-04-26T20:28:52.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-04-26T20:28:52.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-04-26T20:28:52.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-04-26T20:28:52.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-04-26T20:28:52.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-04-26T20:28:52.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-04-26T20:28:52.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-04-26T20:28:52.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-04-26T20:28:52.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-04-26T20:28:52.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-04-26T20:28:52.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-04-26T20:28:52.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-04-26T20:28:52.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-04-26T20:28:52.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-04-26T20:28:52.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-04-26T20:28:52.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-04-26T20:28:52.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-04-26T20:28:52.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-04-26T20:28:52.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-04-26T20:28:52.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-04-26T20:28:52.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-04-26T20:28:52.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-04-26T20:28:52.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-04-26T20:28:52.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-04-26T20:28:52.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-04-26T20:28:52.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-04-26T20:28:52.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-04-26T20:28:52.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-04-26T20:28:52.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-04-26T20:28:52.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-04-26T20:28:52.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-04-26T20:28:52.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-04-26T20:28:52.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-04-26T20:28:52.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-04-26T20:28:52.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-04-26T20:28:52.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-04-26T20:28:52.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-04-26T20:28:52.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-04-26T20:28:52.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-04-26T20:28:52.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-04-26T20:28:52.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-04-26T20:28:52.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-04-26T20:28:52.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-04-26T20:28:52.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-04-26T20:28:52.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-04-26T20:28:52.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-04-26T20:28:52.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-04-26T20:28:52.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-04-26T20:28:52.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-04-26T20:28:52.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-04-26T20:28:52.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-04-26T20:28:52.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-04-26T20:28:52.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-04-26T20:28:52.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-04-26T20:28:52.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-04-26T20:28:52.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-04-26T20:28:52.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-04-26T20:28:52.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-04-26T20:28:52.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-04-26T20:28:52.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-04-26T20:28:52.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-04-26T20:28:52.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-04-26T20:28:52.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-04-26T20:28:52.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-04-26T20:28:52.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-04-26T20:28:52.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-04-26T20:28:52.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-04-26T20:28:52.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-04-26T20:28:52.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-04-26T20:28:52.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-04-26T20:28:52.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-04-26T20:28:52.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-04-26T20:28:52.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-04-26T20:28:52.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-04-26T20:28:52.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-04-26T20:28:52.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-04-26T20:28:52.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-04-26T20:28:52.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-04-26T20:28:52.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-04-26T20:28:52.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-04-26T20:28:52.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-04-26T20:28:52.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-04-26T20:28:52.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-04-26T20:28:52.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-04-26T20:28:52.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-04-26T20:28:52.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-04-26T20:28:52.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-04-26T20:28:52.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-04-26T20:28:52.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-04-26T20:28:52.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-04-26T20:28:52.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-04-26T20:28:52.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-04-26T20:28:52.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-04-26T20:28:52.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-04-26T20:28:52.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-04-26T20:28:52.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-04-26T20:28:52.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-04-26T20:28:52.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-04-26T20:28:52.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-04-26T20:28:52.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-04-26T20:28:52.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-04-26T20:28:52.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-04-26T20:28:52.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-04-26T20:28:52.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-04-26T20:28:52.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-04-26T20:28:52.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-04-26T20:28:52.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-04-26T20:28:52.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-04-26T20:28:52.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-04-26T20:28:52.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-04-26T20:28:52.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-04-26T20:28:52.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-04-26T20:28:52.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-04-26T20:28:52.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-04-26T20:28:52.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-04-26T20:28:52.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-04-26T20:28:52.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-04-26T20:28:52.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-04-26T20:28:52.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-04-26T20:28:52.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-04-26T20:28:52.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-04-26T20:28:52.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-04-26T20:28:52.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-04-26T20:28:52.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-04-26T20:28:52.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-04-26T20:28:52.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-04-26T20:28:52.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-04-26T20:28:52.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-04-26T20:28:52.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-04-26T20:28:52.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-04-26T20:28:52.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-04-26T20:28:52.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-04-26T20:28:52.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-04-26T20:28:52.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-04-26T20:28:52.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-04-26T20:28:52.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-04-26T20:28:52.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-04-26T20:28:52.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-04-26T20:28:52.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-04-26T20:28:52.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-04-26T20:28:52.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-04-26T20:28:52.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-04-26T20:28:52.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-04-26T20:28:52.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-04-26T20:28:52.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-04-26T20:28:52.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-04-26T20:28:52.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-04-26T20:28:52.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-04-26T20:28:52.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-04-26T20:28:52.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-04-26T20:28:52.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-04-26T20:28:52.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-04-26T20:28:52.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-04-26T20:28:52.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-04-26T20:28:52.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-04-26T20:28:52.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-04-26T20:28:52.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-04-26T20:28:52.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-04-26T20:28:52.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-04-26T20:28:52.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-04-26T20:28:52.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-04-26T20:28:52.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-04-26T20:28:52.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-04-26T20:28:52.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-04-26T20:28:52.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-04-26T20:28:52.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-04-26T20:28:52.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-04-26T20:28:52.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-04-26T20:28:52.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-04-26T20:28:52.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-04-26T20:28:52.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-04-26T20:28:52.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-04-26T20:28:52.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-04-26T20:28:52.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-04-26T20:28:52.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-04-26T20:28:52.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-04-26T20:28:52.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-04-26T20:28:52.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-04-26T20:28:52.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-04-26T20:28:52.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-04-26T20:28:52.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-04-26T20:28:52.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-04-26T20:28:52.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-04-26T20:28:52.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-04-26T20:28:52.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-04-26T20:28:52.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-04-26T20:28:52.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-04-26T20:28:52.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-04-26T20:28:52.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-04-26T20:28:52.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-04-26T20:28:52.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-04-26T20:28:52.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-04-26T20:28:52.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-04-26T20:28:52.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-04-26T20:28:52.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-04-26T20:28:52.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-04-26T20:28:52.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-04-26T20:28:52.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-04-26T20:28:52.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-04-26T20:28:52.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-04-26T20:28:52.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-04-26T20:28:52.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-04-26T20:28:52.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-04-26T20:28:52.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-04-26T20:28:52.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-04-26T20:28:52.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-04-26T20:28:52.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-04-26T20:28:52.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-04-26T20:28:52.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-04-26T20:28:52.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-04-26T20:28:52.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-04-26T20:28:52.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-04-26T20:28:52.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-04-26T20:28:52.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-04-26T20:28:52.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-04-26T20:28:52.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-04-26T20:28:52.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-04-26T20:28:52.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-04-26T20:28:52.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-04-26T20:28:52.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-04-26T20:28:52.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-04-26T20:28:52.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-04-26T20:28:52.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-04-26T20:28:52.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-04-26T20:28:52.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-04-26T20:28:52.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-04-26T20:28:52.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-04-26T20:28:52.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-04-26T20:28:52.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-04-26T20:28:52.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-04-26T20:28:52.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-04-26T20:28:52.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-04-26T20:28:52.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-04-26T20:28:52.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-04-26T20:28:52.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-04-26T20:28:52.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-04-26T20:28:52.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-04-26T20:28:52.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-04-26T20:28:52.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-04-26T20:28:52.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-04-26T20:28:52.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-04-26T20:28:52.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-04-26T20:28:52.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-04-26T20:28:52.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-04-26T20:28:52.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-04-26T20:28:52.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-04-26T20:28:52.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-04-26T20:28:52.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-04-26T20:28:52.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-04-26T20:28:52.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-04-26T20:28:52.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-04-26T20:28:52.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-04-26T20:28:52.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-04-26T20:28:52.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-04-26T20:28:52.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-04-26T20:28:52.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-04-26T20:28:52.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-04-26T20:28:52.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-04-26T20:28:52.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-04-26T20:28:52.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-04-26T20:28:52.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-04-26T20:28:52.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-04-26T20:28:52.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-04-26T20:28:52.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-04-26T20:28:52.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-04-26T20:28:52.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-04-26T20:28:52.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-04-26T20:28:52.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-04-26T20:28:52.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-04-26T20:28:52.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-04-26T20:28:52.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-04-26T20:28:52.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-04-26T20:28:52.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-04-26T20:28:52.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-04-26T20:28:52.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-04-26T20:28:52.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-04-26T20:28:52.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-04-26T20:28:52.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-04-26T20:28:52.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-04-26T20:28:52.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-04-26T20:28:52.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-04-26T20:28:52.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-04-26T20:28:52.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-04-26T20:28:52.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-04-26T20:28:52.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-04-26T20:28:52.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-04-26T20:28:52.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-04-26T20:28:52.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-04-26T20:28:52.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-04-26T20:28:52.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-04-26T20:28:52.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-04-26T20:28:52.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-04-26T20:28:52.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-04-26T20:28:52.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-04-26T20:28:52.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-04-26T20:28:52.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-04-26T20:28:52.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-04-26T20:28:52.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-04-26T20:28:52.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-04-26T20:28:52.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-04-26T20:28:52.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-04-26T20:28:52.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-04-26T20:28:52.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-04-26T20:28:52.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-04-26T20:28:52.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-04-26T20:28:52.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-04-26T20:28:52.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-04-26T20:28:52.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-04-26T20:28:52.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-04-26T20:28:52.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-04-26T20:28:52.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-04-26T20:28:52.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-04-26T20:28:52.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-04-26T20:28:52.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-04-26T20:28:52.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-04-26T20:28:52.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-04-26T20:28:52.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-04-26T20:28:52.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-04-26T20:28:52.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-04-26T20:28:52.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-04-26T20:28:52.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-04-26T20:28:52.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-04-26T20:28:52.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-04-26T20:28:52.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-04-26T20:28:52.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-04-26T20:28:52.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-04-26T20:28:52.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-04-26T20:28:52.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-04-26T20:28:52.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-04-26T20:28:52.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-04-26T20:28:52.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-04-26T20:28:52.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-04-26T20:28:52.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-04-26T20:28:52.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-04-26T20:28:52.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-04-26T20:28:52.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-04-26T20:28:52.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-04-26T20:28:52.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-04-26T20:28:52.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-04-26T20:28:52.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-04-26T20:28:52.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-04-26T20:28:52.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-04-26T20:28:52.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-04-26T20:28:52.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-04-26T20:28:52.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-04-26T20:28:52.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-04-26T20:28:52.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-04-26T20:28:52.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-04-26T20:28:52.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-04-26T20:28:52.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-04-26T20:28:52.867 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-04-26T20:28:52.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-04-26T20:28:52.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-04-26T20:28:52.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-04-26T20:28:52.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-04-26T20:28:52.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-04-26T20:28:52.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-04-26T20:28:52.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-04-26T20:28:52.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-04-26T20:28:52.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-04-26T20:28:52.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-04-26T20:28:52.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-04-26T20:28:52.878 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-04-26T20:28:52.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-04-26T20:28:52.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-04-26T20:28:52.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-04-26T20:28:52.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-04-26T20:28:52.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-04-26T20:28:52.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-04-26T20:28:52.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-04-26T20:28:52.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-04-26T20:28:52.886 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-04-26T20:28:52.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-04-26T20:28:52.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-04-26T20:28:52.888 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-04-26T20:28:52.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-04-26T20:28:52.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-04-26T20:28:52.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-04-26T20:28:52.892 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-04-26T20:28:52.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-04-26T20:28:52.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-04-26T20:28:52.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-04-26T20:28:52.896 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-04-26T20:28:52.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-04-26T20:28:52.898 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-04-26T20:28:52.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-04-26T20:28:52.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-04-26T20:28:52.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-04-26T20:28:52.902 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-04-26T20:28:52.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-04-26T20:28:52.904 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-04-26T20:28:52.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-04-26T20:28:52.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-04-26T20:28:52.907 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-04-26T20:28:52.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-04-26T20:28:52.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-04-26T20:28:52.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-04-26T20:28:52.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-04-26T20:28:52.912 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-04-26T20:28:52.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-04-26T20:28:52.914 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-04-26T20:28:52.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-04-26T20:28:52.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-04-26T20:28:52.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-04-26T20:28:52.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-04-26T20:28:52.919 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-04-26T20:28:52.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-04-26T20:28:52.921 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-04-26T20:28:52.921 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-04-26T20:28:52.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-04-26T20:28:52.923 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-04-26T20:28:52.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-04-26T20:28:52.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-04-26T20:28:52.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-04-26T20:28:52.927 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-04-26T20:28:52.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-04-26T20:28:52.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-04-26T20:28:52.930 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-04-26T20:28:52.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-04-26T20:28:52.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-04-26T20:28:52.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-04-26T20:28:52.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-04-26T20:28:52.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-04-26T20:28:52.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-04-26T20:28:52.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-04-26T20:28:52.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-04-26T20:28:52.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-04-26T20:28:52.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-04-26T20:28:52.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-04-26T20:28:52.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-04-26T20:28:52.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-04-26T20:28:52.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-04-26T20:28:52.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-04-26T20:28:52.951 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-04-26T20:28:52.953 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-04-26T20:28:52.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-04-26T20:28:52.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-04-26T20:28:52.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-04-26T20:28:52.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-04-26T20:28:52.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-04-26T20:28:52.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-04-26T20:28:52.963 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-04-26T20:28:52.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-04-26T20:28:52.966 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-04-26T20:28:52.968 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-04-26T20:28:52.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-04-26T20:28:52.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-04-26T20:28:52.972 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-04-26T20:28:52.974 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-04-26T20:28:52.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-04-26T20:28:52.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-04-26T20:28:52.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-04-26T20:28:52.980 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-04-26T20:28:52.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-04-26T20:28:52.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-04-26T20:28:52.984 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-04-26T20:28:52.986 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-04-26T20:28:52.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-04-26T20:28:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-04-26T20:28:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-04-26T20:28:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-04-26T20:28:52.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-04-26T20:28:52.995 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-04-26T20:28:52.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-04-26T20:28:52.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-04-26T20:28:52.999 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-04-26T20:28:53.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-04-26T20:28:53.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-04-26T20:28:53.003 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-04-26T20:28:53.005 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-04-26T20:28:53.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-04-26T20:28:53.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-04-26T20:28:53.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-04-26T20:28:53.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-04-26T20:28:53.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-04-26T20:28:53.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-04-26T20:28:53.015 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-04-26T20:28:53.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-04-26T20:28:53.018 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-04-26T20:28:53.020 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-04-26T20:28:53.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-04-26T20:28:53.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-04-26T20:28:53.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-04-26T20:28:53.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-04-26T20:28:53.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-04-26T20:28:53.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-04-26T20:28:53.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-04-26T20:28:53.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-04-26T20:28:53.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-04-26T20:28:53.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-04-26T20:28:53.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:52 smithi070 ceph-mon[29124]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 14 op/s 2024-04-26T20:28:53.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:52 smithi070 ceph-mon[29124]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-04-26T20:28:53.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-04-26T20:28:53.038 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-04-26T20:28:53.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-04-26T20:28:53.041 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-04-26T20:28:53.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-04-26T20:28:53.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-04-26T20:28:53.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-04-26T20:28:53.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-04-26T20:28:53.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-04-26T20:28:53.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-04-26T20:28:53.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-04-26T20:28:53.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-04-26T20:28:53.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-04-26T20:28:53.050 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-04-26T20:28:53.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-04-26T20:28:53.052 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-04-26T20:28:53.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-04-26T20:28:53.054 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-04-26T20:28:53.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-04-26T20:28:53.056 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-04-26T20:28:53.057 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-04-26T20:28:53.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-04-26T20:28:53.059 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-04-26T20:28:53.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-04-26T20:28:53.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-04-26T20:28:53.062 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-04-26T20:28:53.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-04-26T20:28:53.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-04-26T20:28:53.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-04-26T20:28:53.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-04-26T20:28:53.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-04-26T20:28:53.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-04-26T20:28:53.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-04-26T20:28:53.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-04-26T20:28:53.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-04-26T20:28:53.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-04-26T20:28:53.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-04-26T20:28:53.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-04-26T20:28:53.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-04-26T20:28:53.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-04-26T20:28:53.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-04-26T20:28:53.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-04-26T20:28:53.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-04-26T20:28:53.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-04-26T20:28:53.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-04-26T20:28:53.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-04-26T20:28:53.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-04-26T20:28:53.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-04-26T20:28:53.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-04-26T20:28:53.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-04-26T20:28:53.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-04-26T20:28:53.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-04-26T20:28:53.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-04-26T20:28:53.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-04-26T20:28:53.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-04-26T20:28:53.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-04-26T20:28:53.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-04-26T20:28:53.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-04-26T20:28:53.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-04-26T20:28:53.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-04-26T20:28:53.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-04-26T20:28:53.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-04-26T20:28:53.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-04-26T20:28:53.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-04-26T20:28:53.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-04-26T20:28:53.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-04-26T20:28:53.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-04-26T20:28:53.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-04-26T20:28:53.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-04-26T20:28:53.104 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-04-26T20:28:53.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-04-26T20:28:53.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-04-26T20:28:53.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-04-26T20:28:53.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-04-26T20:28:53.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-04-26T20:28:53.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-04-26T20:28:53.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-04-26T20:28:53.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-04-26T20:28:53.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-04-26T20:28:53.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-04-26T20:28:53.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-04-26T20:28:53.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-04-26T20:28:53.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-04-26T20:28:53.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-04-26T20:28:53.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-04-26T20:28:53.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-04-26T20:28:53.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-04-26T20:28:53.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-04-26T20:28:53.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-04-26T20:28:53.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-04-26T20:28:53.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-04-26T20:28:53.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-04-26T20:28:53.126 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-04-26T20:28:53.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-04-26T20:28:53.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-04-26T20:28:53.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-04-26T20:28:53.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-04-26T20:28:53.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-04-26T20:28:53.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-04-26T20:28:53.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-04-26T20:28:53.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-04-26T20:28:53.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-04-26T20:28:53.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-04-26T20:28:53.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-04-26T20:28:53.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-04-26T20:28:53.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-04-26T20:28:53.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-04-26T20:28:53.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-04-26T20:28:53.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-04-26T20:28:53.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-04-26T20:28:53.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-04-26T20:28:53.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-04-26T20:28:53.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-04-26T20:28:53.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-04-26T20:28:53.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-04-26T20:28:53.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-04-26T20:28:53.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-04-26T20:28:53.149 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-04-26T20:28:53.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-04-26T20:28:53.151 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-04-26T20:28:53.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-04-26T20:28:53.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-04-26T20:28:53.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-04-26T20:28:53.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-04-26T20:28:53.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-04-26T20:28:53.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-04-26T20:28:53.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-04-26T20:28:53.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-04-26T20:28:53.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-04-26T20:28:53.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-04-26T20:28:53.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-04-26T20:28:53.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-04-26T20:28:53.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-04-26T20:28:53.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-04-26T20:28:53.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-04-26T20:28:53.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-04-26T20:28:53.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-04-26T20:28:53.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-04-26T20:28:53.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-04-26T20:28:53.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-04-26T20:28:53.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-04-26T20:28:53.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-04-26T20:28:53.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-04-26T20:28:53.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-04-26T20:28:53.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-04-26T20:28:53.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-04-26T20:28:53.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-04-26T20:28:53.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-04-26T20:28:53.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-04-26T20:28:53.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-04-26T20:28:53.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-04-26T20:28:53.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-04-26T20:28:53.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-04-26T20:28:53.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-04-26T20:28:53.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-04-26T20:28:53.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-04-26T20:28:53.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-04-26T20:28:53.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-04-26T20:28:53.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-04-26T20:28:53.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-04-26T20:28:53.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-04-26T20:28:53.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-04-26T20:28:53.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-04-26T20:28:53.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-04-26T20:28:53.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-04-26T20:28:53.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-04-26T20:28:53.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-04-26T20:28:53.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-04-26T20:28:53.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-04-26T20:28:53.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-04-26T20:28:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:52 smithi098 ceph-mon[32591]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 14 op/s 2024-04-26T20:28:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:52 smithi098 ceph-mon[32591]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-04-26T20:28:53.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-04-26T20:28:53.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-04-26T20:28:53.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-04-26T20:28:53.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-04-26T20:28:53.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-04-26T20:28:53.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-04-26T20:28:53.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-04-26T20:28:53.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-04-26T20:28:53.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-04-26T20:28:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:52 smithi080 ceph-mon[32278]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 14 op/s 2024-04-26T20:28:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:52 smithi080 ceph-mon[32278]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-04-26T20:28:53.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-04-26T20:28:53.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-04-26T20:28:53.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-04-26T20:28:53.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-04-26T20:28:53.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-04-26T20:28:53.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-04-26T20:28:53.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-04-26T20:28:53.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-04-26T20:28:53.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-04-26T20:28:53.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-04-26T20:28:53.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-04-26T20:28:53.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-04-26T20:28:53.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-04-26T20:28:53.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-04-26T20:28:53.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-04-26T20:28:53.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-04-26T20:28:53.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-04-26T20:28:53.238 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-04-26T20:28:53.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-04-26T20:28:53.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-04-26T20:28:53.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-04-26T20:28:53.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-04-26T20:28:53.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-04-26T20:28:53.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-04-26T20:28:53.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-04-26T20:28:53.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-04-26T20:28:53.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-04-26T20:28:53.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-04-26T20:28:53.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-04-26T20:28:53.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-04-26T20:28:53.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-04-26T20:28:53.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-04-26T20:28:53.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-04-26T20:28:53.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-04-26T20:28:53.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-04-26T20:28:53.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-04-26T20:28:53.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-04-26T20:28:53.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-04-26T20:28:53.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-04-26T20:28:53.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-04-26T20:28:53.263 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-04-26T20:28:53.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-04-26T20:28:53.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-04-26T20:28:53.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-04-26T20:28:53.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-04-26T20:28:53.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-04-26T20:28:53.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-04-26T20:28:53.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-04-26T20:28:53.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-04-26T20:28:53.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-04-26T20:28:53.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-04-26T20:28:53.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-04-26T20:28:53.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-04-26T20:28:53.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-04-26T20:28:53.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-04-26T20:28:53.280 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-04-26T20:28:53.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-04-26T20:28:53.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-04-26T20:28:53.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-04-26T20:28:53.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-04-26T20:28:53.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-04-26T20:28:53.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-04-26T20:28:53.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-04-26T20:28:53.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-04-26T20:28:53.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-04-26T20:28:53.291 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-04-26T20:28:53.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-04-26T20:28:53.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-04-26T20:28:53.295 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-04-26T20:28:53.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-04-26T20:28:53.297 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-04-26T20:28:53.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-04-26T20:28:53.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-04-26T20:28:53.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-04-26T20:28:53.301 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-04-26T20:28:53.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-04-26T20:28:53.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-04-26T20:28:53.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-04-26T20:28:53.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-04-26T20:28:53.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-04-26T20:28:53.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-04-26T20:28:53.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-04-26T20:28:53.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-04-26T20:28:53.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-04-26T20:28:53.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-04-26T20:28:53.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-04-26T20:28:53.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-04-26T20:28:53.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-04-26T20:28:53.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-04-26T20:28:53.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-04-26T20:28:53.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-04-26T20:28:53.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-04-26T20:28:53.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-04-26T20:28:53.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-04-26T20:28:53.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-04-26T20:28:53.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-04-26T20:28:53.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-04-26T20:28:53.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-04-26T20:28:53.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-04-26T20:28:53.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-04-26T20:28:53.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-04-26T20:28:53.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-04-26T20:28:53.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-04-26T20:28:53.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-04-26T20:28:53.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-04-26T20:28:53.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-04-26T20:28:53.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-04-26T20:28:53.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-04-26T20:28:53.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-04-26T20:28:53.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-04-26T20:28:53.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-04-26T20:28:53.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-04-26T20:28:53.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-04-26T20:28:53.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-04-26T20:28:53.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-04-26T20:28:53.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-04-26T20:28:53.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-04-26T20:28:53.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-04-26T20:28:53.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-04-26T20:28:53.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-04-26T20:28:53.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-04-26T20:28:53.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-04-26T20:28:53.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-04-26T20:28:53.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-04-26T20:28:53.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-04-26T20:28:53.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-04-26T20:28:53.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-04-26T20:28:53.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-04-26T20:28:53.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-04-26T20:28:53.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-04-26T20:28:53.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-04-26T20:28:53.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-04-26T20:28:53.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-04-26T20:28:53.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-04-26T20:28:53.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-04-26T20:28:53.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-04-26T20:28:53.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-04-26T20:28:53.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-04-26T20:28:53.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-04-26T20:28:53.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-04-26T20:28:53.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-04-26T20:28:53.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-04-26T20:28:53.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-04-26T20:28:53.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-04-26T20:28:53.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-04-26T20:28:53.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-04-26T20:28:53.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-04-26T20:28:53.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-04-26T20:28:53.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-04-26T20:28:53.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-04-26T20:28:53.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-04-26T20:28:53.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-04-26T20:28:53.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-04-26T20:28:53.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-04-26T20:28:53.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-04-26T20:28:53.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-04-26T20:28:53.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-04-26T20:28:53.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-04-26T20:28:53.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-04-26T20:28:53.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-04-26T20:28:53.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-04-26T20:28:53.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-04-26T20:28:53.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-04-26T20:28:53.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-04-26T20:28:53.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-04-26T20:28:53.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-04-26T20:28:53.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-04-26T20:28:53.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-04-26T20:28:53.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-04-26T20:28:53.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-04-26T20:28:53.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-04-26T20:28:53.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-04-26T20:28:53.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-04-26T20:28:53.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-04-26T20:28:53.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-04-26T20:28:53.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-04-26T20:28:53.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-04-26T20:28:53.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-04-26T20:28:53.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-04-26T20:28:53.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-04-26T20:28:53.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-04-26T20:28:53.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-04-26T20:28:53.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-04-26T20:28:53.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-04-26T20:28:53.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-04-26T20:28:53.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-04-26T20:28:53.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-04-26T20:28:53.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-04-26T20:28:53.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-04-26T20:28:53.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-04-26T20:28:53.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-04-26T20:28:53.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-04-26T20:28:53.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-04-26T20:28:53.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-04-26T20:28:53.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-04-26T20:28:53.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-04-26T20:28:53.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-04-26T20:28:53.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-04-26T20:28:53.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-04-26T20:28:53.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-04-26T20:28:53.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-04-26T20:28:53.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-04-26T20:28:53.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-04-26T20:28:53.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-04-26T20:28:53.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-04-26T20:28:53.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-04-26T20:28:53.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-04-26T20:28:53.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-04-26T20:28:53.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-04-26T20:28:53.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-04-26T20:28:53.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-04-26T20:28:53.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-04-26T20:28:53.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-04-26T20:28:53.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-04-26T20:28:53.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-04-26T20:28:53.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-04-26T20:28:53.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-04-26T20:28:53.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-04-26T20:28:53.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-04-26T20:28:53.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-04-26T20:28:53.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-04-26T20:28:53.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-04-26T20:28:53.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-04-26T20:28:53.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-04-26T20:28:53.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-04-26T20:28:53.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-04-26T20:28:53.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-04-26T20:28:53.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-04-26T20:28:53.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-04-26T20:28:53.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-04-26T20:28:53.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-04-26T20:28:53.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-04-26T20:28:53.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-04-26T20:28:53.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-04-26T20:28:53.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-04-26T20:28:53.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-04-26T20:28:53.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-04-26T20:28:53.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-04-26T20:28:53.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-04-26T20:28:53.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-04-26T20:28:53.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-04-26T20:28:53.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-04-26T20:28:53.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-04-26T20:28:53.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-04-26T20:28:53.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-04-26T20:28:53.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-04-26T20:28:53.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-04-26T20:28:53.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-04-26T20:28:53.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-04-26T20:28:53.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-04-26T20:28:53.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-04-26T20:28:53.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-04-26T20:28:53.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-04-26T20:28:53.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-04-26T20:28:53.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-04-26T20:28:53.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-04-26T20:28:53.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-04-26T20:28:53.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-04-26T20:28:53.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-04-26T20:28:53.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-04-26T20:28:53.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-04-26T20:28:53.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-04-26T20:28:53.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-04-26T20:28:53.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-04-26T20:28:53.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-04-26T20:28:53.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-04-26T20:28:53.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-04-26T20:28:53.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-04-26T20:28:53.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-04-26T20:28:53.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-04-26T20:28:53.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-04-26T20:28:53.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-04-26T20:28:53.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-04-26T20:28:53.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-04-26T20:28:53.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-04-26T20:28:53.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-04-26T20:28:53.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-04-26T20:28:53.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-04-26T20:28:53.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-04-26T20:28:53.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-04-26T20:28:53.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-04-26T20:28:53.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-04-26T20:28:53.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-04-26T20:28:53.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-04-26T20:28:53.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-04-26T20:28:53.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-04-26T20:28:53.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-04-26T20:28:53.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-04-26T20:28:53.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-04-26T20:28:53.605 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-04-26T20:28:53.607 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-04-26T20:28:53.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-04-26T20:28:53.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-04-26T20:28:53.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-04-26T20:28:53.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-04-26T20:28:53.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-04-26T20:28:53.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-04-26T20:28:53.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-04-26T20:28:53.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-04-26T20:28:53.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-04-26T20:28:53.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-04-26T20:28:53.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-04-26T20:28:53.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-04-26T20:28:53.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-04-26T20:28:53.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-04-26T20:28:53.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-04-26T20:28:53.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-04-26T20:28:53.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-04-26T20:28:53.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-04-26T20:28:53.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-04-26T20:28:53.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-04-26T20:28:53.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-04-26T20:28:53.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-04-26T20:28:53.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-04-26T20:28:53.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-04-26T20:28:53.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-04-26T20:28:53.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-04-26T20:28:53.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-04-26T20:28:53.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-04-26T20:28:53.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-04-26T20:28:53.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-04-26T20:28:53.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-04-26T20:28:53.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-04-26T20:28:53.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-04-26T20:28:53.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-04-26T20:28:53.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-04-26T20:28:53.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-04-26T20:28:53.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-04-26T20:28:53.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-04-26T20:28:53.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-04-26T20:28:53.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-04-26T20:28:53.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-04-26T20:28:53.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-04-26T20:28:53.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-04-26T20:28:53.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-04-26T20:28:53.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-04-26T20:28:53.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-04-26T20:28:53.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-04-26T20:28:53.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-04-26T20:28:53.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-04-26T20:28:53.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-04-26T20:28:53.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-04-26T20:28:53.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-04-26T20:28:53.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-04-26T20:28:53.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-04-26T20:28:53.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-04-26T20:28:53.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-04-26T20:28:53.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-04-26T20:28:53.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-04-26T20:28:53.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-04-26T20:28:53.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-04-26T20:28:53.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-04-26T20:28:53.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-04-26T20:28:53.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-04-26T20:28:53.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-04-26T20:28:53.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-04-26T20:28:53.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-04-26T20:28:53.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-04-26T20:28:53.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-04-26T20:28:53.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-04-26T20:28:53.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-04-26T20:28:53.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-04-26T20:28:53.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-04-26T20:28:53.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-04-26T20:28:53.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-04-26T20:28:53.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-04-26T20:28:53.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-04-26T20:28:53.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-04-26T20:28:53.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-04-26T20:28:53.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-04-26T20:28:53.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-04-26T20:28:53.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-04-26T20:28:53.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-04-26T20:28:53.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-04-26T20:28:53.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-04-26T20:28:53.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-04-26T20:28:53.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-04-26T20:28:53.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-04-26T20:28:53.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-04-26T20:28:53.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-04-26T20:28:53.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-04-26T20:28:53.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-04-26T20:28:53.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-04-26T20:28:53.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-04-26T20:28:53.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-04-26T20:28:53.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-04-26T20:28:53.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-04-26T20:28:53.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-04-26T20:28:53.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-04-26T20:28:53.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-04-26T20:28:53.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-04-26T20:28:53.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-04-26T20:28:53.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-04-26T20:28:53.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-04-26T20:28:53.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-04-26T20:28:53.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-04-26T20:28:53.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-04-26T20:28:53.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-04-26T20:28:53.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-04-26T20:28:53.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-04-26T20:28:53.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-04-26T20:28:53.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-04-26T20:28:53.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-04-26T20:28:53.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-04-26T20:28:53.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-04-26T20:28:53.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-04-26T20:28:53.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-04-26T20:28:53.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-04-26T20:28:53.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-04-26T20:28:53.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-04-26T20:28:53.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-04-26T20:28:53.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-04-26T20:28:53.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-04-26T20:28:53.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-04-26T20:28:53.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-04-26T20:28:53.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-04-26T20:28:53.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-04-26T20:28:53.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-04-26T20:28:53.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-04-26T20:28:53.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-04-26T20:28:53.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-04-26T20:28:53.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-04-26T20:28:53.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-04-26T20:28:53.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-04-26T20:28:53.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-04-26T20:28:53.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-04-26T20:28:53.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-04-26T20:28:53.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-04-26T20:28:53.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-04-26T20:28:53.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-04-26T20:28:53.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-04-26T20:28:53.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-04-26T20:28:53.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-04-26T20:28:53.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-04-26T20:28:53.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-04-26T20:28:53.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-04-26T20:28:53.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-04-26T20:28:53.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-04-26T20:28:53.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-04-26T20:28:53.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-04-26T20:28:53.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-04-26T20:28:53.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-04-26T20:28:53.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-04-26T20:28:53.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-04-26T20:28:53.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-04-26T20:28:53.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-04-26T20:28:53.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-04-26T20:28:53.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-04-26T20:28:53.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-04-26T20:28:53.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-04-26T20:28:53.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-04-26T20:28:53.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-04-26T20:28:53.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-04-26T20:28:53.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-04-26T20:28:53.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-04-26T20:28:53.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-04-26T20:28:53.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-04-26T20:28:53.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-04-26T20:28:53.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-04-26T20:28:53.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-04-26T20:28:53.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-04-26T20:28:53.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-04-26T20:28:53.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-04-26T20:28:53.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-04-26T20:28:53.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-04-26T20:28:53.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-04-26T20:28:53.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-04-26T20:28:53.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-04-26T20:28:53.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-04-26T20:28:53.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-04-26T20:28:53.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-04-26T20:28:53.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-04-26T20:28:53.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-04-26T20:28:53.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-04-26T20:28:53.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-04-26T20:28:53.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-04-26T20:28:53.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-04-26T20:28:53.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-04-26T20:28:53.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-04-26T20:28:53.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-04-26T20:28:53.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-04-26T20:28:53.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-04-26T20:28:53.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-04-26T20:28:53.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-04-26T20:28:53.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-04-26T20:28:53.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-04-26T20:28:53.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-04-26T20:28:54.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-04-26T20:28:54.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-04-26T20:28:54.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-04-26T20:28:54.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-04-26T20:28:54.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-04-26T20:28:54.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-04-26T20:28:54.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-04-26T20:28:54.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-04-26T20:28:54.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-04-26T20:28:54.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-04-26T20:28:54.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-04-26T20:28:54.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-04-26T20:28:54.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-04-26T20:28:54.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-04-26T20:28:54.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-04-26T20:28:54.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-04-26T20:28:54.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-04-26T20:28:54.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-04-26T20:28:54.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-04-26T20:28:54.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-04-26T20:28:54.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-04-26T20:28:54.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-04-26T20:28:54.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-04-26T20:28:54.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-04-26T20:28:54.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-04-26T20:28:54.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-04-26T20:28:54.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-04-26T20:28:54.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-04-26T20:28:54.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-04-26T20:28:54.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-04-26T20:28:54.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-04-26T20:28:54.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-04-26T20:28:54.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-04-26T20:28:54.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-04-26T20:28:54.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-04-26T20:28:54.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-04-26T20:28:54.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-04-26T20:28:54.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-04-26T20:28:54.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-04-26T20:28:54.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-04-26T20:28:54.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-04-26T20:28:54.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-04-26T20:28:54.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-04-26T20:28:54.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-04-26T20:28:54.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-04-26T20:28:54.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-04-26T20:28:54.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-04-26T20:28:54.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-04-26T20:28:54.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-04-26T20:28:54.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-04-26T20:28:54.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-04-26T20:28:54.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-04-26T20:28:54.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-04-26T20:28:54.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-04-26T20:28:54.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-04-26T20:28:54.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-04-26T20:28:54.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-04-26T20:28:54.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-04-26T20:28:54.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-04-26T20:28:54.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-04-26T20:28:54.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-04-26T20:28:54.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-04-26T20:28:54.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-04-26T20:28:54.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-04-26T20:28:54.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-04-26T20:28:54.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-04-26T20:28:54.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-04-26T20:28:54.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-04-26T20:28:54.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-04-26T20:28:54.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-04-26T20:28:54.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-04-26T20:28:54.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-04-26T20:28:54.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-04-26T20:28:54.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-04-26T20:28:54.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-04-26T20:28:54.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-04-26T20:28:54.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-04-26T20:28:54.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-04-26T20:28:54.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-04-26T20:28:54.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-04-26T20:28:54.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-04-26T20:28:54.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-04-26T20:28:54.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-04-26T20:28:54.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-04-26T20:28:54.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-04-26T20:28:54.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-04-26T20:28:54.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-04-26T20:28:54.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-04-26T20:28:54.149 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-04-26T20:28:54.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-04-26T20:28:54.151 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-04-26T20:28:54.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-04-26T20:28:54.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-04-26T20:28:54.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-04-26T20:28:54.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-04-26T20:28:54.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-04-26T20:28:54.158 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-04-26T20:28:54.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-04-26T20:28:54.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-04-26T20:28:54.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-04-26T20:28:54.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-04-26T20:28:54.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-04-26T20:28:54.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-04-26T20:28:54.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-04-26T20:28:54.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-04-26T20:28:54.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-04-26T20:28:54.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-04-26T20:28:54.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-04-26T20:28:54.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-04-26T20:28:54.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-04-26T20:28:54.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-04-26T20:28:54.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-04-26T20:28:54.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-04-26T20:28:54.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-04-26T20:28:54.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-04-26T20:28:54.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-04-26T20:28:54.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-04-26T20:28:54.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-04-26T20:28:54.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-04-26T20:28:54.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-04-26T20:28:54.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-04-26T20:28:54.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-04-26T20:28:54.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-04-26T20:28:54.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-04-26T20:28:54.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-04-26T20:28:54.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-04-26T20:28:54.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-04-26T20:28:54.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-04-26T20:28:54.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-04-26T20:28:54.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-04-26T20:28:54.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-04-26T20:28:54.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-04-26T20:28:54.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-04-26T20:28:54.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-04-26T20:28:54.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-04-26T20:28:54.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-04-26T20:28:54.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-04-26T20:28:54.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-04-26T20:28:54.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-04-26T20:28:54.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-04-26T20:28:54.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-04-26T20:28:54.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-04-26T20:28:54.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-04-26T20:28:54.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-04-26T20:28:54.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-04-26T20:28:54.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-04-26T20:28:54.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-04-26T20:28:54.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-04-26T20:28:54.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-04-26T20:28:54.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-04-26T20:28:54.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-04-26T20:28:54.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-04-26T20:28:54.215 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-04-26T20:28:54.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-04-26T20:28:54.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-04-26T20:28:54.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-04-26T20:28:54.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-04-26T20:28:54.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-04-26T20:28:54.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-04-26T20:28:54.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-04-26T20:28:54.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-04-26T20:28:54.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-04-26T20:28:54.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-04-26T20:28:54.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-04-26T20:28:54.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-04-26T20:28:54.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-04-26T20:28:54.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-04-26T20:28:54.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-04-26T20:28:54.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-04-26T20:28:54.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-04-26T20:28:54.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-04-26T20:28:54.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-04-26T20:28:54.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-04-26T20:28:54.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-04-26T20:28:54.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-04-26T20:28:54.238 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-04-26T20:28:54.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-04-26T20:28:54.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-04-26T20:28:54.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-04-26T20:28:54.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-04-26T20:28:54.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-04-26T20:28:54.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-04-26T20:28:54.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-04-26T20:28:54.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-04-26T20:28:54.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-04-26T20:28:54.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-04-26T20:28:54.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-04-26T20:28:54.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-04-26T20:28:54.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-04-26T20:28:54.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-04-26T20:28:54.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-04-26T20:28:54.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-04-26T20:28:54.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-04-26T20:28:54.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-04-26T20:28:54.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-04-26T20:28:54.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-04-26T20:28:54.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-04-26T20:28:54.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-04-26T20:28:54.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-04-26T20:28:54.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-04-26T20:28:54.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-04-26T20:28:54.263 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-04-26T20:28:54.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-04-26T20:28:54.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-04-26T20:28:54.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-04-26T20:28:54.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-04-26T20:28:54.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-04-26T20:28:54.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-04-26T20:28:54.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-04-26T20:28:54.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-04-26T20:28:54.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-04-26T20:28:54.273 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-04-26T20:28:54.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-04-26T20:28:54.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-04-26T20:28:54.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-04-26T20:28:54.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-04-26T20:28:54.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-04-26T20:28:54.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-04-26T20:28:54.280 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-04-26T20:28:54.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-04-26T20:28:54.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-04-26T20:28:54.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-04-26T20:28:54.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-04-26T20:28:54.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-04-26T20:28:54.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-04-26T20:28:54.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-04-26T20:28:54.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-04-26T20:28:54.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-04-26T20:28:54.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-04-26T20:28:54.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-04-26T20:28:54.291 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-04-26T20:28:54.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-04-26T20:28:54.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-04-26T20:28:54.295 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-04-26T20:28:54.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-04-26T20:28:54.297 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-04-26T20:28:54.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-04-26T20:28:54.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-04-26T20:28:54.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-04-26T20:28:54.301 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-04-26T20:28:54.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-04-26T20:28:54.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-04-26T20:28:54.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-04-26T20:28:54.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-04-26T20:28:54.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-04-26T20:28:54.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-04-26T20:28:54.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-04-26T20:28:54.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-04-26T20:28:54.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-04-26T20:28:54.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-04-26T20:28:54.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-04-26T20:28:54.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-04-26T20:28:54.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-04-26T20:28:54.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-04-26T20:28:54.316 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-04-26T20:28:54.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-04-26T20:28:54.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-04-26T20:28:54.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-04-26T20:28:54.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-04-26T20:28:54.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-04-26T20:28:54.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-04-26T20:28:54.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-04-26T20:28:54.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-04-26T20:28:54.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-04-26T20:28:54.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-04-26T20:28:54.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-04-26T20:28:54.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-04-26T20:28:54.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-04-26T20:28:54.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-04-26T20:28:54.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-04-26T20:28:54.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-04-26T20:28:54.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-04-26T20:28:54.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-04-26T20:28:54.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-04-26T20:28:54.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-04-26T20:28:54.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-04-26T20:28:54.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-04-26T20:28:54.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-04-26T20:28:54.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-04-26T20:28:54.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-04-26T20:28:54.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-04-26T20:28:54.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-04-26T20:28:54.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-04-26T20:28:54.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-04-26T20:28:54.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-04-26T20:28:54.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-04-26T20:28:54.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-04-26T20:28:54.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-04-26T20:28:54.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-04-26T20:28:54.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-04-26T20:28:54.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-04-26T20:28:54.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-04-26T20:28:54.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-04-26T20:28:54.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-04-26T20:28:54.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-04-26T20:28:54.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-04-26T20:28:54.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-04-26T20:28:54.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-04-26T20:28:54.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-04-26T20:28:54.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-04-26T20:28:54.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-04-26T20:28:54.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-04-26T20:28:54.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-04-26T20:28:54.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-04-26T20:28:54.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-04-26T20:28:54.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-04-26T20:28:54.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-04-26T20:28:54.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-04-26T20:28:54.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-04-26T20:28:54.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-04-26T20:28:54.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-04-26T20:28:54.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-04-26T20:28:54.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-04-26T20:28:54.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-04-26T20:28:54.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-04-26T20:28:54.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-04-26T20:28:54.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-04-26T20:28:54.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-04-26T20:28:54.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-04-26T20:28:54.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-04-26T20:28:54.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-04-26T20:28:54.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-04-26T20:28:54.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-04-26T20:28:54.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-04-26T20:28:54.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-04-26T20:28:54.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-04-26T20:28:54.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-04-26T20:28:54.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-04-26T20:28:54.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-04-26T20:28:54.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-04-26T20:28:54.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-04-26T20:28:54.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-04-26T20:28:54.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-04-26T20:28:54.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-04-26T20:28:54.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-04-26T20:28:54.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-04-26T20:28:54.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-04-26T20:28:54.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-04-26T20:28:54.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-04-26T20:28:54.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-04-26T20:28:54.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-04-26T20:28:54.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-04-26T20:28:54.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-04-26T20:28:54.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-04-26T20:28:54.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-04-26T20:28:54.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-04-26T20:28:54.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-04-26T20:28:54.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-04-26T20:28:54.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-04-26T20:28:54.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-04-26T20:28:54.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-04-26T20:28:54.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-04-26T20:28:54.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-04-26T20:28:54.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-04-26T20:28:54.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-04-26T20:28:54.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-04-26T20:28:54.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-04-26T20:28:54.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-04-26T20:28:54.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-04-26T20:28:54.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-04-26T20:28:54.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-04-26T20:28:54.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-04-26T20:28:54.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-04-26T20:28:54.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-04-26T20:28:54.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-04-26T20:28:54.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-04-26T20:28:54.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-04-26T20:28:54.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-04-26T20:28:54.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-04-26T20:28:54.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-04-26T20:28:54.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-04-26T20:28:54.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-04-26T20:28:54.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-04-26T20:28:54.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-04-26T20:28:54.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-04-26T20:28:54.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-04-26T20:28:54.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-04-26T20:28:54.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-04-26T20:28:54.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-04-26T20:28:54.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-04-26T20:28:54.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-04-26T20:28:54.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-04-26T20:28:54.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-04-26T20:28:54.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-04-26T20:28:54.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-04-26T20:28:54.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-04-26T20:28:54.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-04-26T20:28:54.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-04-26T20:28:54.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-04-26T20:28:54.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-04-26T20:28:54.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-04-26T20:28:54.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-04-26T20:28:54.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-04-26T20:28:54.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-04-26T20:28:54.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-04-26T20:28:54.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-04-26T20:28:54.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-04-26T20:28:54.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-04-26T20:28:54.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-04-26T20:28:54.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-04-26T20:28:54.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-04-26T20:28:54.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-04-26T20:28:54.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-04-26T20:28:54.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-04-26T20:28:54.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-04-26T20:28:54.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-04-26T20:28:54.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-04-26T20:28:54.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-04-26T20:28:54.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-04-26T20:28:54.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-04-26T20:28:54.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-04-26T20:28:54.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-04-26T20:28:54.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-04-26T20:28:54.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-04-26T20:28:54.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-04-26T20:28:54.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-04-26T20:28:54.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-04-26T20:28:54.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-04-26T20:28:54.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-04-26T20:28:54.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-04-26T20:28:54.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-04-26T20:28:54.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-04-26T20:28:54.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-04-26T20:28:54.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-04-26T20:28:54.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-04-26T20:28:54.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-04-26T20:28:54.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-04-26T20:28:54.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-04-26T20:28:54.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-04-26T20:28:54.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-04-26T20:28:54.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-04-26T20:28:54.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-04-26T20:28:54.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-04-26T20:28:54.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-04-26T20:28:54.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-04-26T20:28:54.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-04-26T20:28:54.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-04-26T20:28:54.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-04-26T20:28:54.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-04-26T20:28:54.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-04-26T20:28:54.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-04-26T20:28:54.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-04-26T20:28:54.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-04-26T20:28:54.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-04-26T20:28:54.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-04-26T20:28:54.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-04-26T20:28:54.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-04-26T20:28:54.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-04-26T20:28:54.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-04-26T20:28:54.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-04-26T20:28:54.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-04-26T20:28:54.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-04-26T20:28:54.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-04-26T20:28:54.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-04-26T20:28:54.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-04-26T20:28:54.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-04-26T20:28:54.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-04-26T20:28:54.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-04-26T20:28:54.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-04-26T20:28:54.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-04-26T20:28:54.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-04-26T20:28:54.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-04-26T20:28:54.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-04-26T20:28:54.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-04-26T20:28:54.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-04-26T20:28:54.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-04-26T20:28:54.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-04-26T20:28:54.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-04-26T20:28:54.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-04-26T20:28:54.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-04-26T20:28:54.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-04-26T20:28:54.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-04-26T20:28:54.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-04-26T20:28:54.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-04-26T20:28:54.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-04-26T20:28:54.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-04-26T20:28:54.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-04-26T20:28:54.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-04-26T20:28:54.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-04-26T20:28:54.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-04-26T20:28:54.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-04-26T20:28:54.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-04-26T20:28:54.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-04-26T20:28:54.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-04-26T20:28:54.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-04-26T20:28:54.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-04-26T20:28:54.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-04-26T20:28:54.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-04-26T20:28:54.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-04-26T20:28:54.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-04-26T20:28:54.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-04-26T20:28:54.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-04-26T20:28:54.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-04-26T20:28:54.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-04-26T20:28:54.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-04-26T20:28:54.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-04-26T20:28:54.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-04-26T20:28:54.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-04-26T20:28:54.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-04-26T20:28:54.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-04-26T20:28:54.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-04-26T20:28:54.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-04-26T20:28:54.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-04-26T20:28:54.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-04-26T20:28:54.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-04-26T20:28:54.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-04-26T20:28:54.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-04-26T20:28:54.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-04-26T20:28:54.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-04-26T20:28:54.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-04-26T20:28:54.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-04-26T20:28:54.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-04-26T20:28:54.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-04-26T20:28:54.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-04-26T20:28:54.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-04-26T20:28:54.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-04-26T20:28:54.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-04-26T20:28:54.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-04-26T20:28:54.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-04-26T20:28:54.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-04-26T20:28:54.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-04-26T20:28:54.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-04-26T20:28:54.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-04-26T20:28:54.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-04-26T20:28:54.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-04-26T20:28:54.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-04-26T20:28:54.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-04-26T20:28:54.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-04-26T20:28:54.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-04-26T20:28:54.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-04-26T20:28:54.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-04-26T20:28:54.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-04-26T20:28:54.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-04-26T20:28:54.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-04-26T20:28:54.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-04-26T20:28:54.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-04-26T20:28:54.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-04-26T20:28:54.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-04-26T20:28:54.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-04-26T20:28:54.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-04-26T20:28:54.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-04-26T20:28:54.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-04-26T20:28:54.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-04-26T20:28:54.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-04-26T20:28:54.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-04-26T20:28:54.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-04-26T20:28:54.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-04-26T20:28:54.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-04-26T20:28:54.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-04-26T20:28:54.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-04-26T20:28:54.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-04-26T20:28:54.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-04-26T20:28:54.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-04-26T20:28:54.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-04-26T20:28:54.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-04-26T20:28:54.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-04-26T20:28:54.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-04-26T20:28:54.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-04-26T20:28:54.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-04-26T20:28:54.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-04-26T20:28:54.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-04-26T20:28:54.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-04-26T20:28:54.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-04-26T20:28:54.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-04-26T20:28:54.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-04-26T20:28:54.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-04-26T20:28:54.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-04-26T20:28:54.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-04-26T20:28:54.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-04-26T20:28:54.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-04-26T20:28:54.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-04-26T20:28:54.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-04-26T20:28:54.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/digsig.txt 2024-04-26T20:28:54.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-04-26T20:28:54.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-04-26T20:28:54.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-04-26T20:28:54.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-04-26T20:28:54.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-04-26T20:28:54.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-04-26T20:28:54.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dontdiff 2024-04-26T20:28:54.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/ 2024-04-26T20:28:54.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-04-26T20:28:54.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-04-26T20:28:54.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-04-26T20:28:54.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-04-26T20:28:54.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-04-26T20:28:54.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-04-26T20:28:54.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-04-26T20:28:54.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-04-26T20:28:54.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-04-26T20:28:54.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-04-26T20:28:54.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ 2024-04-26T20:28:54.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-04-26T20:28:54.867 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-04-26T20:28:54.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-04-26T20:28:54.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-04-26T20:28:54.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-04-26T20:28:54.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-04-26T20:28:54.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-04-26T20:28:54.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-04-26T20:28:54.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-04-26T20:28:54.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-04-26T20:28:54.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-04-26T20:28:54.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-04-26T20:28:54.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-04-26T20:28:54.878 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-04-26T20:28:54.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-04-26T20:28:54.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-04-26T20:28:54.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-04-26T20:28:54.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-04-26T20:28:54.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/edac.txt 2024-04-26T20:28:54.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-04-26T20:28:54.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/eisa.txt 2024-04-26T20:28:54.886 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-04-26T20:28:54.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/extcon/ 2024-04-26T20:28:54.888 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-04-26T20:28:54.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-04-26T20:28:54.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-04-26T20:28:54.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-04-26T20:28:54.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-04-26T20:28:54.892 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/ 2024-04-26T20:28:54.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-04-26T20:28:54.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-04-26T20:28:54.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-04-26T20:28:54.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-04-26T20:28:54.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-04-26T20:28:54.898 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-04-26T20:28:54.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-04-26T20:28:54.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-04-26T20:28:54.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-04-26T20:28:54.902 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-04-26T20:28:54.902 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-04-26T20:28:54.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-04-26T20:28:54.904 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-04-26T20:28:54.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-04-26T20:28:54.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-04-26T20:28:54.907 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-04-26T20:28:54.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-04-26T20:28:54.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-04-26T20:28:54.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-04-26T20:28:54.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-04-26T20:28:54.912 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-04-26T20:28:54.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-04-26T20:28:54.914 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-04-26T20:28:54.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-04-26T20:28:54.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-04-26T20:28:54.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-04-26T20:28:54.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-04-26T20:28:54.919 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-04-26T20:28:54.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-04-26T20:28:54.921 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-04-26T20:28:54.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-04-26T20:28:54.923 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-04-26T20:28:54.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-04-26T20:28:54.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-04-26T20:28:54.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-04-26T20:28:54.927 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ 2024-04-26T20:28:54.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-04-26T20:28:54.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-04-26T20:28:54.930 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-04-26T20:28:54.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-04-26T20:28:54.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-04-26T20:28:54.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-04-26T20:28:54.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-04-26T20:28:54.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-04-26T20:28:54.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-04-26T20:28:54.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-04-26T20:28:54.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-04-26T20:28:54.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-04-26T20:28:54.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-04-26T20:28:54.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-04-26T20:28:54.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-04-26T20:28:54.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-04-26T20:28:54.943 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-04-26T20:28:54.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-04-26T20:28:54.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-04-26T20:28:54.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-04-26T20:28:54.947 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-04-26T20:28:54.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-04-26T20:28:54.949 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-04-26T20:28:54.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-04-26T20:28:54.951 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-04-26T20:28:54.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-04-26T20:28:54.953 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-04-26T20:28:54.953 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-04-26T20:28:54.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-04-26T20:28:54.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-04-26T20:28:54.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-04-26T20:28:54.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-04-26T20:28:54.958 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-04-26T20:28:54.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-04-26T20:28:54.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-04-26T20:28:54.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-04-26T20:28:54.961 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-04-26T20:28:54.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-04-26T20:28:54.963 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-04-26T20:28:54.964 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-04-26T20:28:54.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-04-26T20:28:54.966 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-04-26T20:28:54.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-04-26T20:28:54.968 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-04-26T20:28:54.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-04-26T20:28:54.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-04-26T20:28:54.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-04-26T20:28:54.972 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-04-26T20:28:54.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-04-26T20:28:54.974 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-04-26T20:28:54.974 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-04-26T20:28:54.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-04-26T20:28:54.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-04-26T20:28:54.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-04-26T20:28:54.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-04-26T20:28:54.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-04-26T20:28:54.980 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-04-26T20:28:54.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-04-26T20:28:54.982 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-04-26T20:28:54.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-04-26T20:28:54.984 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-04-26T20:28:54.985 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-04-26T20:28:54.986 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-04-26T20:28:54.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-04-26T20:28:54.988 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-04-26T20:28:54.988 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-04-26T20:28:54.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-04-26T20:28:54.990 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-04-26T20:28:54.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-04-26T20:28:54.992 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-04-26T20:28:54.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-04-26T20:28:54.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-04-26T20:28:54.994 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-04-26T20:28:54.995 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-04-26T20:28:54.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-04-26T20:28:54.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-04-26T20:28:54.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-04-26T20:28:54.999 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-04-26T20:28:55.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-04-26T20:28:55.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-04-26T20:28:55.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-04-26T20:28:55.003 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-04-26T20:28:55.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-04-26T20:28:55.005 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-04-26T20:28:55.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-04-26T20:28:55.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-04-26T20:28:55.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-04-26T20:28:55.010 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:54 smithi098 ceph-mon[32591]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-04-26T20:28:55.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-04-26T20:28:55.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-04-26T20:28:55.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-04-26T20:28:55.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-04-26T20:28:55.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-04-26T20:28:55.018 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-04-26T20:28:55.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-04-26T20:28:55.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-04-26T20:28:55.021 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:54 smithi080 ceph-mon[32278]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-04-26T20:28:55.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-04-26T20:28:55.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-04-26T20:28:55.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-04-26T20:28:55.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-04-26T20:28:55.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-04-26T20:28:55.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-04-26T20:28:55.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-04-26T20:28:55.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-04-26T20:28:55.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-04-26T20:28:55.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:54 smithi070 ceph-mon[29124]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-04-26T20:28:55.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-04-26T20:28:55.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-04-26T20:28:55.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-04-26T20:28:55.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-04-26T20:28:55.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-04-26T20:28:55.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-04-26T20:28:55.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-04-26T20:28:55.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-04-26T20:28:55.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-04-26T20:28:55.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-04-26T20:28:55.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-04-26T20:28:55.054 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-04-26T20:28:55.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-04-26T20:28:55.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-04-26T20:28:55.057 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-04-26T20:28:55.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/ 2024-04-26T20:28:55.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-04-26T20:28:55.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-04-26T20:28:55.062 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-04-26T20:28:55.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-04-26T20:28:55.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-04-26T20:28:55.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-04-26T20:28:55.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-04-26T20:28:55.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-04-26T20:28:55.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-04-26T20:28:55.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-04-26T20:28:55.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-04-26T20:28:55.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/ 2024-04-26T20:28:55.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-04-26T20:28:55.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-04-26T20:28:55.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-04-26T20:28:55.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-04-26T20:28:55.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-04-26T20:28:55.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-04-26T20:28:55.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-04-26T20:28:55.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-04-26T20:28:55.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-04-26T20:28:55.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-04-26T20:28:55.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-04-26T20:28:55.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gcov.txt 2024-04-26T20:28:55.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-04-26T20:28:55.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/ 2024-04-26T20:28:55.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-04-26T20:28:55.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-04-26T20:28:55.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-04-26T20:28:55.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-04-26T20:28:55.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-04-26T20:28:55.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-04-26T20:28:55.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-04-26T20:28:55.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/ 2024-04-26T20:28:55.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-04-26T20:28:55.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-04-26T20:28:55.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-04-26T20:28:55.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-04-26T20:28:55.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-04-26T20:28:55.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/highuid.txt 2024-04-26T20:28:55.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hsi.txt 2024-04-26T20:28:55.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-04-26T20:28:55.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ 2024-04-26T20:28:55.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-04-26T20:28:55.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-04-26T20:28:55.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-04-26T20:28:55.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-04-26T20:28:55.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-04-26T20:28:55.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-04-26T20:28:55.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-04-26T20:28:55.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-04-26T20:28:55.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-04-26T20:28:55.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-04-26T20:28:55.126 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-04-26T20:28:55.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-04-26T20:28:55.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-04-26T20:28:55.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-04-26T20:28:55.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-04-26T20:28:55.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-04-26T20:28:55.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-04-26T20:28:55.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-04-26T20:28:55.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-04-26T20:28:55.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-04-26T20:28:55.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-04-26T20:28:55.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-04-26T20:28:55.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-04-26T20:28:55.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-04-26T20:28:55.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-04-26T20:28:55.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-04-26T20:28:55.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-04-26T20:28:55.151 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-04-26T20:28:55.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-04-26T20:28:55.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-04-26T20:28:55.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-04-26T20:28:55.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-04-26T20:28:55.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-04-26T20:28:55.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-04-26T20:28:55.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-04-26T20:28:55.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-04-26T20:28:55.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-04-26T20:28:55.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-04-26T20:28:55.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-04-26T20:28:55.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-04-26T20:28:55.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-04-26T20:28:55.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-04-26T20:28:55.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-04-26T20:28:55.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-04-26T20:28:55.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-04-26T20:28:55.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-04-26T20:28:55.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-04-26T20:28:55.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-04-26T20:28:55.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-04-26T20:28:55.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-04-26T20:28:55.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-04-26T20:28:55.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-04-26T20:28:55.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-04-26T20:28:55.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-04-26T20:28:55.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-04-26T20:28:55.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-04-26T20:28:55.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-04-26T20:28:55.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-04-26T20:28:55.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-04-26T20:28:55.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-04-26T20:28:55.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-04-26T20:28:55.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-04-26T20:28:55.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-04-26T20:28:55.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-04-26T20:28:55.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-04-26T20:28:55.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-04-26T20:28:55.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-04-26T20:28:55.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-04-26T20:28:55.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-04-26T20:28:55.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-04-26T20:28:55.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-04-26T20:28:55.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-04-26T20:28:55.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-04-26T20:28:55.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-04-26T20:28:55.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-04-26T20:28:55.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-04-26T20:28:55.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-04-26T20:28:55.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-04-26T20:28:55.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-04-26T20:28:55.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-04-26T20:28:55.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-04-26T20:28:55.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-04-26T20:28:55.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-04-26T20:28:55.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-04-26T20:28:55.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-04-26T20:28:55.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-04-26T20:28:55.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-04-26T20:28:55.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-04-26T20:28:55.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-04-26T20:28:55.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-04-26T20:28:55.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-04-26T20:28:55.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-04-26T20:28:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-04-26T20:28:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-04-26T20:28:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-04-26T20:28:55.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-04-26T20:28:55.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-04-26T20:28:55.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-04-26T20:28:55.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-04-26T20:28:55.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-04-26T20:28:55.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-04-26T20:28:55.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-04-26T20:28:55.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-04-26T20:28:55.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-04-26T20:28:55.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-04-26T20:28:55.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-04-26T20:28:55.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-04-26T20:28:55.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-04-26T20:28:55.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-04-26T20:28:55.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-04-26T20:28:55.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-04-26T20:28:55.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-04-26T20:28:55.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-04-26T20:28:55.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-04-26T20:28:55.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-04-26T20:28:55.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-04-26T20:28:55.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-04-26T20:28:55.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-04-26T20:28:55.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-04-26T20:28:55.273 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-04-26T20:28:55.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-04-26T20:28:55.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-04-26T20:28:55.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-04-26T20:28:55.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-04-26T20:28:55.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-04-26T20:28:55.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-04-26T20:28:55.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-04-26T20:28:55.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-04-26T20:28:55.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-04-26T20:28:55.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-04-26T20:28:55.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-04-26T20:28:55.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-04-26T20:28:55.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-04-26T20:28:55.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-04-26T20:28:55.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-04-26T20:28:55.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-04-26T20:28:55.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-04-26T20:28:55.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/ 2024-04-26T20:28:55.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-04-26T20:28:55.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-04-26T20:28:55.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-04-26T20:28:55.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-04-26T20:28:55.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-04-26T20:28:55.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-04-26T20:28:55.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-04-26T20:28:55.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-04-26T20:28:55.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-04-26T20:28:55.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-04-26T20:28:55.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-04-26T20:28:55.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-04-26T20:28:55.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-04-26T20:28:55.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-04-26T20:28:55.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-04-26T20:28:55.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-04-26T20:28:55.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-04-26T20:28:55.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-04-26T20:28:55.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-04-26T20:28:55.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-04-26T20:28:55.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-04-26T20:28:55.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-04-26T20:28:55.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-04-26T20:28:55.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-04-26T20:28:55.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-04-26T20:28:55.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-04-26T20:28:55.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-04-26T20:28:55.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-04-26T20:28:55.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-04-26T20:28:55.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-04-26T20:28:55.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-04-26T20:28:55.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-04-26T20:28:55.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/summary 2024-04-26T20:28:55.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-04-26T20:28:55.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-04-26T20:28:55.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-04-26T20:28:55.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/ 2024-04-26T20:28:55.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/README 2024-04-26T20:28:55.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-04-26T20:28:55.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/ 2024-04-26T20:28:55.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-04-26T20:28:55.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-04-26T20:28:55.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-04-26T20:28:55.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/README 2024-04-26T20:28:55.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-04-26T20:28:55.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-04-26T20:28:55.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-04-26T20:28:55.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-04-26T20:28:55.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-04-26T20:28:55.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-04-26T20:28:55.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-04-26T20:28:55.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-04-26T20:28:55.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ 2024-04-26T20:28:55.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-04-26T20:28:55.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-04-26T20:28:55.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-04-26T20:28:55.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-04-26T20:28:55.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-04-26T20:28:55.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-04-26T20:28:55.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-04-26T20:28:55.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/ 2024-04-26T20:28:55.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-04-26T20:28:55.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-04-26T20:28:55.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-04-26T20:28:55.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-04-26T20:28:55.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-04-26T20:28:55.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/init.txt 2024-04-26T20:28:55.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/initrd.txt 2024-04-26T20:28:55.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ 2024-04-26T20:28:55.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-04-26T20:28:55.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-04-26T20:28:55.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-04-26T20:28:55.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-04-26T20:28:55.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-04-26T20:28:55.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-04-26T20:28:55.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-04-26T20:28:55.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-04-26T20:28:55.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-04-26T20:28:55.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-04-26T20:28:55.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-04-26T20:28:55.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-04-26T20:28:55.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-04-26T20:28:55.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-04-26T20:28:55.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-04-26T20:28:55.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-04-26T20:28:55.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-04-26T20:28:55.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/input.txt 2024-04-26T20:28:55.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-04-26T20:28:55.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-04-26T20:28:55.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-04-26T20:28:55.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-04-26T20:28:55.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-04-26T20:28:55.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-04-26T20:28:55.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-04-26T20:28:55.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-04-26T20:28:55.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-04-26T20:28:55.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-04-26T20:28:55.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-04-26T20:28:55.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-04-26T20:28:55.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-04-26T20:28:55.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-04-26T20:28:55.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-04-26T20:28:55.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-04-26T20:28:55.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ 2024-04-26T20:28:55.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-04-26T20:28:55.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-04-26T20:28:55.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-04-26T20:28:55.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-04-26T20:28:55.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-04-26T20:28:55.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-04-26T20:28:55.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/iostats.txt 2024-04-26T20:28:55.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-04-26T20:28:55.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-04-26T20:28:55.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/ 2024-04-26T20:28:55.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-04-26T20:28:55.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-04-26T20:28:55.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-04-26T20:28:55.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-04-26T20:28:55.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-04-26T20:28:55.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-04-26T20:28:55.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README 2024-04-26T20:28:55.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-04-26T20:28:55.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-04-26T20:28:55.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-04-26T20:28:55.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-04-26T20:28:55.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-04-26T20:28:55.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-04-26T20:28:55.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-04-26T20:28:55.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-04-26T20:28:55.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-04-26T20:28:55.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-04-26T20:28:55.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-04-26T20:28:55.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-04-26T20:28:55.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-04-26T20:28:55.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-04-26T20:28:55.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-04-26T20:28:55.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-04-26T20:28:55.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-04-26T20:28:55.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-04-26T20:28:55.605 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-04-26T20:28:55.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-04-26T20:28:55.607 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-04-26T20:28:55.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-04-26T20:28:55.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-04-26T20:28:55.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-04-26T20:28:55.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/java.txt 2024-04-26T20:28:55.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kasan.txt 2024-04-26T20:28:55.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/ 2024-04-26T20:28:55.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-04-26T20:28:55.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-04-26T20:28:55.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-04-26T20:28:55.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-04-26T20:28:55.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-04-26T20:28:55.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-04-26T20:28:55.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-04-26T20:28:55.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/ 2024-04-26T20:28:55.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-04-26T20:28:55.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-04-26T20:28:55.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-04-26T20:28:55.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-04-26T20:28:55.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-04-26T20:28:55.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-04-26T20:28:55.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-04-26T20:28:55.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-04-26T20:28:55.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-04-26T20:28:55.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-04-26T20:28:55.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-04-26T20:28:55.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kobject.txt 2024-04-26T20:28:55.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-04-26T20:28:55.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kref.txt 2024-04-26T20:28:55.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-04-26T20:28:55.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/ 2024-04-26T20:28:55.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-04-26T20:28:55.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-04-26T20:28:55.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-04-26T20:28:55.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-04-26T20:28:55.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-04-26T20:28:55.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-04-26T20:28:55.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-04-26T20:28:55.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-04-26T20:28:55.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-04-26T20:28:55.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-04-26T20:28:55.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-04-26T20:28:55.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-04-26T20:28:55.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ldm.txt 2024-04-26T20:28:55.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ 2024-04-26T20:28:55.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-04-26T20:28:55.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-04-26T20:28:55.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-04-26T20:28:55.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-04-26T20:28:55.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-04-26T20:28:55.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-04-26T20:28:55.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-04-26T20:28:55.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-04-26T20:28:55.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-04-26T20:28:55.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-04-26T20:28:55.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-04-26T20:28:55.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-04-26T20:28:55.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/ 2024-04-26T20:28:55.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-04-26T20:28:55.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-04-26T20:28:55.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-04-26T20:28:55.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-04-26T20:28:55.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-04-26T20:28:55.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-04-26T20:28:55.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-04-26T20:28:55.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-04-26T20:28:55.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-04-26T20:28:55.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-04-26T20:28:55.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-04-26T20:28:55.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/logo.gif 2024-04-26T20:28:55.677 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/logo.txt 2024-04-26T20:28:55.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/lzo.txt 2024-04-26T20:28:55.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/ 2024-04-26T20:28:55.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-04-26T20:28:55.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-04-26T20:28:55.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-04-26T20:28:55.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-04-26T20:28:55.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-04-26T20:28:55.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/md.txt 2024-04-26T20:28:55.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-04-26T20:28:55.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-04-26T20:28:55.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-04-26T20:28:55.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-04-26T20:28:55.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-04-26T20:28:55.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/ 2024-04-26T20:28:55.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-04-26T20:28:55.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-04-26T20:28:55.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/ 2024-04-26T20:28:55.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-04-26T20:28:55.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-04-26T20:28:55.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-04-26T20:28:55.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-04-26T20:28:55.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-04-26T20:28:55.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-04-26T20:28:55.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-04-26T20:28:55.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-04-26T20:28:55.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-04-26T20:28:55.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-04-26T20:28:55.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/ 2024-04-26T20:28:55.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-04-26T20:28:55.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-04-26T20:28:55.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-04-26T20:28:55.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-04-26T20:28:55.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-04-26T20:28:55.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-04-26T20:28:55.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-04-26T20:28:55.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-04-26T20:28:55.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-04-26T20:28:55.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-04-26T20:28:55.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-04-26T20:28:55.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-04-26T20:28:55.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-04-26T20:28:55.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-04-26T20:28:55.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-04-26T20:28:55.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-04-26T20:28:55.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-04-26T20:28:55.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-04-26T20:28:55.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-04-26T20:28:55.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-04-26T20:28:55.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-04-26T20:28:55.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/ 2024-04-26T20:28:55.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-04-26T20:28:55.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-04-26T20:28:55.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-04-26T20:28:55.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-04-26T20:28:55.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/ 2024-04-26T20:28:55.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-04-26T20:28:55.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-04-26T20:28:55.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-04-26T20:28:55.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mono.txt 2024-04-26T20:28:55.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/ 2024-04-26T20:28:55.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-04-26T20:28:55.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-04-26T20:28:55.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-04-26T20:28:55.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-04-26T20:28:55.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/ 2024-04-26T20:28:55.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-04-26T20:28:55.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-04-26T20:28:55.867 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/ 2024-04-26T20:28:55.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-04-26T20:28:55.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-04-26T20:28:55.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-04-26T20:28:55.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-04-26T20:28:55.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-04-26T20:28:55.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ 2024-04-26T20:28:55.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-04-26T20:28:55.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-04-26T20:28:55.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-04-26T20:28:55.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-04-26T20:28:55.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-04-26T20:28:55.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-04-26T20:28:55.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-04-26T20:28:55.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-04-26T20:28:55.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-04-26T20:28:55.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-04-26T20:28:55.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-04-26T20:28:55.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-04-26T20:28:55.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-04-26T20:28:55.886 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-04-26T20:28:55.888 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-04-26T20:28:55.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-04-26T20:28:55.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-04-26T20:28:55.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-04-26T20:28:55.892 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-04-26T20:28:55.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-04-26T20:28:55.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-04-26T20:28:55.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-04-26T20:28:55.896 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-04-26T20:28:55.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-04-26T20:28:55.898 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-04-26T20:28:55.898 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-04-26T20:28:55.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-04-26T20:28:55.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-04-26T20:28:55.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-04-26T20:28:55.902 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-04-26T20:28:55.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-04-26T20:28:55.904 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-04-26T20:28:55.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-04-26T20:28:55.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-04-26T20:28:55.907 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-04-26T20:28:55.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-04-26T20:28:55.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-04-26T20:28:55.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-04-26T20:28:55.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-04-26T20:28:55.912 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-04-26T20:28:55.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-04-26T20:28:55.914 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-04-26T20:28:55.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-04-26T20:28:55.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-04-26T20:28:55.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-04-26T20:28:55.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-04-26T20:28:55.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-04-26T20:28:55.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-04-26T20:28:55.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-04-26T20:28:55.921 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-04-26T20:28:55.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-04-26T20:28:55.923 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-04-26T20:28:55.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-04-26T20:28:55.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-04-26T20:28:55.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-04-26T20:28:55.927 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-04-26T20:28:55.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-04-26T20:28:55.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-04-26T20:28:55.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-04-26T20:28:55.930 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-04-26T20:28:55.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-04-26T20:28:55.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-04-26T20:28:55.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-04-26T20:28:55.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-04-26T20:28:55.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-04-26T20:28:55.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-04-26T20:28:55.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-04-26T20:28:55.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-04-26T20:28:55.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-04-26T20:28:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-04-26T20:28:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-04-26T20:28:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-04-26T20:28:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-04-26T20:28:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-04-26T20:28:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-04-26T20:28:55.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-04-26T20:28:55.947 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-04-26T20:28:55.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-04-26T20:28:55.949 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-04-26T20:28:55.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-04-26T20:28:55.951 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-04-26T20:28:55.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-04-26T20:28:55.953 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-04-26T20:28:55.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-04-26T20:28:55.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-04-26T20:28:55.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-04-26T20:28:55.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-04-26T20:28:55.958 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-04-26T20:28:55.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-04-26T20:28:55.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-04-26T20:28:55.961 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-04-26T20:28:55.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-04-26T20:28:55.963 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-04-26T20:28:55.964 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-04-26T20:28:55.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-04-26T20:28:55.966 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-04-26T20:28:55.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-04-26T20:28:55.968 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-04-26T20:28:55.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-04-26T20:28:55.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-04-26T20:28:55.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-04-26T20:28:55.972 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-04-26T20:28:55.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-04-26T20:28:55.974 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-04-26T20:28:55.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-04-26T20:28:55.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-04-26T20:28:55.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-04-26T20:28:55.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-04-26T20:28:55.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-04-26T20:28:55.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-04-26T20:28:55.980 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-04-26T20:28:55.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-04-26T20:28:55.982 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-04-26T20:28:55.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-04-26T20:28:55.984 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-04-26T20:28:55.985 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-04-26T20:28:55.986 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-04-26T20:28:55.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-04-26T20:28:55.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-04-26T20:28:55.988 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-04-26T20:28:55.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-04-26T20:28:55.990 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-04-26T20:28:55.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-04-26T20:28:55.992 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-04-26T20:28:55.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-04-26T20:28:55.994 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-04-26T20:28:55.995 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-04-26T20:28:55.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-04-26T20:28:55.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-04-26T20:28:55.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-04-26T20:28:55.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-04-26T20:28:55.999 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-04-26T20:28:56.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-04-26T20:28:56.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-04-26T20:28:56.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-04-26T20:28:56.003 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/ 2024-04-26T20:28:56.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-04-26T20:28:56.005 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-04-26T20:28:56.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nios2/ 2024-04-26T20:28:56.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nios2/README 2024-04-26T20:28:56.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-04-26T20:28:56.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/numastat.txt 2024-04-26T20:28:56.010 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-04-26T20:28:56.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/padata.txt 2024-04-26T20:28:56.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/ 2024-04-26T20:28:56.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-04-26T20:28:56.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-04-26T20:28:56.015 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/registers 2024-04-26T20:28:56.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-04-26T20:28:56.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parport.txt 2024-04-26T20:28:56.018 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-04-26T20:28:56.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-04-26T20:28:56.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-04-26T20:28:56.020 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-04-26T20:28:56.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-04-26T20:28:56.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-04-26T20:28:56.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-04-26T20:28:56.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-04-26T20:28:56.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-04-26T20:28:56.026 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy.txt 2024-04-26T20:28:56.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy/ 2024-04-26T20:28:56.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-04-26T20:28:56.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-04-26T20:28:56.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-04-26T20:28:56.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/platform/ 2024-04-26T20:28:56.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-04-26T20:28:56.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pnp.txt 2024-04-26T20:28:56.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/ 2024-04-26T20:28:56.035 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-04-26T20:28:56.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-04-26T20:28:56.038 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-04-26T20:28:56.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-04-26T20:28:56.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-04-26T20:28:56.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-04-26T20:28:56.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-04-26T20:28:56.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-04-26T20:28:56.047 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-04-26T20:28:56.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-04-26T20:28:56.050 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-04-26T20:28:56.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-04-26T20:28:56.052 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-04-26T20:28:56.054 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-04-26T20:28:56.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-04-26T20:28:56.057 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-04-26T20:28:56.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-04-26T20:28:56.059 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-04-26T20:28:56.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-04-26T20:28:56.062 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-04-26T20:28:56.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-04-26T20:28:56.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-04-26T20:28:56.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-04-26T20:28:56.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/states.txt 2024-04-26T20:28:56.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-04-26T20:28:56.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-04-26T20:28:56.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-04-26T20:28:56.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-04-26T20:28:56.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-04-26T20:28:56.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-04-26T20:28:56.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-04-26T20:28:56.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/video.txt 2024-04-26T20:28:56.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/ 2024-04-26T20:28:56.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-04-26T20:28:56.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-04-26T20:28:56.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-04-26T20:28:56.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-04-26T20:28:56.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-04-26T20:28:56.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-04-26T20:28:56.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-04-26T20:28:56.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-04-26T20:28:56.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-04-26T20:28:56.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-04-26T20:28:56.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-04-26T20:28:56.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-04-26T20:28:56.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-04-26T20:28:56.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pps/ 2024-04-26T20:28:56.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-04-26T20:28:56.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/ 2024-04-26T20:28:56.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-04-26T20:28:56.104 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-04-26T20:28:56.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-04-26T20:28:56.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-04-26T20:28:56.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-04-26T20:28:56.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-04-26T20:28:56.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-04-26T20:28:56.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-04-26T20:28:56.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-04-26T20:28:56.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pti/ 2024-04-26T20:28:56.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-04-26T20:28:56.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/ 2024-04-26T20:28:56.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-04-26T20:28:56.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-04-26T20:28:56.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-04-26T20:28:56.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-04-26T20:28:56.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-04-26T20:28:56.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pwm.txt 2024-04-26T20:28:56.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-04-26T20:28:56.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/ 2024-04-26T20:28:56.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-04-26T20:28:56.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-04-26T20:28:56.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-04-26T20:28:56.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-04-26T20:28:56.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-04-26T20:28:56.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-04-26T20:28:56.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-04-26T20:28:56.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-04-26T20:28:56.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-04-26T20:28:56.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rtc.txt 2024-04-26T20:28:56.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/ 2024-04-26T20:28:56.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-04-26T20:28:56.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-04-26T20:28:56.149 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-04-26T20:28:56.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-04-26T20:28:56.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/DASD 2024-04-26T20:28:56.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-04-26T20:28:56.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-04-26T20:28:56.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-04-26T20:28:56.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-04-26T20:28:56.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-04-26T20:28:56.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-04-26T20:28:56.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-04-26T20:28:56.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-04-26T20:28:56.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-04-26T20:28:56.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/ 2024-04-26T20:28:56.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-04-26T20:28:56.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-04-26T20:28:56.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-04-26T20:28:56.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-04-26T20:28:56.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-04-26T20:28:56.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-04-26T20:28:56.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-04-26T20:28:56.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-04-26T20:28:56.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-04-26T20:28:56.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-04-26T20:28:56.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ 2024-04-26T20:28:56.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-04-26T20:28:56.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-04-26T20:28:56.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-04-26T20:28:56.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-04-26T20:28:56.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-04-26T20:28:56.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-04-26T20:28:56.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-04-26T20:28:56.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-04-26T20:28:56.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-04-26T20:28:56.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-04-26T20:28:56.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-04-26T20:28:56.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-04-26T20:28:56.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-04-26T20:28:56.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-04-26T20:28:56.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-04-26T20:28:56.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-04-26T20:28:56.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-04-26T20:28:56.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-04-26T20:28:56.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-04-26T20:28:56.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-04-26T20:28:56.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-04-26T20:28:56.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-04-26T20:28:56.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-04-26T20:28:56.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-04-26T20:28:56.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-04-26T20:28:56.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-04-26T20:28:56.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-04-26T20:28:56.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-04-26T20:28:56.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-04-26T20:28:56.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-04-26T20:28:56.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-04-26T20:28:56.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-04-26T20:28:56.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-04-26T20:28:56.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-04-26T20:28:56.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-04-26T20:28:56.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-04-26T20:28:56.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-04-26T20:28:56.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-04-26T20:28:56.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-04-26T20:28:56.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-04-26T20:28:56.238 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-04-26T20:28:56.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-04-26T20:28:56.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-04-26T20:28:56.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-04-26T20:28:56.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-04-26T20:28:56.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-04-26T20:28:56.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-04-26T20:28:56.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-04-26T20:28:56.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-04-26T20:28:56.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-04-26T20:28:56.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-04-26T20:28:56.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-04-26T20:28:56.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-04-26T20:28:56.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-04-26T20:28:56.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-04-26T20:28:56.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-04-26T20:28:56.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-04-26T20:28:56.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-04-26T20:28:56.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-04-26T20:28:56.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/ 2024-04-26T20:28:56.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-04-26T20:28:56.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-04-26T20:28:56.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-04-26T20:28:56.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-04-26T20:28:56.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-04-26T20:28:56.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-04-26T20:28:56.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-04-26T20:28:56.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-04-26T20:28:56.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-04-26T20:28:56.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-04-26T20:28:56.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-04-26T20:28:56.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-04-26T20:28:56.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-04-26T20:28:56.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-04-26T20:28:56.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/ 2024-04-26T20:28:56.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-04-26T20:28:56.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-04-26T20:28:56.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/driver 2024-04-26T20:28:56.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-04-26T20:28:56.291 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-04-26T20:28:56.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-04-26T20:28:56.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-04-26T20:28:56.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-04-26T20:28:56.295 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-04-26T20:28:56.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/ 2024-04-26T20:28:56.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-04-26T20:28:56.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-04-26T20:28:56.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-04-26T20:28:56.301 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/ 2024-04-26T20:28:56.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-04-26T20:28:56.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-04-26T20:28:56.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-04-26T20:28:56.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-04-26T20:28:56.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-04-26T20:28:56.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-04-26T20:28:56.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-04-26T20:28:56.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-04-26T20:28:56.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-04-26T20:28:56.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-04-26T20:28:56.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-04-26T20:28:56.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-04-26T20:28:56.316 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-04-26T20:28:56.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-04-26T20:28:56.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-04-26T20:28:56.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-04-26T20:28:56.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-04-26T20:28:56.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-04-26T20:28:56.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-04-26T20:28:56.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-04-26T20:28:56.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-04-26T20:28:56.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-04-26T20:28:56.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-04-26T20:28:56.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-04-26T20:28:56.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-04-26T20:28:56.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-04-26T20:28:56.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-04-26T20:28:56.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-04-26T20:28:56.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-04-26T20:28:56.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-04-26T20:28:56.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-04-26T20:28:56.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-04-26T20:28:56.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-04-26T20:28:56.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-04-26T20:28:56.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-04-26T20:28:56.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-04-26T20:28:56.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-04-26T20:28:56.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-04-26T20:28:56.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-04-26T20:28:56.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-04-26T20:28:56.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-04-26T20:28:56.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-04-26T20:28:56.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-04-26T20:28:56.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-04-26T20:28:56.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-04-26T20:28:56.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-04-26T20:28:56.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-04-26T20:28:56.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-04-26T20:28:56.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-04-26T20:28:56.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-04-26T20:28:56.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-04-26T20:28:56.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-04-26T20:28:56.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-04-26T20:28:56.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-04-26T20:28:56.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-04-26T20:28:56.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-04-26T20:28:56.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-04-26T20:28:56.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-04-26T20:28:56.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-04-26T20:28:56.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-04-26T20:28:56.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-04-26T20:28:56.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-04-26T20:28:56.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sparse.txt 2024-04-26T20:28:56.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/ 2024-04-26T20:28:56.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-04-26T20:28:56.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-04-26T20:28:56.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-04-26T20:28:56.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-04-26T20:28:56.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-04-26T20:28:56.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-04-26T20:28:56.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-04-26T20:28:56.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-04-26T20:28:56.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-04-26T20:28:56.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev 2024-04-26T20:28:56.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-04-26T20:28:56.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-04-26T20:28:56.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-04-26T20:28:56.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-04-26T20:28:56.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-04-26T20:28:56.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/svga.txt 2024-04-26T20:28:56.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/ 2024-04-26T20:28:56.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-04-26T20:28:56.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/README 2024-04-26T20:28:56.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-04-26T20:28:56.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-04-26T20:28:56.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-04-26T20:28:56.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-04-26T20:28:56.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-04-26T20:28:56.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-04-26T20:28:56.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-04-26T20:28:56.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-04-26T20:28:56.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/ 2024-04-26T20:28:56.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-04-26T20:28:56.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-04-26T20:28:56.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-04-26T20:28:56.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/ 2024-04-26T20:28:56.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-04-26T20:28:56.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-04-26T20:28:56.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-04-26T20:28:56.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-04-26T20:28:56.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-04-26T20:28:56.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-04-26T20:28:56.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-04-26T20:28:56.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-04-26T20:28:56.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/ 2024-04-26T20:28:56.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-04-26T20:28:56.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-04-26T20:28:56.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-04-26T20:28:56.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-04-26T20:28:56.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-04-26T20:28:56.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-04-26T20:28:56.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-04-26T20:28:56.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-04-26T20:28:56.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-04-26T20:28:56.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-04-26T20:28:56.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-04-26T20:28:56.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/tpm/ 2024-04-26T20:28:56.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-04-26T20:28:56.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ 2024-04-26T20:28:56.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-04-26T20:28:56.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-04-26T20:28:56.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-04-26T20:28:56.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-04-26T20:28:56.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-04-26T20:28:56.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-04-26T20:28:56.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-04-26T20:28:56.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-04-26T20:28:56.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-04-26T20:28:56.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-04-26T20:28:56.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-04-26T20:28:56.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-04-26T20:28:56.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-04-26T20:28:56.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-04-26T20:28:56.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-04-26T20:28:56.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-04-26T20:28:56.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-04-26T20:28:56.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-04-26T20:28:56.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unicode.txt 2024-04-26T20:28:56.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unshare.txt 2024-04-26T20:28:56.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ 2024-04-26T20:28:56.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-04-26T20:28:56.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-04-26T20:28:56.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-04-26T20:28:56.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-04-26T20:28:56.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-04-26T20:28:56.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-04-26T20:28:56.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-04-26T20:28:56.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-04-26T20:28:56.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-04-26T20:28:56.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-04-26T20:28:56.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-04-26T20:28:56.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-04-26T20:28:56.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-04-26T20:28:56.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-04-26T20:28:56.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-04-26T20:28:56.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-04-26T20:28:56.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-04-26T20:28:56.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-04-26T20:28:56.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-04-26T20:28:56.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-04-26T20:28:56.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-04-26T20:28:56.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-04-26T20:28:56.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-04-26T20:28:56.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-04-26T20:28:56.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-04-26T20:28:56.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-04-26T20:28:56.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-04-26T20:28:56.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-04-26T20:28:56.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-04-26T20:28:56.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-04-26T20:28:56.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-04-26T20:28:56.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-04-26T20:28:56.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-04-26T20:28:56.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-04-26T20:28:56.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-04-26T20:28:56.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-04-26T20:28:56.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/ 2024-04-26T20:28:56.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-04-26T20:28:56.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-04-26T20:28:56.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-04-26T20:28:56.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-04-26T20:28:56.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-04-26T20:28:56.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vfio.txt 2024-04-26T20:28:56.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-04-26T20:28:56.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video-output.txt 2024-04-26T20:28:56.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/ 2024-04-26T20:28:56.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-04-26T20:28:56.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-04-26T20:28:56.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-04-26T20:28:56.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-04-26T20:28:56.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-04-26T20:28:56.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-04-26T20:28:56.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-04-26T20:28:56.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-04-26T20:28:56.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-04-26T20:28:56.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-04-26T20:28:56.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-04-26T20:28:56.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-04-26T20:28:56.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-04-26T20:28:56.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-04-26T20:28:56.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-04-26T20:28:56.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-04-26T20:28:56.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-04-26T20:28:56.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-04-26T20:28:56.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-04-26T20:28:56.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-04-26T20:28:56.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-04-26T20:28:56.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-04-26T20:28:56.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-04-26T20:28:56.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-04-26T20:28:56.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-04-26T20:28:56.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-04-26T20:28:56.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-04-26T20:28:56.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-04-26T20:28:56.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-04-26T20:28:56.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-04-26T20:28:56.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-04-26T20:28:56.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-04-26T20:28:56.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-04-26T20:28:56.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-04-26T20:28:56.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-04-26T20:28:56.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-04-26T20:28:56.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-04-26T20:28:56.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-04-26T20:28:56.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-04-26T20:28:56.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-04-26T20:28:56.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-04-26T20:28:56.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-04-26T20:28:56.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-04-26T20:28:56.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-04-26T20:28:56.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-04-26T20:28:56.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-04-26T20:28:56.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-04-26T20:28:56.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-04-26T20:28:56.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-04-26T20:28:56.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-04-26T20:28:56.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-04-26T20:28:56.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-04-26T20:28:56.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-04-26T20:28:56.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-04-26T20:28:56.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-04-26T20:28:56.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-04-26T20:28:56.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-04-26T20:28:56.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-04-26T20:28:56.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-04-26T20:28:56.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-04-26T20:28:56.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-04-26T20:28:56.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-04-26T20:28:56.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-04-26T20:28:56.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-04-26T20:28:56.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-04-26T20:28:56.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-04-26T20:28:56.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-04-26T20:28:56.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-04-26T20:28:56.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-04-26T20:28:56.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-04-26T20:28:56.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-04-26T20:28:56.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-04-26T20:28:56.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-04-26T20:28:56.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-04-26T20:28:56.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-04-26T20:28:56.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-04-26T20:28:56.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-04-26T20:28:56.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-04-26T20:28:56.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/ 2024-04-26T20:28:56.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-04-26T20:28:56.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-04-26T20:28:56.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-04-26T20:28:56.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-04-26T20:28:56.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-04-26T20:28:56.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-04-26T20:28:56.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-04-26T20:28:56.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-04-26T20:28:56.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-04-26T20:28:56.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-04-26T20:28:56.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-04-26T20:28:56.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-04-26T20:28:56.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-04-26T20:28:56.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-04-26T20:28:56.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-04-26T20:28:56.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-04-26T20:28:56.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-04-26T20:28:56.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-04-26T20:28:56.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-04-26T20:28:56.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-04-26T20:28:56.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-04-26T20:28:56.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-04-26T20:28:56.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-04-26T20:28:56.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-04-26T20:28:56.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-04-26T20:28:56.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/ 2024-04-26T20:28:56.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-04-26T20:28:56.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-04-26T20:28:56.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-04-26T20:28:56.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/balance 2024-04-26T20:28:56.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-04-26T20:28:56.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-04-26T20:28:56.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-04-26T20:28:56.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-04-26T20:28:56.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-04-26T20:28:56.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-04-26T20:28:56.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/numa 2024-04-26T20:28:56.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-04-26T20:28:56.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-04-26T20:28:56.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-04-26T20:28:56.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-04-26T20:28:56.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-04-26T20:28:56.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-04-26T20:28:56.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-04-26T20:28:56.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-04-26T20:28:56.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-04-26T20:28:56.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-04-26T20:28:56.605 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-04-26T20:28:56.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-04-26T20:28:56.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-04-26T20:28:56.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-04-26T20:28:56.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/ 2024-04-26T20:28:56.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-04-26T20:28:56.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-04-26T20:28:56.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-04-26T20:28:56.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-04-26T20:28:56.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-04-26T20:28:56.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-04-26T20:28:56.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-04-26T20:28:56.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-04-26T20:28:56.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-04-26T20:28:56.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-04-26T20:28:56.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-04-26T20:28:56.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-04-26T20:28:56.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-04-26T20:28:56.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-04-26T20:28:56.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-04-26T20:28:56.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-04-26T20:28:56.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/ 2024-04-26T20:28:56.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-04-26T20:28:56.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-04-26T20:28:56.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-04-26T20:28:56.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-04-26T20:28:56.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-04-26T20:28:56.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-04-26T20:28:56.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-04-26T20:28:56.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-04-26T20:28:56.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-04-26T20:28:56.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-04-26T20:28:56.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-04-26T20:28:56.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-04-26T20:28:56.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-04-26T20:28:56.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/ 2024-04-26T20:28:56.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-04-26T20:28:56.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-04-26T20:28:56.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-04-26T20:28:56.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/ 2024-04-26T20:28:56.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-04-26T20:28:56.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-04-26T20:28:56.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-04-26T20:28:56.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-04-26T20:28:56.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-04-26T20:28:56.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-04-26T20:28:56.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-04-26T20:28:56.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-04-26T20:28:56.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-04-26T20:28:56.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-04-26T20:28:56.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-04-26T20:28:56.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-04-26T20:28:56.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-04-26T20:28:56.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-04-26T20:28:56.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-04-26T20:28:56.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-04-26T20:28:56.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-04-26T20:28:56.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-04-26T20:28:56.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-04-26T20:28:56.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-04-26T20:28:56.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-04-26T20:28:56.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-04-26T20:28:56.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-04-26T20:28:56.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-04-26T20:28:56.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/ 2024-04-26T20:28:56.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-04-26T20:28:56.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-04-26T20:28:56.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xz.txt 2024-04-26T20:28:56.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-04-26T20:28:56.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-04-26T20:28:56.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-04-26T20:28:56.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-04-26T20:28:56.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-04-26T20:28:56.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-04-26T20:28:56.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-04-26T20:28:56.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-04-26T20:28:56.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-04-26T20:28:56.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-04-26T20:28:56.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-04-26T20:28:56.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-04-26T20:28:56.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-04-26T20:28:56.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-04-26T20:28:56.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-04-26T20:28:56.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-04-26T20:28:56.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-04-26T20:28:56.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-04-26T20:28:56.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-04-26T20:28:56.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-04-26T20:28:56.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-04-26T20:28:56.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-04-26T20:28:56.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-04-26T20:28:56.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-04-26T20:28:56.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-04-26T20:28:56.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-04-26T20:28:56.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-04-26T20:28:56.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-04-26T20:28:56.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-04-26T20:28:56.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zorro.txt 2024-04-26T20:28:57.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:56 smithi070 ceph-mon[29124]: pgmap v51: 97 pgs: 97 active+clean; 89 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 7.4 MiB/s wr, 60 op/s 2024-04-26T20:28:57.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:56 smithi098 ceph-mon[32591]: pgmap v51: 97 pgs: 97 active+clean; 89 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 7.4 MiB/s wr, 60 op/s 2024-04-26T20:28:57.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:56 smithi080 ceph-mon[32278]: pgmap v51: 97 pgs: 97 active+clean; 89 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 7.4 MiB/s wr, 60 op/s 2024-04-26T20:28:59.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:28:58 smithi070 ceph-mon[29124]: pgmap v52: 97 pgs: 97 active+clean; 89 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 7.4 MiB/s wr, 56 op/s 2024-04-26T20:28:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:28:58 smithi098 ceph-mon[32591]: pgmap v52: 97 pgs: 97 active+clean; 89 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 7.4 MiB/s wr, 56 op/s 2024-04-26T20:28:59.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:28:58 smithi080 ceph-mon[32278]: pgmap v52: 97 pgs: 97 active+clean; 89 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 7.4 MiB/s wr, 56 op/s 2024-04-26T20:29:01.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:00 smithi070 ceph-mon[29124]: pgmap v53: 97 pgs: 97 active+clean; 89 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 7.4 MiB/s wr, 56 op/s 2024-04-26T20:29:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:00 smithi098 ceph-mon[32591]: pgmap v53: 97 pgs: 97 active+clean; 89 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 7.4 MiB/s wr, 56 op/s 2024-04-26T20:29:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:00 smithi080 ceph-mon[32278]: pgmap v53: 97 pgs: 97 active+clean; 89 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 7.4 MiB/s wr, 56 op/s 2024-04-26T20:29:01.766 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar cf doc.tar linux-4.0.5 2024-04-26T20:29:02.682 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar xf doc.tar 2024-04-26T20:29:03.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:02 smithi070 ceph-mon[29124]: pgmap v54: 97 pgs: 97 active+clean; 92 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 7.7 MiB/s wr, 66 op/s 2024-04-26T20:29:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:02 smithi098 ceph-mon[32591]: pgmap v54: 97 pgs: 97 active+clean; 92 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 7.7 MiB/s wr, 66 op/s 2024-04-26T20:29:03.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:02 smithi080 ceph-mon[32278]: pgmap v54: 97 pgs: 97 active+clean; 92 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 7.7 MiB/s wr, 66 op/s 2024-04-26T20:29:05.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:04 smithi070 ceph-mon[29124]: pgmap v55: 97 pgs: 97 active+clean; 92 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 7.7 MiB/s wr, 59 op/s 2024-04-26T20:29:05.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:04 smithi098 ceph-mon[32591]: pgmap v55: 97 pgs: 97 active+clean; 92 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 7.7 MiB/s wr, 59 op/s 2024-04-26T20:29:05.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:04 smithi080 ceph-mon[32278]: pgmap v55: 97 pgs: 97 active+clean; 92 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 7.7 MiB/s wr, 59 op/s 2024-04-26T20:29:07.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:06 smithi070 ceph-mon[29124]: pgmap v56: 97 pgs: 97 active+clean; 99 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.3 MiB/s wr, 113 op/s 2024-04-26T20:29:07.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:06 smithi098 ceph-mon[32591]: pgmap v56: 97 pgs: 97 active+clean; 99 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.3 MiB/s wr, 113 op/s 2024-04-26T20:29:07.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:06 smithi080 ceph-mon[32278]: pgmap v56: 97 pgs: 97 active+clean; 99 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.3 MiB/s wr, 113 op/s 2024-04-26T20:29:09.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:08 smithi070 ceph-mon[29124]: pgmap v57: 97 pgs: 97 active+clean; 99 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 959 KiB/s wr, 63 op/s 2024-04-26T20:29:09.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:08 smithi098 ceph-mon[32591]: pgmap v57: 97 pgs: 97 active+clean; 99 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 959 KiB/s wr, 63 op/s 2024-04-26T20:29:09.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:08 smithi080 ceph-mon[32278]: pgmap v57: 97 pgs: 97 active+clean; 99 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 959 KiB/s wr, 63 op/s 2024-04-26T20:29:11.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:10 smithi070 ceph-mon[29124]: pgmap v58: 97 pgs: 97 active+clean; 99 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 959 KiB/s wr, 63 op/s 2024-04-26T20:29:11.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:10 smithi098 ceph-mon[32591]: pgmap v58: 97 pgs: 97 active+clean; 99 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 959 KiB/s wr, 63 op/s 2024-04-26T20:29:11.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:10 smithi080 ceph-mon[32278]: pgmap v58: 97 pgs: 97 active+clean; 99 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 959 KiB/s wr, 63 op/s 2024-04-26T20:29:12.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:11 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:12.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:11 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:12.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:11 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:12 smithi070 ceph-mon[29124]: pgmap v59: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 74 op/s 2024-04-26T20:29:13.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:12 smithi098 ceph-mon[32591]: pgmap v59: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 74 op/s 2024-04-26T20:29:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:12 smithi080 ceph-mon[32278]: pgmap v59: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 74 op/s 2024-04-26T20:29:15.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:14 smithi070 ceph-mon[29124]: pgmap v60: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 63 op/s 2024-04-26T20:29:15.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:14 smithi098 ceph-mon[32591]: pgmap v60: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 63 op/s 2024-04-26T20:29:15.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:14 smithi080 ceph-mon[32278]: pgmap v60: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 63 op/s 2024-04-26T20:29:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:16 smithi098 ceph-mon[32591]: pgmap v61: 97 pgs: 97 active+clean; 122 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 76 op/s 2024-04-26T20:29:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:16 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:16 smithi080 ceph-mon[32278]: pgmap v61: 97 pgs: 97 active+clean; 122 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 76 op/s 2024-04-26T20:29:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:16 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:17.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:16 smithi070 ceph-mon[29124]: pgmap v61: 97 pgs: 97 active+clean; 122 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 76 op/s 2024-04-26T20:29:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:16 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:18 smithi098 ceph-mon[32591]: pgmap v62: 97 pgs: 97 active+clean; 122 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-04-26T20:29:19.212 INFO:tasks.workunit.client.0.smithi070.stderr:+ sync 2024-04-26T20:29:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:18 smithi080 ceph-mon[32278]: pgmap v62: 97 pgs: 97 active+clean; 122 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-04-26T20:29:19.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:18 smithi070 ceph-mon[29124]: pgmap v62: 97 pgs: 97 active+clean; 122 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-04-26T20:29:20.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:19 smithi098 ceph-mon[32591]: pgmap v63: 97 pgs: 97 active+clean; 122 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-04-26T20:29:20.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:19 smithi080 ceph-mon[32278]: pgmap v63: 97 pgs: 97 active+clean; 122 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-04-26T20:29:20.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:19 smithi070 ceph-mon[29124]: pgmap v63: 97 pgs: 97 active+clean; 122 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-04-26T20:29:22.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:21 smithi098 ceph-mon[32591]: pgmap v64: 97 pgs: 97 active+clean; 185 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 586 op/s 2024-04-26T20:29:22.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:21 smithi080 ceph-mon[32278]: pgmap v64: 97 pgs: 97 active+clean; 185 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 586 op/s 2024-04-26T20:29:22.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:21 smithi070 ceph-mon[29124]: pgmap v64: 97 pgs: 97 active+clean; 185 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 586 op/s 2024-04-26T20:29:24.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:23 smithi098 ceph-mon[32591]: pgmap v65: 97 pgs: 97 active+clean; 185 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 575 op/s 2024-04-26T20:29:24.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:23 smithi080 ceph-mon[32278]: pgmap v65: 97 pgs: 97 active+clean; 185 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 575 op/s 2024-04-26T20:29:24.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:23 smithi070 ceph-mon[29124]: pgmap v65: 97 pgs: 97 active+clean; 185 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 575 op/s 2024-04-26T20:29:25.895 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar c linux-4.0.5 2024-04-26T20:29:26.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:25 smithi098 ceph-mon[32591]: pgmap v66: 97 pgs: 97 active+clean; 196 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.4 MiB/s wr, 674 op/s 2024-04-26T20:29:26.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:25 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:29:26.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:25 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:25 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:25 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:25 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:25 smithi080 ceph-mon[32278]: pgmap v66: 97 pgs: 97 active+clean; 196 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.4 MiB/s wr, 674 op/s 2024-04-26T20:29:26.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:25 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:29:26.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:25 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:25 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:25 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:25 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:25 smithi070 ceph-mon[29124]: pgmap v66: 97 pgs: 97 active+clean; 196 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.4 MiB/s wr, 674 op/s 2024-04-26T20:29:26.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:25 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:29:26.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:25 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:25 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:25 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:25 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:26.546 INFO:tasks.workunit.client.0.smithi070.stderr:+ rm -rf linux-4.0.5 2024-04-26T20:29:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:26 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:27.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:26 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:29:27.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:26 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:29:27.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:26 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:27.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:26 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:27.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:26 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:29:27.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:26 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:29:27.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:26 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:27.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:26 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:26 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:29:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:26 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:29:27.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:26 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:29:28.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:28 smithi070 ceph-mon[29124]: pgmap v67: 97 pgs: 97 active+clean; 217 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.4 MiB/s wr, 836 op/s 2024-04-26T20:29:28.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:28 smithi098 ceph-mon[32591]: pgmap v67: 97 pgs: 97 active+clean; 217 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.4 MiB/s wr, 836 op/s 2024-04-26T20:29:28.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:28 smithi080 ceph-mon[32278]: pgmap v67: 97 pgs: 97 active+clean; 217 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.4 MiB/s wr, 836 op/s 2024-04-26T20:29:30.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:30 smithi098 ceph-mon[32591]: pgmap v68: 97 pgs: 97 active+clean; 217 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.4 MiB/s wr, 836 op/s 2024-04-26T20:29:30.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:30 smithi080 ceph-mon[32278]: pgmap v68: 97 pgs: 97 active+clean; 217 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.4 MiB/s wr, 836 op/s 2024-04-26T20:29:31.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:30 smithi070 ceph-mon[29124]: pgmap v68: 97 pgs: 97 active+clean; 217 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.4 MiB/s wr, 836 op/s 2024-04-26T20:29:31.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:31 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:31.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:31 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:32.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:31 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:32.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:32 smithi098 ceph-mon[32591]: pgmap v69: 97 pgs: 97 active+clean; 226 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 1.04k op/s 2024-04-26T20:29:32.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:32 smithi080 ceph-mon[32278]: pgmap v69: 97 pgs: 97 active+clean; 226 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 1.04k op/s 2024-04-26T20:29:33.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:32 smithi070 ceph-mon[29124]: pgmap v69: 97 pgs: 97 active+clean; 226 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 1.04k op/s 2024-04-26T20:29:33.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:33 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:33.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:33 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:34.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:33 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:34 smithi098 ceph-mon[32591]: pgmap v70: 97 pgs: 97 active+clean; 226 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 476 op/s 2024-04-26T20:29:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:34 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:34.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:34 smithi080 ceph-mon[32278]: pgmap v70: 97 pgs: 97 active+clean; 226 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 476 op/s 2024-04-26T20:29:34.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:34 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:35.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:34 smithi070 ceph-mon[29124]: pgmap v70: 97 pgs: 97 active+clean; 226 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 476 op/s 2024-04-26T20:29:35.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:34 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:36.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:36 smithi098 ceph-mon[32591]: pgmap v71: 97 pgs: 97 active+clean; 225 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 540 op/s 2024-04-26T20:29:36.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:36 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:36.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:36 smithi080 ceph-mon[32278]: pgmap v71: 97 pgs: 97 active+clean; 225 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 540 op/s 2024-04-26T20:29:36.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:36 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:36 smithi070 ceph-mon[29124]: pgmap v71: 97 pgs: 97 active+clean; 225 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 540 op/s 2024-04-26T20:29:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:36 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:37.764 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar xf doc.tar 2024-04-26T20:29:37.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:37 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:37.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:37 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:38.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:37 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:38.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:38 smithi098 ceph-mon[32591]: pgmap v72: 97 pgs: 97 active+clean; 229 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 548 op/s 2024-04-26T20:29:38.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:38 smithi080 ceph-mon[32278]: pgmap v72: 97 pgs: 97 active+clean; 229 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 548 op/s 2024-04-26T20:29:39.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:38 smithi070 ceph-mon[29124]: pgmap v72: 97 pgs: 97 active+clean; 229 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 548 op/s 2024-04-26T20:29:40.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:40 smithi098 ceph-mon[32591]: pgmap v73: 97 pgs: 97 active+clean; 229 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 374 op/s 2024-04-26T20:29:40.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:40 smithi080 ceph-mon[32278]: pgmap v73: 97 pgs: 97 active+clean; 229 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 374 op/s 2024-04-26T20:29:41.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:40 smithi070 ceph-mon[29124]: pgmap v73: 97 pgs: 97 active+clean; 229 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 374 op/s 2024-04-26T20:29:42.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:42 smithi098 ceph-mon[32591]: pgmap v74: 97 pgs: 97 active+clean; 227 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 509 op/s 2024-04-26T20:29:42.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:42 smithi080 ceph-mon[32278]: pgmap v74: 97 pgs: 97 active+clean; 227 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 509 op/s 2024-04-26T20:29:43.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:42 smithi070 ceph-mon[29124]: pgmap v74: 97 pgs: 97 active+clean; 227 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 509 op/s 2024-04-26T20:29:44.008 INFO:tasks.workunit.client.0.smithi070.stderr:+ sync 2024-04-26T20:29:44.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:44 smithi098 ceph-mon[32591]: pgmap v75: 97 pgs: 97 active+clean; 227 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 306 op/s 2024-04-26T20:29:44.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:44 smithi080 ceph-mon[32278]: pgmap v75: 97 pgs: 97 active+clean; 227 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 306 op/s 2024-04-26T20:29:45.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:44 smithi070 ceph-mon[29124]: pgmap v75: 97 pgs: 97 active+clean; 227 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 306 op/s 2024-04-26T20:29:46.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:46 smithi098 ceph-mon[32591]: pgmap v76: 97 pgs: 97 active+clean; 240 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 436 op/s 2024-04-26T20:29:46.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:46 smithi080 ceph-mon[32278]: pgmap v76: 97 pgs: 97 active+clean; 240 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 436 op/s 2024-04-26T20:29:47.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:46 smithi070 ceph-mon[29124]: pgmap v76: 97 pgs: 97 active+clean; 240 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 436 op/s 2024-04-26T20:29:47.089 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar c linux-4.0.5 2024-04-26T20:29:47.388 INFO:tasks.workunit.client.0.smithi070.stdout:Ok 2024-04-26T20:29:47.389 INFO:tasks.workunit.client.0.smithi070.stderr:+ echo Ok 2024-04-26T20:29:47.390 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T20:29:47.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T20:29:48.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:48 smithi098 ceph-mon[32591]: pgmap v77: 97 pgs: 97 active+clean; 252 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 568 op/s 2024-04-26T20:29:48.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:48 smithi080 ceph-mon[32278]: pgmap v77: 97 pgs: 97 active+clean; 252 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 568 op/s 2024-04-26T20:29:49.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:48 smithi070 ceph-mon[29124]: pgmap v77: 97 pgs: 97 active+clean; 252 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 568 op/s 2024-04-26T20:29:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:50 smithi098 ceph-mon[32591]: pgmap v78: 97 pgs: 97 active+clean; 252 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 460 op/s 2024-04-26T20:29:50.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:50 smithi080 ceph-mon[32278]: pgmap v78: 97 pgs: 97 active+clean; 252 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 460 op/s 2024-04-26T20:29:51.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:50 smithi070 ceph-mon[29124]: pgmap v78: 97 pgs: 97 active+clean; 252 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 460 op/s 2024-04-26T20:29:52.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:52 smithi098 ceph-mon[32591]: pgmap v79: 97 pgs: 97 active+clean; 241 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 526 op/s 2024-04-26T20:29:52.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:52 smithi080 ceph-mon[32278]: pgmap v79: 97 pgs: 97 active+clean; 241 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 526 op/s 2024-04-26T20:29:53.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:52 smithi070 ceph-mon[29124]: pgmap v79: 97 pgs: 97 active+clean; 241 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 526 op/s 2024-04-26T20:29:54.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:54 smithi098 ceph-mon[32591]: pgmap v80: 97 pgs: 97 active+clean; 241 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 390 op/s 2024-04-26T20:29:54.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:54 smithi080 ceph-mon[32278]: pgmap v80: 97 pgs: 97 active+clean; 241 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 390 op/s 2024-04-26T20:29:55.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:54 smithi070 ceph-mon[29124]: pgmap v80: 97 pgs: 97 active+clean; 241 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 390 op/s 2024-04-26T20:29:56.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:56 smithi098 ceph-mon[32591]: pgmap v81: 97 pgs: 97 active+clean; 243 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 462 op/s 2024-04-26T20:29:56.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:56 smithi080 ceph-mon[32278]: pgmap v81: 97 pgs: 97 active+clean; 243 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 462 op/s 2024-04-26T20:29:57.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:56 smithi070 ceph-mon[29124]: pgmap v81: 97 pgs: 97 active+clean; 243 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 462 op/s 2024-04-26T20:29:58.741 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-04-26T20:29:58.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T20:29:58.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:29:58 smithi098 ceph-mon[32591]: pgmap v82: 97 pgs: 97 active+clean; 244 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 426 op/s 2024-04-26T20:29:58.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:29:58 smithi080 ceph-mon[32278]: pgmap v82: 97 pgs: 97 active+clean; 244 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 426 op/s 2024-04-26T20:29:59.005 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:29:58 smithi070 ceph-mon[29124]: pgmap v82: 97 pgs: 97 active+clean; 244 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 426 op/s 2024-04-26T20:29:59.006 DEBUG:teuthology.parallel:result is None 2024-04-26T20:29:59.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T20:29:59.040 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T20:29:59.040 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-04-26T20:29:59.051 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-04-26T20:29:59.051 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T20:29:59.051 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T20:29:59.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-04-26T20:29:59.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-04-26T20:30:00.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:00 smithi098 ceph-mon[32591]: pgmap v83: 97 pgs: 97 active+clean; 244 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 231 op/s 2024-04-26T20:30:00.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:00 smithi098 ceph-mon[32591]: overall HEALTH_OK 2024-04-26T20:30:00.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:00 smithi080 ceph-mon[32278]: pgmap v83: 97 pgs: 97 active+clean; 244 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 231 op/s 2024-04-26T20:30:00.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:00 smithi080 ceph-mon[32278]: overall HEALTH_OK 2024-04-26T20:30:01.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:00 smithi070 ceph-mon[29124]: pgmap v83: 97 pgs: 97 active+clean; 244 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 231 op/s 2024-04-26T20:30:01.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:00 smithi070 ceph-mon[29124]: overall HEALTH_OK 2024-04-26T20:30:02.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:02 smithi098 ceph-mon[32591]: pgmap v84: 97 pgs: 97 active+clean; 238 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 375 op/s 2024-04-26T20:30:02.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:02 smithi080 ceph-mon[32278]: pgmap v84: 97 pgs: 97 active+clean; 238 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 375 op/s 2024-04-26T20:30:03.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:02 smithi070 ceph-mon[29124]: pgmap v84: 97 pgs: 97 active+clean; 238 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 375 op/s 2024-04-26T20:30:04.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:04 smithi098 ceph-mon[32591]: pgmap v85: 97 pgs: 97 active+clean; 238 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 309 op/s 2024-04-26T20:30:04.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:04 smithi080 ceph-mon[32278]: pgmap v85: 97 pgs: 97 active+clean; 238 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 309 op/s 2024-04-26T20:30:05.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:04 smithi070 ceph-mon[29124]: pgmap v85: 97 pgs: 97 active+clean; 238 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 309 op/s 2024-04-26T20:30:06.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:06 smithi098 ceph-mon[32591]: pgmap v86: 97 pgs: 97 active+clean; 238 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 330 op/s 2024-04-26T20:30:06.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:06 smithi080 ceph-mon[32278]: pgmap v86: 97 pgs: 97 active+clean; 238 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 330 op/s 2024-04-26T20:30:07.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:06 smithi070 ceph-mon[29124]: pgmap v86: 97 pgs: 97 active+clean; 238 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 330 op/s 2024-04-26T20:30:08.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:08 smithi098 ceph-mon[32591]: pgmap v87: 97 pgs: 97 active+clean; 237 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 916 KiB/s wr, 268 op/s 2024-04-26T20:30:08.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:08 smithi080 ceph-mon[32278]: pgmap v87: 97 pgs: 97 active+clean; 237 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 916 KiB/s wr, 268 op/s 2024-04-26T20:30:09.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:08 smithi070 ceph-mon[29124]: pgmap v87: 97 pgs: 97 active+clean; 237 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 916 KiB/s wr, 268 op/s 2024-04-26T20:30:10.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:10 smithi098 ceph-mon[32591]: pgmap v88: 97 pgs: 97 active+clean; 237 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 571 KiB/s wr, 173 op/s 2024-04-26T20:30:10.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:10 smithi080 ceph-mon[32278]: pgmap v88: 97 pgs: 97 active+clean; 237 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 571 KiB/s wr, 173 op/s 2024-04-26T20:30:11.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:10 smithi070 ceph-mon[29124]: pgmap v88: 97 pgs: 97 active+clean; 237 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 571 KiB/s wr, 173 op/s 2024-04-26T20:30:12.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:12 smithi098 ceph-mon[32591]: pgmap v89: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 579 KiB/s wr, 178 op/s 2024-04-26T20:30:12.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:12 smithi080 ceph-mon[32278]: pgmap v89: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 579 KiB/s wr, 178 op/s 2024-04-26T20:30:13.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:12 smithi070 ceph-mon[29124]: pgmap v89: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 579 KiB/s wr, 178 op/s 2024-04-26T20:30:14.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:14 smithi098 ceph-mon[32591]: pgmap v90: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 32 KiB/s wr, 34 op/s 2024-04-26T20:30:14.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:14 smithi080 ceph-mon[32278]: pgmap v90: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 32 KiB/s wr, 34 op/s 2024-04-26T20:30:15.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:14 smithi070 ceph-mon[29124]: pgmap v90: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 32 KiB/s wr, 34 op/s 2024-04-26T20:30:16.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:16 smithi098 ceph-mon[32591]: pgmap v91: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 32 KiB/s wr, 36 op/s 2024-04-26T20:30:16.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:16 smithi080 ceph-mon[32278]: pgmap v91: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 32 KiB/s wr, 36 op/s 2024-04-26T20:30:17.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:16 smithi070 ceph-mon[29124]: pgmap v91: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 32 KiB/s wr, 36 op/s 2024-04-26T20:30:18.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:18 smithi098 ceph-mon[32591]: pgmap v92: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-04-26T20:30:18.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:18 smithi080 ceph-mon[32278]: pgmap v92: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-04-26T20:30:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:18 smithi070 ceph-mon[29124]: pgmap v92: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-04-26T20:30:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:20 smithi098 ceph-mon[32591]: pgmap v93: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 9 op/s 2024-04-26T20:30:20.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:20 smithi080 ceph-mon[32278]: pgmap v93: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 9 op/s 2024-04-26T20:30:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:20 smithi070 ceph-mon[29124]: pgmap v93: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 9 op/s 2024-04-26T20:30:22.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:22 smithi098 ceph-mon[32591]: pgmap v94: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.1 KiB/s wr, 13 op/s 2024-04-26T20:30:22.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:22 smithi080 ceph-mon[32278]: pgmap v94: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.1 KiB/s wr, 13 op/s 2024-04-26T20:30:23.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:22 smithi070 ceph-mon[29124]: pgmap v94: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.1 KiB/s wr, 13 op/s 2024-04-26T20:30:24.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:24 smithi098 ceph-mon[32591]: pgmap v95: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-04-26T20:30:24.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:24 smithi080 ceph-mon[32278]: pgmap v95: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-04-26T20:30:25.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:24 smithi070 ceph-mon[29124]: pgmap v95: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-04-26T20:30:26.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:26 smithi098 ceph-mon[32591]: pgmap v96: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-04-26T20:30:26.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:26 smithi080 ceph-mon[32278]: pgmap v96: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-04-26T20:30:27.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:26 smithi070 ceph-mon[29124]: pgmap v96: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-04-26T20:30:27.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:27 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:30:27.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:27 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:27.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:27 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:27.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:27 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:30:27.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:27 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:30:27.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:27 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:27.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:27 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:27.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:27 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:30:28.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:27 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:30:28.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:27 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:28.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:27 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:28.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:27 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:30:28.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:28 smithi098 ceph-mon[32591]: pgmap v97: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-04-26T20:30:28.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:28 smithi080 ceph-mon[32278]: pgmap v97: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-04-26T20:30:29.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:28 smithi070 ceph-mon[29124]: pgmap v97: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-04-26T20:30:30.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:30 smithi098 ceph-mon[32591]: pgmap v98: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-26T20:30:30.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:30 smithi080 ceph-mon[32278]: pgmap v98: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-26T20:30:31.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:30 smithi070 ceph-mon[29124]: pgmap v98: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-04-26T20:30:32.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:32 smithi098 ceph-mon[32591]: pgmap v99: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-04-26T20:30:32.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:32 smithi080 ceph-mon[32278]: pgmap v99: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-04-26T20:30:33.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:32 smithi070 ceph-mon[29124]: pgmap v99: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-04-26T20:30:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:34 smithi098 ceph-mon[32591]: pgmap v100: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-26T20:30:34.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:34 smithi080 ceph-mon[32278]: pgmap v100: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-26T20:30:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:34 smithi070 ceph-mon[29124]: pgmap v100: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-26T20:30:36.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:36 smithi098 ceph-mon[32591]: pgmap v101: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-26T20:30:36.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:36 smithi080 ceph-mon[32278]: pgmap v101: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-26T20:30:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:36 smithi070 ceph-mon[29124]: pgmap v101: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-26T20:30:38.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:38 smithi098 ceph-mon[32591]: pgmap v102: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-26T20:30:38.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:38 smithi080 ceph-mon[32278]: pgmap v102: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-26T20:30:39.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:38 smithi070 ceph-mon[29124]: pgmap v102: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-26T20:30:40.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:40 smithi098 ceph-mon[32591]: pgmap v103: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-26T20:30:40.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:40 smithi080 ceph-mon[32278]: pgmap v103: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-26T20:30:41.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:40 smithi070 ceph-mon[29124]: pgmap v103: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-26T20:30:42.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:42 smithi098 ceph-mon[32591]: pgmap v104: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 682 B/s wr, 12 op/s 2024-04-26T20:30:42.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:42 smithi080 ceph-mon[32278]: pgmap v104: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 682 B/s wr, 12 op/s 2024-04-26T20:30:43.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:42 smithi070 ceph-mon[29124]: pgmap v104: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 682 B/s wr, 12 op/s 2024-04-26T20:30:44.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:44 smithi098 ceph-mon[32591]: pgmap v105: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:30:44.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:44 smithi080 ceph-mon[32278]: pgmap v105: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:30:45.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:44 smithi070 ceph-mon[29124]: pgmap v105: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:30:46.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:46 smithi098 ceph-mon[32591]: pgmap v106: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:30:46.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:46 smithi080 ceph-mon[32278]: pgmap v106: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:30:47.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:46 smithi070 ceph-mon[29124]: pgmap v106: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:30:48.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:48 smithi098 ceph-mon[32591]: pgmap v107: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:30:48.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:48 smithi080 ceph-mon[32278]: pgmap v107: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:30:49.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:48 smithi070 ceph-mon[29124]: pgmap v107: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:30:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:50 smithi098 ceph-mon[32591]: pgmap v108: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:30:50.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:50 smithi080 ceph-mon[32278]: pgmap v108: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:30:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:50 smithi070 ceph-mon[29124]: pgmap v108: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:30:52.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:52 smithi098 ceph-mon[32591]: pgmap v109: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:30:52.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:52 smithi080 ceph-mon[32278]: pgmap v109: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:30:53.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:52 smithi070 ceph-mon[29124]: pgmap v109: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:30:54.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:54 smithi098 ceph-mon[32591]: pgmap v110: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:30:54.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:54 smithi080 ceph-mon[32278]: pgmap v110: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:30:55.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:54 smithi070 ceph-mon[29124]: pgmap v110: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:30:56.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:56 smithi098 ceph-mon[32591]: pgmap v111: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:30:56.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:56 smithi080 ceph-mon[32278]: pgmap v111: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:30:57.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:56 smithi070 ceph-mon[29124]: pgmap v111: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:30:58.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:30:58 smithi098 ceph-mon[32591]: pgmap v112: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:30:58.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:30:58 smithi080 ceph-mon[32278]: pgmap v112: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:30:59.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:30:58 smithi070 ceph-mon[29124]: pgmap v112: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:00.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:00 smithi098 ceph-mon[32591]: pgmap v113: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:00.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:00 smithi080 ceph-mon[32278]: pgmap v113: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:01.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:00 smithi070 ceph-mon[29124]: pgmap v113: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:02.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:02 smithi098 ceph-mon[32591]: pgmap v114: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:02.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:02 smithi080 ceph-mon[32278]: pgmap v114: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:03.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:02 smithi070 ceph-mon[29124]: pgmap v114: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:04.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:04 smithi098 ceph-mon[32591]: pgmap v115: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:04.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:04 smithi080 ceph-mon[32278]: pgmap v115: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:05.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:04 smithi070 ceph-mon[29124]: pgmap v115: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:06.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:06 smithi098 ceph-mon[32591]: pgmap v116: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 23 op/s 2024-04-26T20:31:06.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:06 smithi080 ceph-mon[32278]: pgmap v116: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 23 op/s 2024-04-26T20:31:07.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:06 smithi070 ceph-mon[29124]: pgmap v116: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 23 op/s 2024-04-26T20:31:08.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:08 smithi098 ceph-mon[32591]: pgmap v117: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:31:08.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:08 smithi080 ceph-mon[32278]: pgmap v117: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:31:09.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:08 smithi070 ceph-mon[29124]: pgmap v117: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:31:10.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:10 smithi098 ceph-mon[32591]: pgmap v118: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:31:10.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:10 smithi080 ceph-mon[32278]: pgmap v118: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:31:11.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:10 smithi070 ceph-mon[29124]: pgmap v118: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:31:12.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:12 smithi098 ceph-mon[32591]: pgmap v119: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T20:31:12.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:12 smithi080 ceph-mon[32278]: pgmap v119: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T20:31:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:12 smithi070 ceph-mon[29124]: pgmap v119: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T20:31:14.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:14 smithi080 ceph-mon[32278]: pgmap v120: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:31:15.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:14 smithi070 ceph-mon[29124]: pgmap v120: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:31:15.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:14 smithi098 ceph-mon[32591]: pgmap v120: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:31:16.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:16 smithi080 ceph-mon[32278]: pgmap v121: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:31:17.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:16 smithi070 ceph-mon[29124]: pgmap v121: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:31:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:16 smithi098 ceph-mon[32591]: pgmap v121: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:31:18.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:18 smithi080 ceph-mon[32278]: pgmap v122: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-04-26T20:31:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:18 smithi070 ceph-mon[29124]: pgmap v122: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-04-26T20:31:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:18 smithi098 ceph-mon[32591]: pgmap v122: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-04-26T20:31:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:20 smithi070 ceph-mon[29124]: pgmap v123: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:31:21.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:20 smithi098 ceph-mon[32591]: pgmap v123: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:31:21.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:20 smithi080 ceph-mon[32278]: pgmap v123: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:31:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:22 smithi070 ceph-mon[29124]: pgmap v124: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:31:23.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:22 smithi098 ceph-mon[32591]: pgmap v124: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:31:23.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:22 smithi080 ceph-mon[32278]: pgmap v124: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:31:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:24 smithi070 ceph-mon[29124]: pgmap v125: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:31:25.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:24 smithi098 ceph-mon[32591]: pgmap v125: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:31:25.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:24 smithi080 ceph-mon[32278]: pgmap v125: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:31:27.010 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:26 smithi098 ceph-mon[32591]: pgmap v126: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:31:27.022 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:26 smithi080 ceph-mon[32278]: pgmap v126: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:31:27.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:26 smithi070 ceph-mon[29124]: pgmap v126: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:31:28.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:27 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:28.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:27 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:28.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:27 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:28 smithi070 ceph-mon[29124]: pgmap v127: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:28 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:28 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:28 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:31:29.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:28 smithi098 ceph-mon[32591]: pgmap v127: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:29.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:28 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:29.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:28 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:29.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:28 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:31:29.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:28 smithi080 ceph-mon[32278]: pgmap v127: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:29.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:28 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:29.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:28 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:29.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:28 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:31:31.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:30 smithi070 ceph-mon[29124]: pgmap v128: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:30 smithi098 ceph-mon[32591]: pgmap v128: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:31.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:30 smithi080 ceph-mon[32278]: pgmap v128: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:32 smithi070 ceph-mon[29124]: pgmap v129: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:33.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:32 smithi098 ceph-mon[32591]: pgmap v129: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:33.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:32 smithi080 ceph-mon[32278]: pgmap v129: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:34 smithi070 ceph-mon[29124]: pgmap v130: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:35.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:34 smithi098 ceph-mon[32591]: pgmap v130: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:35.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:34 smithi080 ceph-mon[32278]: pgmap v130: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:36 smithi070 ceph-mon[29124]: pgmap v131: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:31:37.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:36 smithi098 ceph-mon[32591]: pgmap v131: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:31:37.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:36 smithi080 ceph-mon[32278]: pgmap v131: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:31:39.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:38 smithi070 ceph-mon[29124]: pgmap v132: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:38 smithi098 ceph-mon[32591]: pgmap v132: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:39.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:38 smithi080 ceph-mon[32278]: pgmap v132: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:41.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:40 smithi070 ceph-mon[29124]: pgmap v133: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:40 smithi098 ceph-mon[32591]: pgmap v133: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:41.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:40 smithi080 ceph-mon[32278]: pgmap v133: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:43.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:42 smithi070 ceph-mon[29124]: pgmap v134: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:42 smithi098 ceph-mon[32591]: pgmap v134: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:43.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:42 smithi080 ceph-mon[32278]: pgmap v134: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:45.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:44 smithi070 ceph-mon[29124]: pgmap v135: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:44 smithi098 ceph-mon[32591]: pgmap v135: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:45.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:44 smithi080 ceph-mon[32278]: pgmap v135: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:47.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:46 smithi070 ceph-mon[29124]: pgmap v136: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:31:47.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:46 smithi098 ceph-mon[32591]: pgmap v136: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:31:47.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:46 smithi080 ceph-mon[32278]: pgmap v136: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:31:49.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:48 smithi070 ceph-mon[29124]: pgmap v137: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:49.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:48 smithi098 ceph-mon[32591]: pgmap v137: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:49.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:48 smithi080 ceph-mon[32278]: pgmap v137: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:51.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:50 smithi070 ceph-mon[29124]: pgmap v138: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:51.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:50 smithi098 ceph-mon[32591]: pgmap v138: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:51.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:50 smithi080 ceph-mon[32278]: pgmap v138: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:53.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:52 smithi070 ceph-mon[29124]: pgmap v139: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:53.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:52 smithi098 ceph-mon[32591]: pgmap v139: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:53.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:52 smithi080 ceph-mon[32278]: pgmap v139: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:31:55.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:54 smithi070 ceph-mon[29124]: pgmap v140: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:55.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:54 smithi098 ceph-mon[32591]: pgmap v140: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:55.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:54 smithi080 ceph-mon[32278]: pgmap v140: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:31:57.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:56 smithi070 ceph-mon[29124]: pgmap v141: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:31:57.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:56 smithi098 ceph-mon[32591]: pgmap v141: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:31:57.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:56 smithi080 ceph-mon[32278]: pgmap v141: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:31:59.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:58 smithi070 ceph-mon[29124]: pgmap v142: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:59.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:31:58 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:58 smithi098 ceph-mon[32591]: pgmap v142: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:31:58 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:59.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:58 smithi080 ceph-mon[32278]: pgmap v142: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:31:59.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:31:58 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:00 smithi098 ceph-mon[32591]: pgmap v143: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:00 smithi080 ceph-mon[32278]: pgmap v143: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:01.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:00 smithi070 ceph-mon[29124]: pgmap v143: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:02.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:01 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:02.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:01 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:02.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:01 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:02 smithi098 ceph-mon[32591]: pgmap v144: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:02 smithi080 ceph-mon[32278]: pgmap v144: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:03.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:02 smithi070 ceph-mon[29124]: pgmap v144: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:05.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:04 smithi098 ceph-mon[32591]: pgmap v145: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:05.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:04 smithi080 ceph-mon[32278]: pgmap v145: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:05.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:04 smithi070 ceph-mon[29124]: pgmap v145: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:07.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:06 smithi098 ceph-mon[32591]: pgmap v146: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-26T20:32:07.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:06 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:07.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:06 smithi080 ceph-mon[32278]: pgmap v146: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-26T20:32:07.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:06 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:07.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:06 smithi070 ceph-mon[29124]: pgmap v146: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-26T20:32:07.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:06 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:08.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:07 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:08.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:07 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:08.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:07 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:09.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:08 smithi098 ceph-mon[32591]: pgmap v147: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:32:09.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:08 smithi080 ceph-mon[32278]: pgmap v147: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:32:09.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:08 smithi070 ceph-mon[29124]: pgmap v147: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:32:10.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:09 smithi098 ceph-mon[32591]: pgmap v148: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:32:10.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:09 smithi080 ceph-mon[32278]: pgmap v148: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:32:10.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:09 smithi070 ceph-mon[29124]: pgmap v148: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:32:12.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:11 smithi070 ceph-mon[29124]: pgmap v149: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T20:32:12.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:11 smithi098 ceph-mon[32591]: pgmap v149: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T20:32:12.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:11 smithi080 ceph-mon[32278]: pgmap v149: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T20:32:14.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:13 smithi070 ceph-mon[29124]: pgmap v150: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:32:14.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:13 smithi098 ceph-mon[32591]: pgmap v150: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:32:14.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:13 smithi080 ceph-mon[32278]: pgmap v150: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:32:15.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:14 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:15.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:14 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:15.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:14 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:16.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:15 smithi070 ceph-mon[29124]: pgmap v151: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:32:16.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:15 smithi098 ceph-mon[32591]: pgmap v151: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:32:16.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:15 smithi080 ceph-mon[32278]: pgmap v151: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:32:17.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:16 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:17.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:16 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:17.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:16 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:18.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:18 smithi070 ceph-mon[29124]: pgmap v152: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:32:18.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:18 smithi098 ceph-mon[32591]: pgmap v152: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:32:18.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:18 smithi080 ceph-mon[32278]: pgmap v152: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:32:20.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:20 smithi070 ceph-mon[29124]: pgmap v153: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:32:20.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:20 smithi098 ceph-mon[32591]: pgmap v153: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:32:20.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:20 smithi080 ceph-mon[32278]: pgmap v153: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:32:22.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:22 smithi070 ceph-mon[29124]: pgmap v154: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:32:22.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:22 smithi070 ceph-mon[29124]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:22.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:22 smithi098 ceph-mon[32591]: pgmap v154: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:32:22.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:22 smithi098 ceph-mon[32591]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:22.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:22 smithi080 ceph-mon[32278]: pgmap v154: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:32:22.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:22 smithi080 ceph-mon[32278]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:32:24.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:24 smithi070 ceph-mon[29124]: pgmap v155: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:32:24.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:24 smithi098 ceph-mon[32591]: pgmap v155: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:32:24.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:24 smithi080 ceph-mon[32278]: pgmap v155: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:32:26.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:26 smithi070 ceph-mon[29124]: pgmap v156: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:32:26.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:26 smithi098 ceph-mon[32591]: pgmap v156: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:32:26.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:26 smithi080 ceph-mon[32278]: pgmap v156: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:32:28.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:28 smithi070 ceph-mon[29124]: pgmap v157: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:32:28.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:28 smithi098 ceph-mon[32591]: pgmap v157: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:32:28.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:28 smithi080 ceph-mon[32278]: pgmap v157: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:32:29.289 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:29 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:29.289 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:29 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:29.289 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:29 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:29.289 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:29 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:32:29.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:29 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:29.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:29 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:29.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:29 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:29.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:29 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:32:29.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:29 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:29.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:29 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:29.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:29 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:29.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:29 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:32:30.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:30 smithi070 ceph-mon[29124]: pgmap v158: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:30.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:30 smithi098 ceph-mon[32591]: pgmap v158: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:30.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:30 smithi080 ceph-mon[32278]: pgmap v158: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:32.285 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:32 smithi070 ceph-mon[29124]: pgmap v159: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:32.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:32 smithi098 ceph-mon[32591]: pgmap v159: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:32.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:32 smithi080 ceph-mon[32278]: pgmap v159: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:34.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:34 smithi098 ceph-mon[32591]: pgmap v160: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:34.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:34 smithi080 ceph-mon[32278]: pgmap v160: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:34.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:34 smithi070 ceph-mon[29124]: pgmap v160: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:36.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:36 smithi098 ceph-mon[32591]: pgmap v161: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:32:36.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:36 smithi080 ceph-mon[32278]: pgmap v161: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:32:36.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:36 smithi070 ceph-mon[29124]: pgmap v161: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:32:38.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:38 smithi098 ceph-mon[32591]: pgmap v162: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:32:38.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:38 smithi080 ceph-mon[32278]: pgmap v162: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:32:38.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:38 smithi070 ceph-mon[29124]: pgmap v162: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:32:40.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:40 smithi098 ceph-mon[32591]: pgmap v163: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:40.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:40 smithi080 ceph-mon[32278]: pgmap v163: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:40.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:40 smithi070 ceph-mon[29124]: pgmap v163: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:42.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:42 smithi098 ceph-mon[32591]: pgmap v164: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:42.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:42 smithi080 ceph-mon[32278]: pgmap v164: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:42.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:42 smithi070 ceph-mon[29124]: pgmap v164: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:44.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:44 smithi098 ceph-mon[32591]: pgmap v165: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:44.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:44 smithi080 ceph-mon[32278]: pgmap v165: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:44.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:44 smithi070 ceph-mon[29124]: pgmap v165: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:46.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:46 smithi098 ceph-mon[32591]: pgmap v166: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:32:46.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:46 smithi080 ceph-mon[32278]: pgmap v166: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:32:46.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:46 smithi070 ceph-mon[29124]: pgmap v166: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:32:48.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:48 smithi098 ceph-mon[32591]: pgmap v167: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:32:48.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:48 smithi080 ceph-mon[32278]: pgmap v167: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:32:48.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:48 smithi070 ceph-mon[29124]: pgmap v167: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:32:50.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:50 smithi098 ceph-mon[32591]: pgmap v168: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:50.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:50 smithi080 ceph-mon[32278]: pgmap v168: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:50.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:50 smithi070 ceph-mon[29124]: pgmap v168: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:52.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:52 smithi098 ceph-mon[32591]: pgmap v169: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:52.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:52 smithi080 ceph-mon[32278]: pgmap v169: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:52.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:52 smithi070 ceph-mon[29124]: pgmap v169: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:32:54.336 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:54 smithi070 ceph-mon[29124]: pgmap v170: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:54.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:54 smithi098 ceph-mon[32591]: pgmap v170: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:54.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:54 smithi080 ceph-mon[32278]: pgmap v170: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:32:56.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:56 smithi098 ceph-mon[32591]: pgmap v171: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:32:56.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:56 smithi080 ceph-mon[32278]: pgmap v171: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:32:56.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:56 smithi070 ceph-mon[29124]: pgmap v171: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:32:58.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:32:58 smithi098 ceph-mon[32591]: pgmap v172: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:32:58.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:32:58 smithi080 ceph-mon[32278]: pgmap v172: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:32:58.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:32:58 smithi070 ceph-mon[29124]: pgmap v172: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:33:00.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:00 smithi098 ceph-mon[32591]: pgmap v173: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:00.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:00 smithi080 ceph-mon[32278]: pgmap v173: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:00.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:00 smithi070 ceph-mon[29124]: pgmap v173: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:02.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:02 smithi098 ceph-mon[32591]: pgmap v174: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:02.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:02 smithi080 ceph-mon[32278]: pgmap v174: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:02.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:02 smithi070 ceph-mon[29124]: pgmap v174: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:04.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:04 smithi098 ceph-mon[32591]: pgmap v175: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:04.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:04 smithi080 ceph-mon[32278]: pgmap v175: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:04.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:04 smithi070 ceph-mon[29124]: pgmap v175: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:06.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:06 smithi098 ceph-mon[32591]: pgmap v176: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-26T20:33:06.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:06 smithi080 ceph-mon[32278]: pgmap v176: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-26T20:33:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:06 smithi070 ceph-mon[29124]: pgmap v176: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-26T20:33:08.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:08 smithi098 ceph-mon[32591]: pgmap v177: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:33:08.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:08 smithi080 ceph-mon[32278]: pgmap v177: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:33:08.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:08 smithi070 ceph-mon[29124]: pgmap v177: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:33:10.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:10 smithi098 ceph-mon[32591]: pgmap v178: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:33:10.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:10 smithi080 ceph-mon[32278]: pgmap v178: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:33:10.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:10 smithi070 ceph-mon[29124]: pgmap v178: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:33:12.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:12 smithi098 ceph-mon[32591]: pgmap v179: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T20:33:12.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:12 smithi080 ceph-mon[32278]: pgmap v179: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T20:33:12.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:12 smithi070 ceph-mon[29124]: pgmap v179: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T20:33:14.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:14 smithi098 ceph-mon[32591]: pgmap v180: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:33:14.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:14 smithi080 ceph-mon[32278]: pgmap v180: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:33:14.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:14 smithi070 ceph-mon[29124]: pgmap v180: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T20:33:16.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:16 smithi098 ceph-mon[32591]: pgmap v181: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:33:16.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:16 smithi080 ceph-mon[32278]: pgmap v181: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:33:16.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:16 smithi070 ceph-mon[29124]: pgmap v181: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-26T20:33:18.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:18 smithi098 ceph-mon[32591]: pgmap v182: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:33:18.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:18 smithi080 ceph-mon[32278]: pgmap v182: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:33:18.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:18 smithi070 ceph-mon[29124]: pgmap v182: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:33:20.462 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:20 smithi098 ceph-mon[32591]: pgmap v183: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:33:20.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:20 smithi080 ceph-mon[32278]: pgmap v183: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:33:20.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:20 smithi070 ceph-mon[29124]: pgmap v183: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T20:33:22.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:22 smithi098 ceph-mon[32591]: pgmap v184: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:33:22.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:22 smithi080 ceph-mon[32278]: pgmap v184: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:33:22.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:22 smithi070 ceph-mon[29124]: pgmap v184: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-26T20:33:24.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:24 smithi098 ceph-mon[32591]: pgmap v185: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:33:24.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:24 smithi080 ceph-mon[32278]: pgmap v185: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:33:24.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:24 smithi070 ceph-mon[29124]: pgmap v185: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:33:26.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:26 smithi098 ceph-mon[32591]: pgmap v186: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:33:26.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:26 smithi080 ceph-mon[32278]: pgmap v186: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:33:26.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:26 smithi070 ceph-mon[29124]: pgmap v186: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:33:28.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:28 smithi098 ceph-mon[32591]: pgmap v187: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:33:28.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:28 smithi080 ceph-mon[32278]: pgmap v187: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:33:28.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:28 smithi070 ceph-mon[29124]: pgmap v187: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:33:29.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:29 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:29.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:29 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:29.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:29 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:30.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:30 smithi098 ceph-mon[32591]: pgmap v188: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:30.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:30 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:30.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:30 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:30.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:30 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:33:30.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:30 smithi080 ceph-mon[32278]: pgmap v188: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:30.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:30 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:30.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:30 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:30.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:30 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:33:30.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:30 smithi070 ceph-mon[29124]: pgmap v188: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:30.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:30 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:30.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:30 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:30.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:30 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:33:32.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:32 smithi098 ceph-mon[32591]: pgmap v189: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:32.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:32 smithi080 ceph-mon[32278]: pgmap v189: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:32.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:32 smithi070 ceph-mon[29124]: pgmap v189: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:34.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:34 smithi098 ceph-mon[32591]: pgmap v190: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:34.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:34 smithi080 ceph-mon[32278]: pgmap v190: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:34.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:34 smithi070 ceph-mon[29124]: pgmap v190: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:36.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:36 smithi098 ceph-mon[32591]: pgmap v191: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-26T20:33:36.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:36 smithi080 ceph-mon[32278]: pgmap v191: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-26T20:33:36.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:36 smithi070 ceph-mon[29124]: pgmap v191: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-26T20:33:38.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:38 smithi098 ceph-mon[32591]: pgmap v192: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-26T20:33:38.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:38 smithi080 ceph-mon[32278]: pgmap v192: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-26T20:33:38.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:38 smithi070 ceph-mon[29124]: pgmap v192: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-26T20:33:40.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:40 smithi098 ceph-mon[32591]: pgmap v193: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T20:33:40.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:40 smithi080 ceph-mon[32278]: pgmap v193: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T20:33:40.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:40 smithi070 ceph-mon[29124]: pgmap v193: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T20:33:42.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:42 smithi098 ceph-mon[32591]: pgmap v194: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:42.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:42 smithi080 ceph-mon[32278]: pgmap v194: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:42.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:42 smithi070 ceph-mon[29124]: pgmap v194: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:44.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:44 smithi098 ceph-mon[32591]: pgmap v195: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T20:33:44.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:44 smithi080 ceph-mon[32278]: pgmap v195: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T20:33:44.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:44 smithi070 ceph-mon[29124]: pgmap v195: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T20:33:46.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:46 smithi098 ceph-mon[32591]: pgmap v196: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-26T20:33:46.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:46 smithi080 ceph-mon[32278]: pgmap v196: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-26T20:33:46.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:46 smithi070 ceph-mon[29124]: pgmap v196: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-26T20:33:48.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:48 smithi098 ceph-mon[32591]: pgmap v197: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:33:48.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:48 smithi080 ceph-mon[32278]: pgmap v197: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:33:48.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:48 smithi070 ceph-mon[29124]: pgmap v197: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:33:50.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:50 smithi098 ceph-mon[32591]: pgmap v198: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:50.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:50 smithi080 ceph-mon[32278]: pgmap v198: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:50.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:50 smithi070 ceph-mon[29124]: pgmap v198: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:52.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:52 smithi098 ceph-mon[32591]: pgmap v199: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:52.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:52 smithi080 ceph-mon[32278]: pgmap v199: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:52.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:52 smithi070 ceph-mon[29124]: pgmap v199: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:33:54.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:54 smithi098 ceph-mon[32591]: pgmap v200: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:54.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:54 smithi080 ceph-mon[32278]: pgmap v200: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:54.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:54 smithi070 ceph-mon[29124]: pgmap v200: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:33:56.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:56 smithi098 ceph-mon[32591]: pgmap v201: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:33:56.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:56 smithi080 ceph-mon[32278]: pgmap v201: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:33:56.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:56 smithi070 ceph-mon[29124]: pgmap v201: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:33:58.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:33:58 smithi098 ceph-mon[32591]: pgmap v202: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:33:58.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:33:58 smithi080 ceph-mon[32278]: pgmap v202: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:33:58.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:33:58 smithi070 ceph-mon[29124]: pgmap v202: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:34:00.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:00 smithi098 ceph-mon[32591]: pgmap v203: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:00.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:00 smithi080 ceph-mon[32278]: pgmap v203: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:00.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:00 smithi070 ceph-mon[29124]: pgmap v203: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:02.459 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:02 smithi098 ceph-mon[32591]: pgmap v204: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:34:02.471 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:02 smithi080 ceph-mon[32278]: pgmap v204: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:34:02.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:02 smithi070 ceph-mon[29124]: pgmap v204: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:34:04.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:04 smithi098 ceph-mon[32591]: pgmap v205: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:04.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:04 smithi080 ceph-mon[32278]: pgmap v205: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:04.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:04 smithi070 ceph-mon[29124]: pgmap v205: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:06.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:06 smithi098 ceph-mon[32591]: pgmap v206: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-26T20:34:06.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:06 smithi080 ceph-mon[32278]: pgmap v206: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-26T20:34:06.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:06 smithi070 ceph-mon[29124]: pgmap v206: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-26T20:34:08.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:08 smithi098 ceph-mon[32591]: pgmap v207: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-26T20:34:08.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:08 smithi080 ceph-mon[32278]: pgmap v207: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-26T20:34:08.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:08 smithi070 ceph-mon[29124]: pgmap v207: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-26T20:34:10.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:10 smithi098 ceph-mon[32591]: pgmap v208: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:34:10.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:10 smithi080 ceph-mon[32278]: pgmap v208: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:34:10.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:10 smithi070 ceph-mon[29124]: pgmap v208: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:34:12.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:12 smithi098 ceph-mon[32591]: pgmap v209: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T20:34:12.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:12 smithi098 ceph-mon[32591]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T20:34:12.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:12 smithi080 ceph-mon[32278]: pgmap v209: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T20:34:12.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:12 smithi080 ceph-mon[32278]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T20:34:12.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:12 smithi070 ceph-mon[29124]: pgmap v209: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T20:34:12.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:12 smithi070 ceph-mon[29124]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T20:34:14.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:14 smithi098 ceph-mon[32591]: pgmap v211: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:34:14.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:14 smithi080 ceph-mon[32278]: pgmap v211: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:34:14.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:14 smithi070 ceph-mon[29124]: pgmap v211: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:34:16.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:16 smithi098 ceph-mon[32591]: pgmap v212: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 307 B/s wr, 11 op/s 2024-04-26T20:34:16.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:16 smithi080 ceph-mon[32278]: pgmap v212: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 307 B/s wr, 11 op/s 2024-04-26T20:34:16.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:16 smithi070 ceph-mon[29124]: pgmap v212: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 307 B/s wr, 11 op/s 2024-04-26T20:34:18.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:18 smithi098 ceph-mon[32591]: pgmap v213: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:34:18.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:18 smithi098 ceph-mon[32591]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T20:34:18.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:18 smithi080 ceph-mon[32278]: pgmap v213: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:34:18.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:18 smithi080 ceph-mon[32278]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T20:34:18.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:18 smithi070 ceph-mon[29124]: pgmap v213: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:34:18.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:18 smithi070 ceph-mon[29124]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T20:34:20.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:20 smithi098 ceph-mon[32591]: pgmap v215: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-04-26T20:34:20.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:20 smithi080 ceph-mon[32278]: pgmap v215: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-04-26T20:34:20.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:20 smithi070 ceph-mon[29124]: pgmap v215: 97 pgs: 97 active+clean; 238 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-04-26T20:34:22.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:22 smithi098 ceph-mon[32591]: pgmap v216: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2024-04-26T20:34:22.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:22 smithi080 ceph-mon[32278]: pgmap v216: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2024-04-26T20:34:22.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:22 smithi070 ceph-mon[29124]: pgmap v216: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2024-04-26T20:34:24.458 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:24 smithi098 ceph-mon[32591]: pgmap v217: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:34:24.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:24 smithi080 ceph-mon[32278]: pgmap v217: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:34:24.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:24 smithi070 ceph-mon[29124]: pgmap v217: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:34:26.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:26 smithi080 ceph-mon[32278]: pgmap v218: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 9 op/s 2024-04-26T20:34:26.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:26 smithi070 ceph-mon[29124]: pgmap v218: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 9 op/s 2024-04-26T20:34:26.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:26 smithi098 ceph-mon[32591]: pgmap v218: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 9 op/s 2024-04-26T20:34:28.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:28 smithi080 ceph-mon[32278]: pgmap v219: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 9 op/s 2024-04-26T20:34:28.511 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:28 smithi098 ceph-mon[32591]: pgmap v219: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 9 op/s 2024-04-26T20:34:28.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:28 smithi070 ceph-mon[29124]: pgmap v219: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 9 op/s 2024-04-26T20:34:30.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:30 smithi080 ceph-mon[32278]: pgmap v220: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 94 B/s wr, 9 op/s 2024-04-26T20:34:30.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:30 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:30.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:30 smithi070 ceph-mon[29124]: pgmap v220: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 94 B/s wr, 9 op/s 2024-04-26T20:34:30.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:30 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:30.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:30 smithi098 ceph-mon[32591]: pgmap v220: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 94 B/s wr, 9 op/s 2024-04-26T20:34:30.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:30 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:31.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:31 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:34:31.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:31 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:34:31.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:31 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:34:31.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:31 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:34:31.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:31 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:34:31.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:31 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:34:31.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:31 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:34:31.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:31 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:34:31.709 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:31 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:34:32.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:32 smithi080 ceph-mon[32278]: pgmap v221: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:34:32.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:32 smithi070 ceph-mon[29124]: pgmap v221: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:34:32.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:32 smithi098 ceph-mon[32591]: pgmap v221: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:34:34.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:34 smithi080 ceph-mon[32278]: pgmap v222: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-04-26T20:34:34.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:34 smithi070 ceph-mon[29124]: pgmap v222: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-04-26T20:34:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:34 smithi098 ceph-mon[32591]: pgmap v222: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-04-26T20:34:36.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:36 smithi080 ceph-mon[32278]: pgmap v223: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-04-26T20:34:36.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:36 smithi070 ceph-mon[29124]: pgmap v223: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-04-26T20:34:36.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:36 smithi098 ceph-mon[32591]: pgmap v223: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-04-26T20:34:38.720 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:38 smithi080 ceph-mon[32278]: pgmap v224: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:34:38.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:38 smithi070 ceph-mon[29124]: pgmap v224: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:34:38.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:38 smithi098 ceph-mon[32591]: pgmap v224: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:34:40.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:40 smithi070 ceph-mon[29124]: pgmap v225: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:40.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:40 smithi098 ceph-mon[32591]: pgmap v225: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:40.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:40 smithi080 ceph-mon[32278]: pgmap v225: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:42.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:42 smithi070 ceph-mon[29124]: pgmap v226: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:34:42.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:42 smithi098 ceph-mon[32591]: pgmap v226: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:34:42.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:42 smithi080 ceph-mon[32278]: pgmap v226: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:34:44.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:44 smithi070 ceph-mon[29124]: pgmap v227: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:44.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:44 smithi098 ceph-mon[32591]: pgmap v227: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:44.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:44 smithi080 ceph-mon[32278]: pgmap v227: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:46.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:46 smithi070 ceph-mon[29124]: pgmap v228: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:34:46.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:46 smithi098 ceph-mon[32591]: pgmap v228: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:34:46.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:46 smithi080 ceph-mon[32278]: pgmap v228: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:34:48.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:48 smithi070 ceph-mon[29124]: pgmap v229: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:34:48.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:48 smithi098 ceph-mon[32591]: pgmap v229: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:34:48.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:48 smithi080 ceph-mon[32278]: pgmap v229: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:34:50.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:50 smithi070 ceph-mon[29124]: pgmap v230: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:50 smithi098 ceph-mon[32591]: pgmap v230: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:50.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:50 smithi080 ceph-mon[32278]: pgmap v230: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:52.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:52 smithi070 ceph-mon[29124]: pgmap v231: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:34:52.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:52 smithi098 ceph-mon[32591]: pgmap v231: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:34:52.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:52 smithi080 ceph-mon[32278]: pgmap v231: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:34:54.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:54 smithi070 ceph-mon[29124]: pgmap v232: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:54.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:54 smithi098 ceph-mon[32591]: pgmap v232: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:54.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:54 smithi080 ceph-mon[32278]: pgmap v232: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:34:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:56 smithi070 ceph-mon[29124]: pgmap v233: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:34:56.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:56 smithi098 ceph-mon[32591]: pgmap v233: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:34:56.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:56 smithi080 ceph-mon[32278]: pgmap v233: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:34:58.760 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:34:58 smithi098 ceph-mon[32591]: pgmap v234: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:34:58.772 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:34:58 smithi080 ceph-mon[32278]: pgmap v234: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:34:58.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:34:58 smithi070 ceph-mon[29124]: pgmap v234: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:00.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:00 smithi070 ceph-mon[29124]: pgmap v235: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:00.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:00 smithi098 ceph-mon[32591]: pgmap v235: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:00.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:00 smithi080 ceph-mon[32278]: pgmap v235: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:02.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:02 smithi070 ceph-mon[29124]: pgmap v236: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:35:02.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:02 smithi098 ceph-mon[32591]: pgmap v236: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:35:02.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:02 smithi080 ceph-mon[32278]: pgmap v236: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:35:04.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:04 smithi070 ceph-mon[29124]: pgmap v237: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:04.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:04 smithi098 ceph-mon[32591]: pgmap v237: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:04.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:04 smithi080 ceph-mon[32278]: pgmap v237: 97 pgs: 97 active+clean; 238 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:06.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:06 smithi070 ceph-mon[29124]: pgmap v238: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-26T20:35:06.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:06 smithi098 ceph-mon[32591]: pgmap v238: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-26T20:35:06.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:06 smithi080 ceph-mon[32278]: pgmap v238: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-26T20:35:08.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:08 smithi070 ceph-mon[29124]: pgmap v239: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-26T20:35:08.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:08 smithi098 ceph-mon[32591]: pgmap v239: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-26T20:35:08.971 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:08 smithi080 ceph-mon[32278]: pgmap v239: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-26T20:35:10.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:10 smithi070 ceph-mon[29124]: pgmap v240: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:35:10.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:10 smithi098 ceph-mon[32591]: pgmap v240: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:35:10.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:10 smithi080 ceph-mon[32278]: pgmap v240: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:35:11.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:11 smithi070 ceph-mon[29124]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T20:35:11.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:11 smithi098 ceph-mon[32591]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T20:35:11.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:11 smithi080 ceph-mon[32278]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T20:35:12.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:12 smithi070 ceph-mon[29124]: pgmap v242: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:35:12.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:12 smithi098 ceph-mon[32591]: pgmap v242: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:35:12.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:12 smithi080 ceph-mon[32278]: pgmap v242: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:35:14.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:14 smithi070 ceph-mon[29124]: pgmap v243: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:35:14.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:14 smithi098 ceph-mon[32591]: pgmap v243: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:35:14.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:14 smithi080 ceph-mon[32278]: pgmap v243: 97 pgs: 97 active+clean; 238 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:35:16.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:16 smithi070 ceph-mon[29124]: pgmap v244: 97 pgs: 97 active+clean; 176 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:16.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:16 smithi098 ceph-mon[32591]: pgmap v244: 97 pgs: 97 active+clean; 176 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:16.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:16 smithi080 ceph-mon[32278]: pgmap v244: 97 pgs: 97 active+clean; 176 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:18.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:18 smithi098 ceph-mon[32591]: pgmap v245: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:18.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:18 smithi098 ceph-mon[32591]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T20:35:18.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:18 smithi080 ceph-mon[32278]: pgmap v245: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:18.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:18 smithi080 ceph-mon[32278]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T20:35:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:18 smithi070 ceph-mon[29124]: pgmap v245: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:18 smithi070 ceph-mon[29124]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T20:35:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:20 smithi098 ceph-mon[32591]: pgmap v247: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 121 B/s wr, 6 op/s 2024-04-26T20:35:20.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:20 smithi080 ceph-mon[32278]: pgmap v247: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 121 B/s wr, 6 op/s 2024-04-26T20:35:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:20 smithi070 ceph-mon[29124]: pgmap v247: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 121 B/s wr, 6 op/s 2024-04-26T20:35:22.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:22 smithi098 ceph-mon[32591]: pgmap v248: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:22.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:22 smithi080 ceph-mon[32278]: pgmap v248: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:22 smithi070 ceph-mon[29124]: pgmap v248: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:24.837 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:24 smithi070 ceph-mon[29124]: pgmap v249: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:24.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:24 smithi098 ceph-mon[32591]: pgmap v249: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:24.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:24 smithi080 ceph-mon[32278]: pgmap v249: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:35:26.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:26 smithi098 ceph-mon[32591]: pgmap v250: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:35:26.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:26 smithi080 ceph-mon[32278]: pgmap v250: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:35:27.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:26 smithi070 ceph-mon[29124]: pgmap v250: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:35:28.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:28 smithi098 ceph-mon[32591]: pgmap v251: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:35:28.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:28 smithi080 ceph-mon[32278]: pgmap v251: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:35:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:28 smithi070 ceph-mon[29124]: pgmap v251: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:35:30.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:30 smithi098 ceph-mon[32591]: pgmap v252: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2024-04-26T20:35:30.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:30 smithi080 ceph-mon[32278]: pgmap v252: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2024-04-26T20:35:31.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:30 smithi070 ceph-mon[29124]: pgmap v252: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2024-04-26T20:35:31.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:31 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:35:31.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:31 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:31.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:31 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:31.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:31 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:35:31.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:31 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:35:31.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:31 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:31.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:31 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:31.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:31 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:35:32.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:31 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:35:32.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:31 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:32.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:31 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:32.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:31 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:35:32.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:32 smithi098 ceph-mon[32591]: pgmap v253: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:35:32.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:32 smithi080 ceph-mon[32278]: pgmap v253: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:35:33.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:32 smithi070 ceph-mon[29124]: pgmap v253: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:35:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:34 smithi098 ceph-mon[32591]: pgmap v254: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:34.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:34 smithi080 ceph-mon[32278]: pgmap v254: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:35.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:34 smithi070 ceph-mon[29124]: pgmap v254: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:36.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:36 smithi098 ceph-mon[32591]: pgmap v255: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:35:36.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:36 smithi080 ceph-mon[32278]: pgmap v255: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:35:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:36 smithi070 ceph-mon[29124]: pgmap v255: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:35:38.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:38 smithi098 ceph-mon[32591]: pgmap v256: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:38.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:38 smithi080 ceph-mon[32278]: pgmap v256: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:39.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:38 smithi070 ceph-mon[29124]: pgmap v256: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:40.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:40 smithi098 ceph-mon[32591]: pgmap v257: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:40.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:40 smithi080 ceph-mon[32278]: pgmap v257: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:41.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:40 smithi070 ceph-mon[29124]: pgmap v257: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:42.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:42 smithi098 ceph-mon[32591]: pgmap v258: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:35:42.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:42 smithi080 ceph-mon[32278]: pgmap v258: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:35:43.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:42 smithi070 ceph-mon[29124]: pgmap v258: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:35:44.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:44 smithi098 ceph-mon[32591]: pgmap v259: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:44.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:44 smithi080 ceph-mon[32278]: pgmap v259: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:45.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:44 smithi070 ceph-mon[29124]: pgmap v259: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:46.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:46 smithi098 ceph-mon[32591]: pgmap v260: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:35:46.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:46 smithi080 ceph-mon[32278]: pgmap v260: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:35:47.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:46 smithi070 ceph-mon[29124]: pgmap v260: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:35:48.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:48 smithi098 ceph-mon[32591]: pgmap v261: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:48.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:48 smithi080 ceph-mon[32278]: pgmap v261: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:49.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:48 smithi070 ceph-mon[29124]: pgmap v261: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:50 smithi098 ceph-mon[32591]: pgmap v262: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:50.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:50 smithi080 ceph-mon[32278]: pgmap v262: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:51.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:50 smithi070 ceph-mon[29124]: pgmap v262: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:52.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:52 smithi098 ceph-mon[32591]: pgmap v263: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:35:52.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:52 smithi080 ceph-mon[32278]: pgmap v263: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:35:53.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:52 smithi070 ceph-mon[29124]: pgmap v263: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:35:54.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:54 smithi098 ceph-mon[32591]: pgmap v264: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:54.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:54 smithi080 ceph-mon[32278]: pgmap v264: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:55.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:54 smithi070 ceph-mon[29124]: pgmap v264: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:35:56.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:56 smithi098 ceph-mon[32591]: pgmap v265: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:35:56.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:56 smithi080 ceph-mon[32278]: pgmap v265: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:35:57.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:56 smithi070 ceph-mon[29124]: pgmap v265: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:35:58.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:35:58 smithi098 ceph-mon[32591]: pgmap v266: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:58.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:35:58 smithi080 ceph-mon[32278]: pgmap v266: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:59.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:35:58 smithi070 ceph-mon[29124]: pgmap v266: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:36:00.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:00 smithi098 ceph-mon[32591]: pgmap v267: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:00.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:00 smithi080 ceph-mon[32278]: pgmap v267: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:01.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:00 smithi070 ceph-mon[29124]: pgmap v267: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:02.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:02 smithi098 ceph-mon[32591]: pgmap v268: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:36:02.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:02 smithi080 ceph-mon[32278]: pgmap v268: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:36:03.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:02 smithi070 ceph-mon[29124]: pgmap v268: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:36:04.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:04 smithi098 ceph-mon[32591]: pgmap v269: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:04.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:04 smithi080 ceph-mon[32278]: pgmap v269: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:05.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:04 smithi070 ceph-mon[29124]: pgmap v269: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:06.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:06 smithi098 ceph-mon[32591]: pgmap v270: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-26T20:36:06.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:06 smithi080 ceph-mon[32278]: pgmap v270: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-26T20:36:07.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:06 smithi070 ceph-mon[29124]: pgmap v270: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-26T20:36:08.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:08 smithi098 ceph-mon[32591]: pgmap v271: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-26T20:36:08.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:08 smithi080 ceph-mon[32278]: pgmap v271: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-26T20:36:09.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:08 smithi070 ceph-mon[29124]: pgmap v271: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-26T20:36:10.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:10 smithi098 ceph-mon[32591]: pgmap v272: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:36:10.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:10 smithi080 ceph-mon[32278]: pgmap v272: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:36:11.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:10 smithi070 ceph-mon[29124]: pgmap v272: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:36:11.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:11 smithi098 ceph-mon[32591]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T20:36:11.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:11 smithi080 ceph-mon[32278]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T20:36:12.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:11 smithi070 ceph-mon[29124]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T20:36:12.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:12 smithi098 ceph-mon[32591]: pgmap v274: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:36:12.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:12 smithi080 ceph-mon[32278]: pgmap v274: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:36:13.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:12 smithi070 ceph-mon[29124]: pgmap v274: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:36:14.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:14 smithi098 ceph-mon[32591]: pgmap v275: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:36:14.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:14 smithi080 ceph-mon[32278]: pgmap v275: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:36:15.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:14 smithi070 ceph-mon[29124]: pgmap v275: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:36:16.961 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:16 smithi098 ceph-mon[32591]: pgmap v276: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:16.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:16 smithi080 ceph-mon[32278]: pgmap v276: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:17.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:16 smithi070 ceph-mon[29124]: pgmap v276: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:18.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:18 smithi098 ceph-mon[32591]: pgmap v277: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:18.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:18 smithi098 ceph-mon[32591]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T20:36:18.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:18 smithi080 ceph-mon[32278]: pgmap v277: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:18.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:18 smithi080 ceph-mon[32278]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T20:36:19.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:18 smithi070 ceph-mon[29124]: pgmap v277: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:18 smithi070 ceph-mon[29124]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T20:36:20.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:20 smithi098 ceph-mon[32591]: pgmap v279: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 122 B/s wr, 6 op/s 2024-04-26T20:36:20.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:20 smithi080 ceph-mon[32278]: pgmap v279: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 122 B/s wr, 6 op/s 2024-04-26T20:36:21.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:20 smithi070 ceph-mon[29124]: pgmap v279: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 122 B/s wr, 6 op/s 2024-04-26T20:36:22.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:22 smithi098 ceph-mon[32591]: pgmap v280: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:22.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:22 smithi080 ceph-mon[32278]: pgmap v280: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:23.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:22 smithi070 ceph-mon[29124]: pgmap v280: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:24.959 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:24 smithi098 ceph-mon[32591]: pgmap v281: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:24.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:24 smithi080 ceph-mon[32278]: pgmap v281: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:25.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:24 smithi070 ceph-mon[29124]: pgmap v281: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:36:26.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:26 smithi098 ceph-mon[32591]: pgmap v282: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:36:26.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:26 smithi080 ceph-mon[32278]: pgmap v282: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:36:27.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:26 smithi070 ceph-mon[29124]: pgmap v282: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:36:28.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:28 smithi098 ceph-mon[32591]: pgmap v283: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:36:28.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:28 smithi080 ceph-mon[32278]: pgmap v283: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:36:29.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:28 smithi070 ceph-mon[29124]: pgmap v283: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T20:36:30.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:30 smithi098 ceph-mon[32591]: pgmap v284: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2024-04-26T20:36:30.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:30 smithi080 ceph-mon[32278]: pgmap v284: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2024-04-26T20:36:31.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:30 smithi070 ceph-mon[29124]: pgmap v284: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2024-04-26T20:36:31.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:31 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:36:31.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:31 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:36:32.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:31 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:36:32.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:32 smithi098 ceph-mon[32591]: pgmap v285: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:36:32.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:32 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:36:32.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:32 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:36:32.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:32 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:36:32.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:32 smithi080 ceph-mon[32278]: pgmap v285: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:36:32.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:32 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:36:32.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:32 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:36:32.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:32 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:36:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:32 smithi070 ceph-mon[29124]: pgmap v285: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T20:36:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:32 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:36:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:32 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:36:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:32 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:36:34.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:34 smithi098 ceph-mon[32591]: pgmap v286: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:34.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:34 smithi080 ceph-mon[32278]: pgmap v286: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:35.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:34 smithi070 ceph-mon[29124]: pgmap v286: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:36.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:36 smithi098 ceph-mon[32591]: pgmap v287: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:36:36.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:36 smithi080 ceph-mon[32278]: pgmap v287: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:36:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:36 smithi070 ceph-mon[29124]: pgmap v287: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:36:38.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:38 smithi098 ceph-mon[32591]: pgmap v288: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:36:38.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:38 smithi080 ceph-mon[32278]: pgmap v288: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:36:39.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:38 smithi070 ceph-mon[29124]: pgmap v288: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:36:40.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:40 smithi098 ceph-mon[32591]: pgmap v289: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:40.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:40 smithi080 ceph-mon[32278]: pgmap v289: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:41.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:40 smithi070 ceph-mon[29124]: pgmap v289: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:42.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:42 smithi098 ceph-mon[32591]: pgmap v290: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:36:42.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:42 smithi080 ceph-mon[32278]: pgmap v290: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:36:43.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:42 smithi070 ceph-mon[29124]: pgmap v290: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:36:44.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:44 smithi098 ceph-mon[32591]: pgmap v291: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:44.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:44 smithi080 ceph-mon[32278]: pgmap v291: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:45.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:44 smithi070 ceph-mon[29124]: pgmap v291: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:46.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:46 smithi098 ceph-mon[32591]: pgmap v292: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:36:46.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:46 smithi080 ceph-mon[32278]: pgmap v292: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:36:47.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:46 smithi070 ceph-mon[29124]: pgmap v292: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:36:48.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:48 smithi098 ceph-mon[32591]: pgmap v293: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:36:48.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:48 smithi080 ceph-mon[32278]: pgmap v293: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:36:49.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:48 smithi070 ceph-mon[29124]: pgmap v293: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:36:50.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:50 smithi098 ceph-mon[32591]: pgmap v294: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:50.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:50 smithi080 ceph-mon[32278]: pgmap v294: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:51.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:50 smithi070 ceph-mon[29124]: pgmap v294: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:52.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:52 smithi098 ceph-mon[32591]: pgmap v295: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:36:52.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:52 smithi080 ceph-mon[32278]: pgmap v295: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:36:53.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:52 smithi070 ceph-mon[29124]: pgmap v295: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:36:54.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:54 smithi098 ceph-mon[32591]: pgmap v296: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:54.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:54 smithi080 ceph-mon[32278]: pgmap v296: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:55.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:54 smithi070 ceph-mon[29124]: pgmap v296: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:36:56.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:56 smithi098 ceph-mon[32591]: pgmap v297: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:36:56.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:56 smithi080 ceph-mon[32278]: pgmap v297: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:36:57.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:56 smithi070 ceph-mon[29124]: pgmap v297: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:36:58.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:36:58 smithi098 ceph-mon[32591]: pgmap v298: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:36:58.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:36:58 smithi080 ceph-mon[32278]: pgmap v298: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:36:59.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:36:58 smithi070 ceph-mon[29124]: pgmap v298: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:37:00.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:00 smithi098 ceph-mon[32591]: pgmap v299: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:00.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:00 smithi080 ceph-mon[32278]: pgmap v299: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:01.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:00 smithi070 ceph-mon[29124]: pgmap v299: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:02.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:02 smithi080 ceph-mon[32278]: pgmap v300: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:37:03.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:02 smithi070 ceph-mon[29124]: pgmap v300: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:37:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:02 smithi098 ceph-mon[32591]: pgmap v300: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:37:04.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:04 smithi080 ceph-mon[32278]: pgmap v301: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:05.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:04 smithi070 ceph-mon[29124]: pgmap v301: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:05.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:04 smithi098 ceph-mon[32591]: pgmap v301: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:06.970 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:06 smithi080 ceph-mon[32278]: pgmap v302: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-26T20:37:07.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:06 smithi070 ceph-mon[29124]: pgmap v302: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-26T20:37:07.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:06 smithi098 ceph-mon[32591]: pgmap v302: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-26T20:37:08.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:08 smithi080 ceph-mon[32278]: pgmap v303: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-26T20:37:09.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:08 smithi070 ceph-mon[29124]: pgmap v303: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-26T20:37:09.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:08 smithi098 ceph-mon[32591]: pgmap v303: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-26T20:37:11.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:10 smithi070 ceph-mon[29124]: pgmap v304: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:37:11.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:10 smithi098 ceph-mon[32591]: pgmap v304: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:37:11.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:10 smithi080 ceph-mon[32278]: pgmap v304: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T20:37:12.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:11 smithi070 ceph-mon[29124]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T20:37:12.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:11 smithi098 ceph-mon[32591]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T20:37:12.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:11 smithi080 ceph-mon[32278]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T20:37:13.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:12 smithi070 ceph-mon[29124]: pgmap v306: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:37:13.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:12 smithi098 ceph-mon[32591]: pgmap v306: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:37:13.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:12 smithi080 ceph-mon[32278]: pgmap v306: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:37:15.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:14 smithi070 ceph-mon[29124]: pgmap v307: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:37:15.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:14 smithi098 ceph-mon[32591]: pgmap v307: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:37:15.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:14 smithi080 ceph-mon[32278]: pgmap v307: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T20:37:17.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:16 smithi070 ceph-mon[29124]: pgmap v308: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:17.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:16 smithi098 ceph-mon[32591]: pgmap v308: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:17.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:16 smithi080 ceph-mon[32278]: pgmap v308: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:18 smithi070 ceph-mon[29124]: pgmap v309: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:19.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:18 smithi070 ceph-mon[29124]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T20:37:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:18 smithi098 ceph-mon[32591]: pgmap v309: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:19.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:18 smithi098 ceph-mon[32591]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T20:37:19.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:18 smithi080 ceph-mon[32278]: pgmap v309: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:19.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:18 smithi080 ceph-mon[32278]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T20:37:21.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:20 smithi070 ceph-mon[29124]: pgmap v311: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2024-04-26T20:37:21.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-26T20:37:21.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:20 smithi098 ceph-mon[32591]: pgmap v311: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2024-04-26T20:37:21.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:20 smithi080 ceph-mon[32278]: pgmap v311: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 6 op/s 2024-04-26T20:37:21.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.283+0000 7fa56e045640 1 -- 172.21.15.70:0/3176075601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa568107850 msgr2=0x7fa568107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.283+0000 7fa56e045640 1 --2- 172.21.15.70:0/3176075601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa568107850 0x7fa568107c30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa558009cd0 tx=0x7fa55802a8e0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.283+0000 7fa56e045640 1 -- 172.21.15.70:0/3176075601 shutdown_connections 2024-04-26T20:37:21.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.283+0000 7fa56e045640 1 --2- 172.21.15.70:0/3176075601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa568102250 0x7fa56810e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.283+0000 7fa56e045640 1 --2- 172.21.15.70:0/3176075601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa568101890 0x7fa568101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.283+0000 7fa56e045640 1 --2- 172.21.15.70:0/3176075601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa568107850 0x7fa568107c30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.283+0000 7fa56e045640 1 -- 172.21.15.70:0/3176075601 >> 172.21.15.70:0/3176075601 conn(0x7fa568078980 msgr2=0x7fa568078d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:21.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.283+0000 7fa56e045640 1 -- 172.21.15.70:0/3176075601 shutdown_connections 2024-04-26T20:37:21.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.283+0000 7fa56e045640 1 -- 172.21.15.70:0/3176075601 wait complete. 2024-04-26T20:37:21.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa56e045640 1 Processor -- start 2024-04-26T20:37:21.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa56e045640 1 -- start start 2024-04-26T20:37:21.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa56e045640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa568101890 0x7fa568110790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa56e045640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa568102250 0x7fa568110cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa56e045640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa568107850 0x7fa568111210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa56e045640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa568112d80 con 0x7fa568102250 2024-04-26T20:37:21.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa56e045640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa568112c00 con 0x7fa568101890 2024-04-26T20:37:21.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa56e045640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa568112f00 con 0x7fa568107850 2024-04-26T20:37:21.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa566ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa568102250 0x7fa568110cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa566ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa568102250 0x7fa568110cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44012/0 (socket says 172.21.15.70:44012) 2024-04-26T20:37:21.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa566ffd640 1 -- 172.21.15.70:0/2691517657 learned_addr learned my addr 172.21.15.70:0/2691517657 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:37:21.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.284+0000 7fa5677fe640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa568101890 0x7fa568110790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa567fff640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa568107850 0x7fa568111210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa566ffd640 1 -- 172.21.15.70:0/2691517657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa568107850 msgr2=0x7fa568111210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa566ffd640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa568107850 0x7fa568111210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa566ffd640 1 -- 172.21.15.70:0/2691517657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa568101890 msgr2=0x7fa568110790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa566ffd640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa568101890 0x7fa568110790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa566ffd640 1 -- 172.21.15.70:0/2691517657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5681a7810 con 0x7fa568102250 2024-04-26T20:37:21.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa566ffd640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa568102250 0x7fa568110cd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00b4a0 tx=0x7fa55c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:21.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa564ff9640 1 -- 172.21.15.70:0/2691517657 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c014070 con 0x7fa568102250 2024-04-26T20:37:21.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa564ff9640 1 -- 172.21.15.70:0/2691517657 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa55c010ae0 con 0x7fa568102250 2024-04-26T20:37:21.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa56e045640 1 -- 172.21.15.70:0/2691517657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5681a7b00 con 0x7fa568102250 2024-04-26T20:37:21.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa564ff9640 1 -- 172.21.15.70:0/2691517657 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c017ce0 con 0x7fa568102250 2024-04-26T20:37:21.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.285+0000 7fa56e045640 1 -- 172.21.15.70:0/2691517657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5681a8000 con 0x7fa568102250 2024-04-26T20:37:21.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.286+0000 7fa56e045640 1 -- 172.21.15.70:0/2691517657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa568102f80 con 0x7fa568102250 2024-04-26T20:37:21.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.288+0000 7fa564ff9640 1 -- 172.21.15.70:0/2691517657 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fa55c017070 con 0x7fa568102250 2024-04-26T20:37:21.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.289+0000 7fa564ff9640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fa5500a3d10 0x7fa5500a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.289+0000 7fa5677fe640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fa5500a3d10 0x7fa5500a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.289+0000 7fa564ff9640 1 -- 172.21.15.70:0/2691517657 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7fa55c0cff00 con 0x7fa568102250 2024-04-26T20:37:21.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.289+0000 7fa5677fe640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fa5500a3d10 0x7fa5500a61d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa558006010 tx=0x7fa558009420 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:21.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.292+0000 7fa564ff9640 1 -- 172.21.15.70:0/2691517657 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa55c09c660 con 0x7fa568102250 2024-04-26T20:37:21.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.497+0000 7fa56e045640 1 -- 172.21.15.70:0/2691517657 --> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fa568062d70 con 0x7fa5500a3d10 2024-04-26T20:37:21.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.504+0000 7fa564ff9640 1 -- 172.21.15.70:0/2691517657 <== mgr.15333 v2:172.21.15.70:6800/212113189 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fa568062d70 con 0x7fa5500a3d10 2024-04-26T20:37:21.505 INFO:teuthology.orchestra.run.smithi070.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-26T00:00:00", "created": "2024-04-26T20:27:19", "first": "2024-04-26T20:28:00", "last": "2024-04-26T20:37:00", "last_pruned": "2024-04-26T20:37:01", "created_count": 10, "pruned_count": 4, "active": true} 2024-04-26T20:37:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.506+0000 7fa56e045640 1 -- 172.21.15.70:0/2691517657 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fa5500a3d10 msgr2=0x7fa5500a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.506+0000 7fa56e045640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fa5500a3d10 0x7fa5500a61d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa558006010 tx=0x7fa558009420 comp rx=0 tx=0).stop 2024-04-26T20:37:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.507+0000 7fa56e045640 1 -- 172.21.15.70:0/2691517657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa568102250 msgr2=0x7fa568110cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.507+0000 7fa56e045640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa568102250 0x7fa568110cd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00b4a0 tx=0x7fa55c00b960 comp rx=0 tx=0).stop 2024-04-26T20:37:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.507+0000 7fa56e045640 1 -- 172.21.15.70:0/2691517657 shutdown_connections 2024-04-26T20:37:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.507+0000 7fa56e045640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fa5500a3d10 0x7fa5500a61d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.507+0000 7fa56e045640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa568107850 0x7fa568111210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.507+0000 7fa56e045640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa568102250 0x7fa568110cd0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.507+0000 7fa56e045640 1 --2- 172.21.15.70:0/2691517657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa568101890 0x7fa568110790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.507+0000 7fa56e045640 1 -- 172.21.15.70:0/2691517657 >> 172.21.15.70:0/2691517657 conn(0x7fa568078980 msgr2=0x7fa5681040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.507+0000 7fa56e045640 1 -- 172.21.15.70:0/2691517657 shutdown_connections 2024-04-26T20:37:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.507+0000 7fa56e045640 1 -- 172.21.15.70:0/2691517657 wait complete. 2024-04-26T20:37:21.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-26T20:37:21.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.617+0000 7f8452a47640 1 -- 172.21.15.70:0/1387399922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c108a00 msgr2=0x7f844c108de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.617+0000 7f8452a47640 1 --2- 172.21.15.70:0/1387399922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c108a00 0x7f844c108de0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f843c009900 tx=0x7f843c02a480 comp rx=0 tx=0).stop 2024-04-26T20:37:21.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.617+0000 7f8452a47640 1 -- 172.21.15.70:0/1387399922 shutdown_connections 2024-04-26T20:37:21.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.617+0000 7f8452a47640 1 --2- 172.21.15.70:0/1387399922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c06b950 0x7f844c10f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.617+0000 7f8452a47640 1 --2- 172.21.15.70:0/1387399922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f844c06afb0 0x7f844c06b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.617+0000 7f8452a47640 1 --2- 172.21.15.70:0/1387399922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c108a00 0x7f844c108de0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.617+0000 7f8452a47640 1 -- 172.21.15.70:0/1387399922 >> 172.21.15.70:0/1387399922 conn(0x7f844c0786b0 msgr2=0x7f844c078ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:21.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.617+0000 7f8452a47640 1 -- 172.21.15.70:0/1387399922 shutdown_connections 2024-04-26T20:37:21.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.617+0000 7f8452a47640 1 -- 172.21.15.70:0/1387399922 wait complete. 2024-04-26T20:37:21.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.617+0000 7f8452a47640 1 Processor -- start 2024-04-26T20:37:21.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f8452a47640 1 -- start start 2024-04-26T20:37:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f8452a47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c06afb0 0x7f844c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f8452a47640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c06b950 0x7f844c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f8452a47640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f844c108a00 0x7f844c19da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f8452a47640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f844c112d80 con 0x7f844c06afb0 2024-04-26T20:37:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f8452a47640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f844c112c00 con 0x7f844c06b950 2024-04-26T20:37:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f8452a47640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f844c112f00 con 0x7f844c108a00 2024-04-26T20:37:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f844bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c06afb0 0x7f844c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f844bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c06afb0 0x7f844c199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44026/0 (socket says 172.21.15.70:44026) 2024-04-26T20:37:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f844bfff640 1 -- 172.21.15.70:0/2514827349 learned_addr learned my addr 172.21.15.70:0/2514827349 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:37:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f844b7fe640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c06b950 0x7f844c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f8450fe4640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f844c108a00 0x7f844c19da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f844bfff640 1 -- 172.21.15.70:0/2514827349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f844c108a00 msgr2=0x7f844c19da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f844bfff640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f844c108a00 0x7f844c19da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f844bfff640 1 -- 172.21.15.70:0/2514827349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c06b950 msgr2=0x7f844c1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f844bfff640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c06b950 0x7f844c1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f844bfff640 1 -- 172.21.15.70:0/2514827349 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844c19e150 con 0x7f844c06afb0 2024-04-26T20:37:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f844b7fe640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c06b950 0x7f844c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:37:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.618+0000 7f844bfff640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c06afb0 0x7f844c199160 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f843c006010 tx=0x7f843c005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.619+0000 7f84497fa640 1 -- 172.21.15.70:0/2514827349 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c03f070 con 0x7f844c06afb0 2024-04-26T20:37:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.619+0000 7f8452a47640 1 -- 172.21.15.70:0/2514827349 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f844c19e3e0 con 0x7f844c06afb0 2024-04-26T20:37:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.619+0000 7f84497fa640 1 -- 172.21.15.70:0/2514827349 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f843c005630 con 0x7f844c06afb0 2024-04-26T20:37:21.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.619+0000 7f84497fa640 1 -- 172.21.15.70:0/2514827349 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c035030 con 0x7f844c06afb0 2024-04-26T20:37:21.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.619+0000 7f8452a47640 1 -- 172.21.15.70:0/2514827349 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f844c1a5cd0 con 0x7f844c06afb0 2024-04-26T20:37:21.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.620+0000 7f8452a47640 1 -- 172.21.15.70:0/2514827349 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844c104030 con 0x7f844c06afb0 2024-04-26T20:37:21.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.621+0000 7f84497fa640 1 -- 172.21.15.70:0/2514827349 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f843c042070 con 0x7f844c06afb0 2024-04-26T20:37:21.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.621+0000 7f84497fa640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f84340a3d10 0x7f84340a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.621+0000 7f844b7fe640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f84340a3d10 0x7f84340a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.621+0000 7f84497fa640 1 -- 172.21.15.70:0/2514827349 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7f843c0f17a0 con 0x7f844c06afb0 2024-04-26T20:37:21.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.622+0000 7f844b7fe640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f84340a3d10 0x7f84340a61d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8440006fd0 tx=0x7f8440008040 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:21.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.625+0000 7f84497fa640 1 -- 172.21.15.70:0/2514827349 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f843c0bddf0 con 0x7f844c06afb0 2024-04-26T20:37:21.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.826+0000 7f8452a47640 1 -- 172.21.15.70:0/2514827349 --> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f844c062d70 con 0x7f84340a3d10 2024-04-26T20:37:21.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.833+0000 7f84497fa640 1 -- 172.21.15.70:0/2514827349 <== mgr.15333 v2:172.21.15.70:6800/212113189 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f844c062d70 con 0x7f84340a3d10 2024-04-26T20:37:21.834 INFO:teuthology.orchestra.run.smithi070.stdout:/ 1m 6m3h 2024-04-26T20:37:21.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.835+0000 7f8452a47640 1 -- 172.21.15.70:0/2514827349 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f84340a3d10 msgr2=0x7f84340a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.835+0000 7f8452a47640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f84340a3d10 0x7f84340a61d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8440006fd0 tx=0x7f8440008040 comp rx=0 tx=0).stop 2024-04-26T20:37:21.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.835+0000 7f8452a47640 1 -- 172.21.15.70:0/2514827349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c06afb0 msgr2=0x7f844c199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.835+0000 7f8452a47640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c06afb0 0x7f844c199160 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f843c006010 tx=0x7f843c005000 comp rx=0 tx=0).stop 2024-04-26T20:37:21.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.836+0000 7f8452a47640 1 -- 172.21.15.70:0/2514827349 shutdown_connections 2024-04-26T20:37:21.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.836+0000 7f8452a47640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f84340a3d10 0x7f84340a61d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.836+0000 7f8452a47640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f844c108a00 0x7f844c19da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.836+0000 7f8452a47640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c06b950 0x7f844c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.836+0000 7f8452a47640 1 --2- 172.21.15.70:0/2514827349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c06afb0 0x7f844c199160 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.836+0000 7f8452a47640 1 -- 172.21.15.70:0/2514827349 >> 172.21.15.70:0/2514827349 conn(0x7f844c0786b0 msgr2=0x7f844c0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:21.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.836+0000 7f8452a47640 1 -- 172.21.15.70:0/2514827349 shutdown_connections 2024-04-26T20:37:21.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.836+0000 7f8452a47640 1 -- 172.21.15.70:0/2514827349 wait complete. 2024-04-26T20:37:21.847 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-26T20:37:21.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:37:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.954+0000 7fcb5302a640 1 -- 172.21.15.70:0/754600982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb4c1078b0 msgr2=0x7fcb4c107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.954+0000 7fcb5302a640 1 --2- 172.21.15.70:0/754600982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb4c1078b0 0x7fcb4c107c90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009900 tx=0x7fcb4002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.954+0000 7fcb5302a640 1 -- 172.21.15.70:0/754600982 shutdown_connections 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.954+0000 7fcb5302a640 1 --2- 172.21.15.70:0/754600982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4c102420 0x7fcb4c10e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.954+0000 7fcb5302a640 1 --2- 172.21.15.70:0/754600982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb4c101a80 0x7fcb4c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.954+0000 7fcb5302a640 1 --2- 172.21.15.70:0/754600982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb4c1078b0 0x7fcb4c107c90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.954+0000 7fcb5302a640 1 -- 172.21.15.70:0/754600982 >> 172.21.15.70:0/754600982 conn(0x7fcb4c078620 msgr2=0x7fcb4c078a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.954+0000 7fcb5302a640 1 -- 172.21.15.70:0/754600982 shutdown_connections 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.954+0000 7fcb5302a640 1 -- 172.21.15.70:0/754600982 wait complete. 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb5302a640 1 Processor -- start 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb5302a640 1 -- start start 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb5302a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4c101a80 0x7fcb4c199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb5302a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb4c102420 0x7fcb4c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb5302a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb4c1078b0 0x7fcb4c1a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb5302a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c111bc0 con 0x7fcb4c102420 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb5302a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c111a40 con 0x7fcb4c101a80 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb5302a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c111d40 con 0x7fcb4c1078b0 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb4bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb4c102420 0x7fcb4c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb4bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb4c102420 0x7fcb4c19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44042/0 (socket says 172.21.15.70:44042) 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb4bfff640 1 -- 172.21.15.70:0/2813051724 learned_addr learned my addr 172.21.15.70:0/2813051724 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.955+0000 7fcb515c7640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb4c1078b0 0x7fcb4c1a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb50dc6640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4c101a80 0x7fcb4c199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb4bfff640 1 -- 172.21.15.70:0/2813051724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb4c1078b0 msgr2=0x7fcb4c1a5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb4bfff640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb4c1078b0 0x7fcb4c1a5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb4bfff640 1 -- 172.21.15.70:0/2813051724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4c101a80 msgr2=0x7fcb4c199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb4bfff640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4c101a80 0x7fcb4c199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb4bfff640 1 -- 172.21.15.70:0/2813051724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c1a55a0 con 0x7fcb4c102420 2024-04-26T20:37:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb4bfff640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb4c102420 0x7fcb4c19a520 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800c920 tx=0x7fcb3800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb49ffb640 1 -- 172.21.15.70:0/2813051724 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38007c70 con 0x7fcb4c102420 2024-04-26T20:37:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb49ffb640 1 -- 172.21.15.70:0/2813051724 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcb38007e10 con 0x7fcb4c102420 2024-04-26T20:37:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb5302a640 1 -- 172.21.15.70:0/2813051724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c1a5770 con 0x7fcb4c102420 2024-04-26T20:37:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb49ffb640 1 -- 172.21.15.70:0/2813051724 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb380188c0 con 0x7fcb4c102420 2024-04-26T20:37:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.956+0000 7fcb5302a640 1 -- 172.21.15.70:0/2813051724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c1a5c30 con 0x7fcb4c102420 2024-04-26T20:37:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.957+0000 7fcb5302a640 1 -- 172.21.15.70:0/2813051724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4c0697e0 con 0x7fcb4c102420 2024-04-26T20:37:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.958+0000 7fcb49ffb640 1 -- 172.21.15.70:0/2813051724 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fcb38018a60 con 0x7fcb4c102420 2024-04-26T20:37:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.959+0000 7fcb49ffb640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fcb3c0a3d20 0x7fcb3c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.959+0000 7fcb50dc6640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fcb3c0a3d20 0x7fcb3c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.959+0000 7fcb49ffb640 1 -- 172.21.15.70:0/2813051724 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7fcb380d09a0 con 0x7fcb4c102420 2024-04-26T20:37:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.959+0000 7fcb50dc6640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fcb3c0a3d20 0x7fcb3c0a61e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcb400096c0 tx=0x7fcb40000bc0 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:21.963+0000 7fcb49ffb640 1 -- 172.21.15.70:0/2813051724 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fcb38014030 con 0x7fcb4c102420 2024-04-26T20:37:22.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.144+0000 7fcb5302a640 1 -- 172.21.15.70:0/2813051724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb4c109cf0 con 0x7fcb4c102420 2024-04-26T20:37:22.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.146+0000 7fcb49ffb640 1 -- 172.21.15.70:0/2813051724 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+23173 (secure 0 0 0) 0x7fcb3809cff0 con 0x7fcb4c102420 2024-04-26T20:37:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:37:22.147 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":97,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:37:18.134943+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":6}]},{"pgid":"2.16","mappings":[{"from":2,"to":4},{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3045016659":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/1870744030":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/828657527":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:6800/828657527":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1996137110":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/3579803061":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/358585512":"2024-04-27T20:27:18.831654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:37:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 -- 172.21.15.70:0/2813051724 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fcb3c0a3d20 msgr2=0x7fcb3c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fcb3c0a3d20 0x7fcb3c0a61e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcb400096c0 tx=0x7fcb40000bc0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 -- 172.21.15.70:0/2813051724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb4c102420 msgr2=0x7fcb4c19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb4c102420 0x7fcb4c19a520 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800c920 tx=0x7fcb3800cde0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 -- 172.21.15.70:0/2813051724 shutdown_connections 2024-04-26T20:37:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fcb3c0a3d20 0x7fcb3c0a61e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb4c1078b0 0x7fcb4c1a5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb4c102420 0x7fcb4c19a520 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 --2- 172.21.15.70:0/2813051724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4c101a80 0x7fcb4c199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 -- 172.21.15.70:0/2813051724 >> 172.21.15.70:0/2813051724 conn(0x7fcb4c078620 msgr2=0x7fcb4c100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 -- 172.21.15.70:0/2813051724 shutdown_connections 2024-04-26T20:37:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.148+0000 7fcb5302a640 1 -- 172.21.15.70:0/2813051724 wait complete. 2024-04-26T20:37:22.160 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:20:33.781367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:25:13.606603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:25:14.309945+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 96, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:37:22.161 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:37:22.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.260+0000 7f3fbbc59640 1 -- 172.21.15.70:0/33971150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb410cee0 msgr2=0x7f3fb410f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.260+0000 7f3fbbc59640 1 --2- 172.21.15.70:0/33971150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb410cee0 0x7f3fb410f380 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009900 tx=0x7f3fac02a480 comp rx=0 tx=0).stop 2024-04-26T20:37:22.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 -- 172.21.15.70:0/33971150 shutdown_connections 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 --2- 172.21.15.70:0/33971150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb410cee0 0x7f3fb410f380 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 --2- 172.21.15.70:0/33971150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb41044c0 0x7f3fb410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 --2- 172.21.15.70:0/33971150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fb4103ba0 0x7f3fb4103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 -- 172.21.15.70:0/33971150 >> 172.21.15.70:0/33971150 conn(0x7f3fb40789e0 msgr2=0x7f3fb4078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 -- 172.21.15.70:0/33971150 shutdown_connections 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 -- 172.21.15.70:0/33971150 wait complete. 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 Processor -- start 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 -- start start 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb4103ba0 0x7f3fb41991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fb41044c0 0x7f3fb41996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb410cee0 0x7f3fb419da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4112cb0 con 0x7f3fb4103ba0 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4112b30 con 0x7f3fb410cee0 2024-04-26T20:37:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fbbc59640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4112e30 con 0x7f3fb41044c0 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.261+0000 7f3fb99f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb4103ba0 0x7f3fb41991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3fb99f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb4103ba0 0x7f3fb41991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44068/0 (socket says 172.21.15.70:44068) 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3fb99f5640 1 -- 172.21.15.70:0/397354444 learned_addr learned my addr 172.21.15.70:0/397354444 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3fba1f6640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb410cee0 0x7f3fb419da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3fb99f5640 1 -- 172.21.15.70:0/397354444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fb41044c0 msgr2=0x7f3fb41996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3fb99f5640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fb41044c0 0x7f3fb41996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3fb99f5640 1 -- 172.21.15.70:0/397354444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb410cee0 msgr2=0x7f3fb419da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3fb99f5640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb410cee0 0x7f3fb419da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3fb99f5640 1 -- 172.21.15.70:0/397354444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb419e150 con 0x7f3fb4103ba0 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3fb99f5640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb4103ba0 0x7f3fb41991b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000eb90 tx=0x7f3fb000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3faaffd640 1 -- 172.21.15.70:0/397354444 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0004d20 con 0x7f3fb4103ba0 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3fbbc59640 1 -- 172.21.15.70:0/397354444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb419e440 con 0x7f3fb4103ba0 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3faaffd640 1 -- 172.21.15.70:0/397354444 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3fb000ee90 con 0x7f3fb4103ba0 2024-04-26T20:37:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3faaffd640 1 -- 172.21.15.70:0/397354444 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0010720 con 0x7f3fb4103ba0 2024-04-26T20:37:22.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.262+0000 7f3fbbc59640 1 -- 172.21.15.70:0/397354444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb41a5cd0 con 0x7f3fb4103ba0 2024-04-26T20:37:22.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.263+0000 7f3fbbc59640 1 -- 172.21.15.70:0/397354444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb40697e0 con 0x7f3fb4103ba0 2024-04-26T20:37:22.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.264+0000 7f3faaffd640 1 -- 172.21.15.70:0/397354444 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f3fb0005580 con 0x7f3fb4103ba0 2024-04-26T20:37:22.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.265+0000 7f3faaffd640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f3fa00a3d20 0x7f3fa00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.265+0000 7f3fb91f4640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f3fa00a3d20 0x7f3fa00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:22.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.265+0000 7f3faaffd640 1 -- 172.21.15.70:0/397354444 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7f3fb00d1120 con 0x7f3fb4103ba0 2024-04-26T20:37:22.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.265+0000 7f3fb91f4640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f3fa00a3d20 0x7f3fa00a61e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4005fd0 tx=0x7f3fa4005f40 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:22.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.268+0000 7f3faaffd640 1 -- 172.21.15.70:0/397354444 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f3fb0054060 con 0x7f3fb4103ba0 2024-04-26T20:37:22.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.446+0000 7f3fbbc59640 1 -- 172.21.15.70:0/397354444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3fb419a4b0 con 0x7f3fb4103ba0 2024-04-26T20:37:22.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.446+0000 7f3faaffd640 1 -- 172.21.15.70:0/397354444 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) ==== 93+0+10 (secure 0 0 0) 0x7f3fb009d810 con 0x7f3fb4103ba0 2024-04-26T20:37:22.447 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-04-26T20:37:22.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.448+0000 7f3fbbc59640 1 -- 172.21.15.70:0/397354444 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f3fa00a3d20 msgr2=0x7f3fa00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.448+0000 7f3fbbc59640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f3fa00a3d20 0x7f3fa00a61e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4005fd0 tx=0x7f3fa4005f40 comp rx=0 tx=0).stop 2024-04-26T20:37:22.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.448+0000 7f3fbbc59640 1 -- 172.21.15.70:0/397354444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb4103ba0 msgr2=0x7f3fb41991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.448+0000 7f3fbbc59640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb4103ba0 0x7f3fb41991b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000eb90 tx=0x7f3fb000c6a0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.448+0000 7f3fbbc59640 1 -- 172.21.15.70:0/397354444 shutdown_connections 2024-04-26T20:37:22.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.448+0000 7f3fbbc59640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f3fa00a3d20 0x7f3fa00a61e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.448+0000 7f3fbbc59640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3fb410cee0 0x7f3fb419da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.448+0000 7f3fbbc59640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fb41044c0 0x7f3fb41996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.448+0000 7f3fbbc59640 1 --2- 172.21.15.70:0/397354444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fb4103ba0 0x7f3fb41991b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.448+0000 7f3fbbc59640 1 -- 172.21.15.70:0/397354444 >> 172.21.15.70:0/397354444 conn(0x7f3fb40789e0 msgr2=0x7f3fb40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:22.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.449+0000 7f3fbbc59640 1 -- 172.21.15.70:0/397354444 shutdown_connections 2024-04-26T20:37:22.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.449+0000 7f3fbbc59640 1 -- 172.21.15.70:0/397354444 wait complete. 2024-04-26T20:37:22.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:37:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.559+0000 7fb6eb2da640 1 -- 172.21.15.70:0/3051214803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e41022b0 msgr2=0x7fb6e4106770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.559+0000 7fb6eb2da640 1 --2- 172.21.15.70:0/3051214803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e41022b0 0x7fb6e4106770 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009900 tx=0x7fb6d402a510 comp rx=0 tx=0).stop 2024-04-26T20:37:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.559+0000 7fb6eb2da640 1 -- 172.21.15.70:0/3051214803 shutdown_connections 2024-04-26T20:37:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.559+0000 7fb6eb2da640 1 --2- 172.21.15.70:0/3051214803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6e4106cb0 0x7fb6e4107140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.559+0000 7fb6eb2da640 1 --2- 172.21.15.70:0/3051214803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e41022b0 0x7fb6e4106770 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.559+0000 7fb6eb2da640 1 --2- 172.21.15.70:0/3051214803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6e4101990 0x7fb6e4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.559+0000 7fb6eb2da640 1 -- 172.21.15.70:0/3051214803 >> 172.21.15.70:0/3051214803 conn(0x7fb6e4078950 msgr2=0x7fb6e4078d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:22.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.559+0000 7fb6eb2da640 1 -- 172.21.15.70:0/3051214803 shutdown_connections 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6eb2da640 1 -- 172.21.15.70:0/3051214803 wait complete. 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6eb2da640 1 Processor -- start 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6eb2da640 1 -- start start 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6eb2da640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6e4101990 0x7fb6e41a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6eb2da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e41022b0 0x7fb6e41a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6eb2da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6e4106cb0 0x7fb6e419f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6eb2da640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e41192b0 con 0x7fb6e41022b0 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6eb2da640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e4119130 con 0x7fb6e4101990 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6eb2da640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e4119430 con 0x7fb6e4106cb0 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6e8875640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e41022b0 0x7fb6e41a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6e8875640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e41022b0 0x7fb6e41a5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44090/0 (socket says 172.21.15.70:44090) 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.560+0000 7fb6e8875640 1 -- 172.21.15.70:0/2758761754 learned_addr learned my addr 172.21.15.70:0/2758761754 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:37:22.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6e9076640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6e4101990 0x7fb6e41a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6e9877640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6e4106cb0 0x7fb6e419f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6e8875640 1 -- 172.21.15.70:0/2758761754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6e4106cb0 msgr2=0x7fb6e419f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6e8875640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6e4106cb0 0x7fb6e419f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6e8875640 1 -- 172.21.15.70:0/2758761754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6e4101990 msgr2=0x7fb6e41a5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6e8875640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6e4101990 0x7fb6e41a5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6e8875640 1 -- 172.21.15.70:0/2758761754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e419ff10 con 0x7fb6e41022b0 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6e9877640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6e4106cb0 0x7fb6e419f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6e8875640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e41022b0 0x7fb6e41a5ad0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4005ab0 tx=0x7fb6d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6da7fc640 1 -- 172.21.15.70:0/2758761754 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d403f030 con 0x7fb6e41022b0 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6da7fc640 1 -- 172.21.15.70:0/2758761754 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb6d4003cd0 con 0x7fb6e41022b0 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6eb2da640 1 -- 172.21.15.70:0/2758761754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e41a01a0 con 0x7fb6e41022b0 2024-04-26T20:37:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6da7fc640 1 -- 172.21.15.70:0/2758761754 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4035070 con 0x7fb6e41022b0 2024-04-26T20:37:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.561+0000 7fb6eb2da640 1 -- 172.21.15.70:0/2758761754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e41ac510 con 0x7fb6e41022b0 2024-04-26T20:37:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.562+0000 7fb6eb2da640 1 -- 172.21.15.70:0/2758761754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e406a850 con 0x7fb6e41022b0 2024-04-26T20:37:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.563+0000 7fb6da7fc640 1 -- 172.21.15.70:0/2758761754 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fb6d4042030 con 0x7fb6e41022b0 2024-04-26T20:37:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.563+0000 7fb6da7fc640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fb6d00a3da0 0x7fb6d00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.564+0000 7fb6e9076640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fb6d00a3da0 0x7fb6d00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.564+0000 7fb6da7fc640 1 -- 172.21.15.70:0/2758761754 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7fb6d40f1050 con 0x7fb6e41022b0 2024-04-26T20:37:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.564+0000 7fb6e9076640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fb6d00a3da0 0x7fb6d00a6260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0005fd0 tx=0x7fb6e0005e20 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.568+0000 7fb6da7fc640 1 -- 172.21.15.70:0/2758761754 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb6d40bd6a0 con 0x7fb6e41022b0 2024-04-26T20:37:22.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.746+0000 7fb6eb2da640 1 -- 172.21.15.70:0/2758761754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb6e4069c30 con 0x7fb6e41022b0 2024-04-26T20:37:22.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.749+0000 7fb6da7fc640 1 -- 172.21.15.70:0/2758761754 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) ==== 104+0+11 (secure 0 0 0) 0x7fb6d40bcfa0 con 0x7fb6e41022b0 2024-04-26T20:37:22.750 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 -- 172.21.15.70:0/2758761754 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fb6d00a3da0 msgr2=0x7fb6d00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fb6d00a3da0 0x7fb6d00a6260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0005fd0 tx=0x7fb6e0005e20 comp rx=0 tx=0).stop 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 -- 172.21.15.70:0/2758761754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e41022b0 msgr2=0x7fb6e41a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e41022b0 0x7fb6e41a5ad0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4005ab0 tx=0x7fb6d40042f0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 -- 172.21.15.70:0/2758761754 shutdown_connections 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fb6d00a3da0 0x7fb6d00a6260 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6e4106cb0 0x7fb6e419f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e41022b0 0x7fb6e41a5ad0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 --2- 172.21.15.70:0/2758761754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6e4101990 0x7fb6e41a5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 -- 172.21.15.70:0/2758761754 >> 172.21.15.70:0/2758761754 conn(0x7fb6e4078950 msgr2=0x7fb6e4104740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 -- 172.21.15.70:0/2758761754 shutdown_connections 2024-04-26T20:37:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.751+0000 7fb6eb2da640 1 -- 172.21.15.70:0/2758761754 wait complete. 2024-04-26T20:37:22.762 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:37:22.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.861+0000 7ffa6a551640 1 -- 172.21.15.70:0/95821850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa64107810 msgr2=0x7ffa64107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.861+0000 7ffa6a551640 1 --2- 172.21.15.70:0/95821850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa64107810 0x7ffa64107bf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009930 tx=0x7ffa5402a420 comp rx=0 tx=0).stop 2024-04-26T20:37:22.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.861+0000 7ffa6a551640 1 -- 172.21.15.70:0/95821850 shutdown_connections 2024-04-26T20:37:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.861+0000 7ffa6a551640 1 --2- 172.21.15.70:0/95821850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa641021c0 0x7ffa6410e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.861+0000 7ffa6a551640 1 --2- 172.21.15.70:0/95821850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64101800 0x7ffa64101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.861+0000 7ffa6a551640 1 --2- 172.21.15.70:0/95821850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa64107810 0x7ffa64107bf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.861+0000 7ffa6a551640 1 -- 172.21.15.70:0/95821850 >> 172.21.15.70:0/95821850 conn(0x7ffa640789e0 msgr2=0x7ffa64078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.862+0000 7ffa6a551640 1 -- 172.21.15.70:0/95821850 shutdown_connections 2024-04-26T20:37:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.862+0000 7ffa6a551640 1 -- 172.21.15.70:0/95821850 wait complete. 2024-04-26T20:37:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.862+0000 7ffa6a551640 1 Processor -- start 2024-04-26T20:37:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.862+0000 7ffa6a551640 1 -- start start 2024-04-26T20:37:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.862+0000 7ffa6a551640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64101800 0x7ffa641992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.862+0000 7ffa6a551640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa641021c0 0x7ffa641997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.862+0000 7ffa6a551640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa64107810 0x7ffa6419db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.862+0000 7ffa6a551640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64111c10 con 0x7ffa641021c0 2024-04-26T20:37:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.862+0000 7ffa6a551640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64111a90 con 0x7ffa64101800 2024-04-26T20:37:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.862+0000 7ffa6a551640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64111d90 con 0x7ffa64107810 2024-04-26T20:37:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa637fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa641021c0 0x7ffa641997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa637fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa641021c0 0x7ffa641997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44106/0 (socket says 172.21.15.70:44106) 2024-04-26T20:37:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa637fe640 1 -- 172.21.15.70:0/615298997 learned_addr learned my addr 172.21.15.70:0/615298997 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:37:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa63fff640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64101800 0x7ffa641992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa68aee640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa64107810 0x7ffa6419db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa637fe640 1 -- 172.21.15.70:0/615298997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa64107810 msgr2=0x7ffa6419db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa637fe640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa64107810 0x7ffa6419db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa637fe640 1 -- 172.21.15.70:0/615298997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64101800 msgr2=0x7ffa641992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa637fe640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64101800 0x7ffa641992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa637fe640 1 -- 172.21.15.70:0/615298997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6419e240 con 0x7ffa641021c0 2024-04-26T20:37:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa637fe640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa641021c0 0x7ffa641997e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800d950 tx=0x7ffa5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa617fa640 1 -- 172.21.15.70:0/615298997 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58017070 con 0x7ffa641021c0 2024-04-26T20:37:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa6a551640 1 -- 172.21.15.70:0/615298997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6419e530 con 0x7ffa641021c0 2024-04-26T20:37:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa617fa640 1 -- 172.21.15.70:0/615298997 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffa58009c30 con 0x7ffa641021c0 2024-04-26T20:37:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa617fa640 1 -- 172.21.15.70:0/615298997 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800f6b0 con 0x7ffa641021c0 2024-04-26T20:37:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.863+0000 7ffa6a551640 1 -- 172.21.15.70:0/615298997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa641a5dc0 con 0x7ffa641021c0 2024-04-26T20:37:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.864+0000 7ffa6a551640 1 -- 172.21.15.70:0/615298997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa640697e0 con 0x7ffa641021c0 2024-04-26T20:37:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.865+0000 7ffa617fa640 1 -- 172.21.15.70:0/615298997 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7ffa580109c0 con 0x7ffa641021c0 2024-04-26T20:37:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.866+0000 7ffa617fa640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ffa4c0a3d20 0x7ffa4c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.866+0000 7ffa63fff640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ffa4c0a3d20 0x7ffa4c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.866+0000 7ffa617fa640 1 -- 172.21.15.70:0/615298997 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7ffa580d04f0 con 0x7ffa641021c0 2024-04-26T20:37:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.866+0000 7ffa63fff640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ffa4c0a3d20 0x7ffa4c0a61e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa54000c00 tx=0x7ffa54005a20 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:22.871+0000 7ffa617fa640 1 -- 172.21.15.70:0/615298997 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ffa58009de0 con 0x7ffa641021c0 2024-04-26T20:37:23.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:22 smithi070 ceph-mon[29124]: pgmap v312: 97 pgs: 97 active+clean; 140 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:22 smithi070 ceph-mon[29124]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:37:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:22 smithi070 ceph-mon[29124]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:37:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:22 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2813051724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:37:23.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:22 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/397354444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:37:23.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.049+0000 7ffa6a551640 1 -- 172.21.15.70:0/615298997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffa6410ade0 con 0x7ffa641021c0 2024-04-26T20:37:23.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.050+0000 7ffa617fa640 1 -- 172.21.15.70:0/615298997 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) ==== 100+0+11 (secure 0 0 0) 0x7ffa5809cb40 con 0x7ffa641021c0 2024-04-26T20:37:23.051 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-04-26T20:37:23.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 -- 172.21.15.70:0/615298997 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ffa4c0a3d20 msgr2=0x7ffa4c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:23.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ffa4c0a3d20 0x7ffa4c0a61e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa54000c00 tx=0x7ffa54005a20 comp rx=0 tx=0).stop 2024-04-26T20:37:23.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 -- 172.21.15.70:0/615298997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa641021c0 msgr2=0x7ffa641997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:23.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa641021c0 0x7ffa641997e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800d950 tx=0x7ffa5800de10 comp rx=0 tx=0).stop 2024-04-26T20:37:23.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 -- 172.21.15.70:0/615298997 shutdown_connections 2024-04-26T20:37:23.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ffa4c0a3d20 0x7ffa4c0a61e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:23.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa64107810 0x7ffa6419db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:23.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa641021c0 0x7ffa641997e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:23.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 --2- 172.21.15.70:0/615298997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64101800 0x7ffa641992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:23.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 -- 172.21.15.70:0/615298997 >> 172.21.15.70:0/615298997 conn(0x7ffa640789e0 msgr2=0x7ffa6406a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:23.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 -- 172.21.15.70:0/615298997 shutdown_connections 2024-04-26T20:37:23.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.052+0000 7ffa6a551640 1 -- 172.21.15.70:0/615298997 wait complete. 2024-04-26T20:37:23.064 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-26T20:37:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.161+0000 7f3836bc8640 1 -- 172.21.15.70:0/4027130191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3830069c30 msgr2=0x7f383006a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.161+0000 7f3836bc8640 1 --2- 172.21.15.70:0/4027130191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3830069c30 0x7f383006a090 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3820009ca0 tx=0x7f382002a950 comp rx=0 tx=0).stop 2024-04-26T20:37:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.161+0000 7f3836bc8640 1 -- 172.21.15.70:0/4027130191 shutdown_connections 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.161+0000 7f3836bc8640 1 --2- 172.21.15.70:0/4027130191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f383006a5d0 0x7f383010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.161+0000 7f3836bc8640 1 --2- 172.21.15.70:0/4027130191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3830069c30 0x7f383006a090 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.161+0000 7f3836bc8640 1 --2- 172.21.15.70:0/4027130191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3830108a00 0x7f3830108de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.161+0000 7f3836bc8640 1 -- 172.21.15.70:0/4027130191 >> 172.21.15.70:0/4027130191 conn(0x7f3830078620 msgr2=0x7f3830078a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.161+0000 7f3836bc8640 1 -- 172.21.15.70:0/4027130191 shutdown_connections 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.161+0000 7f3836bc8640 1 -- 172.21.15.70:0/4027130191 wait complete. 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.162+0000 7f3836bc8640 1 Processor -- start 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.162+0000 7f3836bc8640 1 -- start start 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.162+0000 7f3836bc8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3830069c30 0x7f38301991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.162+0000 7f3836bc8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f383006a5d0 0x7f38301996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.162+0000 7f3836bc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3830108a00 0x7f383019da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.162+0000 7f3836bc8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3830112d30 con 0x7f3830069c30 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.162+0000 7f3836bc8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3830112bb0 con 0x7f3830108a00 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.162+0000 7f3836bc8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3830112eb0 con 0x7f383006a5d0 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.162+0000 7f3834964640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3830069c30 0x7f38301991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.162+0000 7f3834964640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3830069c30 0x7f38301991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44126/0 (socket says 172.21.15.70:44126) 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.162+0000 7f3834964640 1 -- 172.21.15.70:0/3011234958 learned_addr learned my addr 172.21.15.70:0/3011234958 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.163+0000 7f3834964640 1 -- 172.21.15.70:0/3011234958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f383006a5d0 msgr2=0x7f38301996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.163+0000 7f3834964640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f383006a5d0 0x7f38301996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.163+0000 7f3834964640 1 -- 172.21.15.70:0/3011234958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3830108a00 msgr2=0x7f383019da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.163+0000 7f3834964640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3830108a00 0x7f383019da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.163+0000 7f3834964640 1 -- 172.21.15.70:0/3011234958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383019e1a0 con 0x7f3830069c30 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.163+0000 7f3834964640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3830069c30 0x7f38301991b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f381800d950 tx=0x7f381800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.163+0000 7f382dffb640 1 -- 172.21.15.70:0/3011234958 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3818017070 con 0x7f3830069c30 2024-04-26T20:37:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.163+0000 7f382dffb640 1 -- 172.21.15.70:0/3011234958 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3818009c30 con 0x7f3830069c30 2024-04-26T20:37:23.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.163+0000 7f3836bc8640 1 -- 172.21.15.70:0/3011234958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383019e490 con 0x7f3830069c30 2024-04-26T20:37:23.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.163+0000 7f382dffb640 1 -- 172.21.15.70:0/3011234958 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381800f6b0 con 0x7f3830069c30 2024-04-26T20:37:23.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.163+0000 7f3836bc8640 1 -- 172.21.15.70:0/3011234958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38301a5d20 con 0x7f3830069c30 2024-04-26T20:37:23.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.164+0000 7f3836bc8640 1 -- 172.21.15.70:0/3011234958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38300697e0 con 0x7f3830069c30 2024-04-26T20:37:23.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.165+0000 7f382dffb640 1 -- 172.21.15.70:0/3011234958 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f38180109c0 con 0x7f3830069c30 2024-04-26T20:37:23.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.165+0000 7f382dffb640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f381c0a3d20 0x7f381c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:23.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.166+0000 7f382ffff640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f381c0a3d20 0x7f381c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:23.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.166+0000 7f382dffb640 1 -- 172.21.15.70:0/3011234958 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7f38180d04f0 con 0x7f3830069c30 2024-04-26T20:37:23.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.166+0000 7f382ffff640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f381c0a3d20 0x7f381c0a61e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3820030040 tx=0x7f3820005ef0 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:23.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.170+0000 7f382dffb640 1 -- 172.21.15.70:0/3011234958 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f3818009de0 con 0x7f3830069c30 2024-04-26T20:37:23.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:22 smithi098 ceph-mon[32591]: pgmap v312: 97 pgs: 97 active+clean; 140 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:23.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:22 smithi098 ceph-mon[32591]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:37:23.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:22 smithi098 ceph-mon[32591]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:37:23.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:22 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2813051724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:37:23.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:22 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/397354444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:37:23.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:22 smithi080 ceph-mon[32278]: pgmap v312: 97 pgs: 97 active+clean; 140 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:22 smithi080 ceph-mon[32278]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:37:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:22 smithi080 ceph-mon[32278]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:37:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:22 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2813051724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:37:23.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:22 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/397354444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:37:23.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.399+0000 7f3836bc8640 1 -- 172.21.15.70:0/3011234958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f383010a880 con 0x7f3830069c30 2024-04-26T20:37:23.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.407+0000 7f382dffb640 1 -- 172.21.15.70:0/3011234958 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+746058 (secure 0 0 0) 0x7f381809cb40 con 0x7f3830069c30 2024-04-26T20:37:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:37:23.418 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 25, 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "active_gid": 15333, 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "active_name": "x", 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addrs": { 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 212113189 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 212113189 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addr": "172.21.15.70:6801/212113189", 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "active_change": "2024-04-26T20:27:18.831866+0000", 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "active_mgr_features": 4540701547738038271, 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "available": true, 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "standbys": [ 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24841, 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "z", 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540701547738038271, 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-04-26T20:37:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-04-26T20:37:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-04-26T20:37:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-04-26T20:37:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-04-26T20:37:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-04-26T20:37:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-26T20:37:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-26T20:37:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-04-26T20:37:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-26T20:37:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-26T20:37:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-04-26T20:37:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-04-26T20:37:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-26T20:37:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-26T20:37:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-04-26T20:37:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-04-26T20:37:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-04-26T20:37:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-26T20:37:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-04-26T20:37:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-04-26T20:37:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-04-26T20:37:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-04-26T20:37:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-26T20:37:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-04-26T20:37:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-04-26T20:37:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-26T20:37:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-04-26T20:37:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-26T20:37:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-26T20:37:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-26T20:37:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-26T20:37:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-04-26T20:37:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-04-26T20:37:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-04-26T20:37:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-04-26T20:37:23.516 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.517 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.518 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.520 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.521 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-04-26T20:37:23.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-04-26T20:37:23.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.522 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.522 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.522 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.522 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.522 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.522 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-26T20:37:23.522 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.527 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.528 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-04-26T20:37:23.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-04-26T20:37:23.530 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.531 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-04-26T20:37:23.532 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-26T20:37:23.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.534 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.536 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.537 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.538 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.539 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.540 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.541 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.541 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-26T20:37:23.541 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-26T20:37:23.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.541 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.541 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.541 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.541 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.541 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.546 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.547 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.548 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.549 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.550 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.551 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.552 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.553 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "[]", 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.554 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: "MULTICLUSTER_CONFIG": { 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.555 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "{}", 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.556 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-26T20:37:23.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-26T20:37:23.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.560 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.561 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.563 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.564 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-26T20:37:23.567 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.570 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.571 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.572 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.572 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.572 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-26T20:37:23.572 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-26T20:37:23.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.572 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.572 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-04-26T20:37:23.572 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.574 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.576 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.577 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-26T20:37:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-26T20:37:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.579 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.580 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-04-26T20:37:23.581 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-04-26T20:37:23.582 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.583 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.585 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.586 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.587 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.588 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.589 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.590 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.591 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.592 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.594 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.596 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-04-26T20:37:23.596 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.596 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.596 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.596 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.596 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.596 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.596 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.597 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.602 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.603 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.604 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.607 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.608 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.609 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-26T20:37:23.610 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-26T20:37:23.611 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.612 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.615 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.616 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.617 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.619 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.623 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.624 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.625 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:23.626 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.627 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-04-26T20:37:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-04-26T20:37:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-04-26T20:37:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-26T20:37:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-04-26T20:37:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-04-26T20:37:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-04-26T20:37:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-04-26T20:37:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-04-26T20:37:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-04-26T20:37:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-04-26T20:37:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-04-26T20:37:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-04-26T20:37:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-04-26T20:37:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-04-26T20:37:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-04-26T20:37:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-04-26T20:37:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-04-26T20:37:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-26T20:37:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-26T20:37:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-04-26T20:37:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-04-26T20:37:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.734 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-04-26T20:37:23.735 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-04-26T20:37:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-04-26T20:37:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-04-26T20:37:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.760 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.769 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.771 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.772 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.773 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.775 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.776 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.778 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.779 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.782 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.784 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.789 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.789 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.789 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-04-26T20:37:23.789 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-04-26T20:37:23.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.789 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.789 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.789 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.791 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.792 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-04-26T20:37:23.792 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-04-26T20:37:23.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.792 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.792 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.792 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.792 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.792 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.792 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.794 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.795 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.797 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.797 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.797 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.797 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.797 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.797 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.797 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.797 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.798 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.799 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.802 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.802 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.802 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.802 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.802 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.802 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.802 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.802 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.805 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.806 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.807 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.808 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.810 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:23.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.813 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.814 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.815 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.818 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.819 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.822 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.824 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-04-26T20:37:23.825 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-04-26T20:37:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-26T20:37:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.828 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.829 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.830 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.831 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.832 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.835 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.838 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.840 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.842 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.843 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.844 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.845 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.846 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.847 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.848 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.849 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.850 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.851 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.852 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.853 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-04-26T20:37:23.856 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:23.857 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.858 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.859 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.860 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.861 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.862 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-04-26T20:37:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.865 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-04-26T20:37:23.865 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-04-26T20:37:23.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.865 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.865 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.865 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-04-26T20:37:23.865 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.865 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.865 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.865 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.866 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24881, 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "y", 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540701547738038271, 2024-04-26T20:37:23.867 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:23.868 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.869 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.870 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.872 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.873 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.874 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.875 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.876 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.877 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.878 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.879 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.880 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.881 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.882 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.885 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.886 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-26T20:37:23.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.888 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.889 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:37:23.890 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.891 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.892 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.893 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.894 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.895 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.896 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.897 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.898 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-26T20:37:23.899 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-26T20:37:23.900 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.902 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:23.903 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.905 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.906 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.907 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.908 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.909 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-04-26T20:37:23.910 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-04-26T20:37:23.911 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.912 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-04-26T20:37:23.913 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-04-26T20:37:23.913 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.913 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.913 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.913 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.913 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.913 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.913 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.913 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-26T20:37:23.913 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.913 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.914 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.915 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-04-26T20:37:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-04-26T20:37:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-04-26T20:37:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-04-26T20:37:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-04-26T20:37:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-04-26T20:37:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-04-26T20:37:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-26T20:37:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-26T20:37:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-04-26T20:37:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-04-26T20:37:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-26T20:37:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-04-26T20:37:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-04-26T20:37:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-04-26T20:37:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-04-26T20:37:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-04-26T20:37:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-04-26T20:37:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-26T20:37:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-04-26T20:37:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-26T20:37:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-26T20:37:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-26T20:37:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-26T20:37:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "[]", 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "MULTICLUSTER_CONFIG": { 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "{}", 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-26T20:37:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-26T20:37:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.021 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.022 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.022 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.022 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.022 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.022 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-04-26T20:37:24.022 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-26T20:37:24.022 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.022 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.022 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.022 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.023 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:24.024 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.025 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.029 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-04-26T20:37:24.030 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.031 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.031 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.031 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.031 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.031 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.031 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.031 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-04-26T20:37:24.031 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-04-26T20:37:24.031 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.031 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.033 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.034 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.035 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.037 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.038 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-04-26T20:37:24.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-04-26T20:37:24.040 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-04-26T20:37:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-04-26T20:37:24.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-04-26T20:37:24.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-04-26T20:37:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-04-26T20:37:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-04-26T20:37:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-26T20:37:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-04-26T20:37:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-04-26T20:37:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-04-26T20:37:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-04-26T20:37:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-04-26T20:37:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-04-26T20:37:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-04-26T20:37:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-26T20:37:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-04-26T20:37:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-04-26T20:37:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-04-26T20:37:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-04-26T20:37:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-04-26T20:37:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-04-26T20:37:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-04-26T20:37:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-04-26T20:37:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-04-26T20:37:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-04-26T20:37:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-04-26T20:37:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-04-26T20:37:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-26T20:37:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-04-26T20:37:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-04-26T20:37:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-04-26T20:37:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-04-26T20:37:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-04-26T20:37:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-04-26T20:37:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-04-26T20:37:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-26T20:37:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-04-26T20:37:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-04-26T20:37:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-04-26T20:37:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-04-26T20:37:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-04-26T20:37:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-04-26T20:37:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-26T20:37:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "modules": [ 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard", 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "iostat", 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "nfs", 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "restful", 2024-04-26T20:37:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_schedule" 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.316 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.318 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.319 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.320 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-04-26T20:37:24.321 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.324 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.325 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.327 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.328 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.329 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.330 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.331 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-04-26T20:37:24.332 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-04-26T20:37:24.333 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.334 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.336 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.337 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.338 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.339 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.339 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.339 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.339 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.339 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.339 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.339 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-04-26T20:37:24.339 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-04-26T20:37:24.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-04-26T20:37:24.341 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.342 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.343 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.344 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.345 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.346 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-04-26T20:37:24.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-04-26T20:37:24.348 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.349 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.351 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.352 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.353 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.354 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.355 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-04-26T20:37:24.358 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.359 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.360 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.361 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.362 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-04-26T20:37:24.362 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.362 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.362 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.362 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-04-26T20:37:24.362 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-04-26T20:37:24.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.362 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.364 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-26T20:37:24.364 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.364 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.364 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.364 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-04-26T20:37:24.364 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.364 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-04-26T20:37:24.366 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-04-26T20:37:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-04-26T20:37:24.372 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.375 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.376 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.377 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.378 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-26T20:37:24.379 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-04-26T20:37:24.380 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-26T20:37:24.381 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.384 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.385 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.387 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.387 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.387 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.387 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-26T20:37:24.387 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.387 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.387 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.388 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.390 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.390 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.390 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.390 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.390 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.390 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.390 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.392 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-04-26T20:37:24.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.396 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.397 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-26T20:37:24.402 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.404 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-26T20:37:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-04-26T20:37:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-04-26T20:37:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-26T20:37:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-04-26T20:37:24.418 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-04-26T20:37:24.419 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.420 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-26T20:37:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-26T20:37:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "[]", 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "MULTICLUSTER_CONFIG": { 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "{}", 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-26T20:37:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-26T20:37:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-04-26T20:37:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-04-26T20:37:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-26T20:37:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-26T20:37:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-04-26T20:37:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-04-26T20:37:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-04-26T20:37:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-04-26T20:37:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-04-26T20:37:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-04-26T20:37:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-04-26T20:37:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-04-26T20:37:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-26T20:37:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-04-26T20:37:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-04-26T20:37:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-04-26T20:37:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-26T20:37:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-04-26T20:37:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-04-26T20:37:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.536 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.537 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.538 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.539 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.540 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.542 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.543 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.544 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.545 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.546 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.548 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.549 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.550 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-04-26T20:37:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-04-26T20:37:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-04-26T20:37:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-04-26T20:37:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-26T20:37:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-04-26T20:37:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-04-26T20:37:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-04-26T20:37:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-04-26T20:37:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-04-26T20:37:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-04-26T20:37:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-04-26T20:37:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-04-26T20:37:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-04-26T20:37:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.683 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.683 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-04-26T20:37:24.683 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-04-26T20:37:24.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.683 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.683 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.683 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.683 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.683 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.683 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-04-26T20:37:24.684 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.684 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.684 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.684 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-04-26T20:37:24.684 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-04-26T20:37:24.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.684 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.684 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.684 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-04-26T20:37:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-04-26T20:37:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-04-26T20:37:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-04-26T20:37:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-04-26T20:37:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-04-26T20:37:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-26T20:37:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-26T20:37:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-04-26T20:37:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-04-26T20:37:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-26T20:37:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-04-26T20:37:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-04-26T20:37:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-26T20:37:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-04-26T20:37:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-04-26T20:37:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-26T20:37:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-04-26T20:37:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-04-26T20:37:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-04-26T20:37:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-04-26T20:37:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-04-26T20:37:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-04-26T20:37:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-04-26T20:37:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-04-26T20:37:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-04-26T20:37:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-04-26T20:37:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-04-26T20:37:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-04-26T20:37:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-04-26T20:37:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-04-26T20:37:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-04-26T20:37:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.754 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.754 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.754 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.754 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.754 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.754 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.754 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.754 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.755 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-04-26T20:37:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-04-26T20:37:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-04-26T20:37:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-04-26T20:37:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-26T20:37:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-04-26T20:37:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-04-26T20:37:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-04-26T20:37:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-04-26T20:37:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-04-26T20:37:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-04-26T20:37:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-04-26T20:37:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-04-26T20:37:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-04-26T20:37:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-04-26T20:37:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-04-26T20:37:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-04-26T20:37:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-04-26T20:37:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-04-26T20:37:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-04-26T20:37:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-04-26T20:37:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-04-26T20:37:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-04-26T20:37:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-04-26T20:37:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-04-26T20:37:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-04-26T20:37:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-04-26T20:37:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-04-26T20:37:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-04-26T20:37:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-04-26T20:37:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-04-26T20:37:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "services": { 2024-04-26T20:37:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard": "https://172.21.15.70:8443/" 2024-04-26T20:37:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "always_on_modules": { 2024-04-26T20:37:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "octopus": [ 2024-04-26T20:37:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-04-26T20:37:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-04-26T20:37:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-04-26T20:37:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-04-26T20:37:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-04-26T20:37:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "pacific": [ 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-04-26T20:37:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "quincy": [ 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-04-26T20:37:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "reef": [ 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-04-26T20:37:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "squid": [ 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-04-26T20:37:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "last_failure_osd_epoch": 89, 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "active_clients": [ 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-04-26T20:37:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 944411472 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "libcephsqlite", 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 445533793 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:37:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-04-26T20:37:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-04-26T20:37:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-04-26T20:37:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-04-26T20:37:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3921981953 2024-04-26T20:37:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1544014339 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3490015740 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-04-26T20:37:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-04-26T20:37:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2174695136 2024-04-26T20:37:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:37:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T20:37:24.788 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:37:24.789 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:23 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2758761754' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:37:24.789 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:23 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/615298997' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:37:24.789 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:23 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3011234958' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-26T20:37:24.790 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:23 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2758761754' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:37:24.790 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:23 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/615298997' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:37:24.790 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:23 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3011234958' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-26T20:37:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.412+0000 7f3836bc8640 1 -- 172.21.15.70:0/3011234958 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f381c0a3d20 msgr2=0x7f381c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.412+0000 7f3836bc8640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f381c0a3d20 0x7f381c0a61e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3820030040 tx=0x7f3820005ef0 comp rx=0 tx=0).stop 2024-04-26T20:37:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.412+0000 7f3836bc8640 1 -- 172.21.15.70:0/3011234958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3830069c30 msgr2=0x7f38301991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.412+0000 7f3836bc8640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3830069c30 0x7f38301991b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f381800d950 tx=0x7f381800de10 comp rx=0 tx=0).stop 2024-04-26T20:37:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.412+0000 7f3836bc8640 1 -- 172.21.15.70:0/3011234958 shutdown_connections 2024-04-26T20:37:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.412+0000 7f3836bc8640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f381c0a3d20 0x7f381c0a61e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.412+0000 7f3836bc8640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3830108a00 0x7f383019da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.412+0000 7f3836bc8640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f383006a5d0 0x7f38301996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.412+0000 7f3836bc8640 1 --2- 172.21.15.70:0/3011234958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3830069c30 0x7f38301991b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.412+0000 7f3836bc8640 1 -- 172.21.15.70:0/3011234958 >> 172.21.15.70:0/3011234958 conn(0x7f3830078620 msgr2=0x7f38300ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:24.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.413+0000 7f3836bc8640 1 -- 172.21.15.70:0/3011234958 shutdown_connections 2024-04-26T20:37:24.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:23.413+0000 7f3836bc8640 1 -- 172.21.15.70:0/3011234958 wait complete. 2024-04-26T20:37:24.799 DEBUG:tasks.check_counter:Getting stats from a 2024-04-26T20:37:24.799 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-26T20:37:24.800 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:23 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2758761754' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:37:24.800 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:23 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/615298997' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:37:24.800 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:23 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3011234958' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-26T20:37:25.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:24 smithi070 ceph-mon[29124]: pgmap v313: 97 pgs: 97 active+clean; 140 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:37:25.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:24 smithi098 ceph-mon[32591]: pgmap v313: 97 pgs: 97 active+clean; 140 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:25.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:24 smithi080 ceph-mon[32278]: pgmap v313: 97 pgs: 97 active+clean; 140 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T20:37:26.852 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:37:26.852 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:26.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 965, 2024-04-26T20:37:26.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 939, 2024-04-26T20:37:26.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 1821456, 2024-04-26T20:37:26.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 355144, 2024-04-26T20:37:26.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.108522174, 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.036505069, 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.049193725, 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.024628335, 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 938, 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.034419040, 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000036694 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1578192, 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 124912 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 612, 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 762, 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 151032, 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 629040, 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 7, 2024-04-26T20:37:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 5, 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.066012033, 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.023403302, 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.014913357, 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.021453614, 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 759, 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.026803842, 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000035314 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.855 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 434992 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 746, 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 746, 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 3308669, 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 236405, 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.061206200, 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.019524051, 2024-04-26T20:37:26.856 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.018091510, 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.017958258, 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 745, 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.022127926, 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000029701 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 448 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.857 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3450, 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.086601910, 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000025102 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-04-26T20:37:26.858 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 0, 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 0, 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 0, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 0, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 972, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 0, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 972, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 0, 2024-04-26T20:37:26.860 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 972, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 0, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 1, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 0, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 0, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 0, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 0, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 0, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-04-26T20:37:26.861 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:37:26.862 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 0, 2024-04-26T20:37:26.863 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 0 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 0, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 0, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 0, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 0, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-04-26T20:37:26.864 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0 2024-04-26T20:37:26.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 0, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 1289, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 0, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 3, 2024-04-26T20:37:26.866 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 7305856, 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 7304241, 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 1289 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.867 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 299, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 862, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 563, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 38, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 61, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 23, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 972, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 1333, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 361, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 0, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 0, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 54012, 2024-04-26T20:37:26.868 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 215416 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 0, 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 0, 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 0, 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 0, 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 0, 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-04-26T20:37:26.870 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.870 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.870 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.870 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-04-26T20:37:26.870 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.870 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.870 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.870 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-04-26T20:37:26.870 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.871 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.872 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.873 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.873 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-04-26T20:37:26.873 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.873 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.873 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.873 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.874 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-04-26T20:37:26.875 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.876 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-04-26T20:37:26.877 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.878 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.879 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:37:26.880 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 2, 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 5, 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 3, 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 4, 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 0, 2024-04-26T20:37:26.881 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 0, 2024-04-26T20:37:26.882 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 2907, 2024-04-26T20:37:26.882 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-04-26T20:37:26.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.882 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-04-26T20:37:26.882 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:26.882 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:26.882 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:26.882 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:26.882 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:26.882 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:26.882 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:26.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 201544, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 380, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 8360, 2024-04-26T20:37:26.885 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 191, 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 1461163, 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 18440, 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-04-26T20:37:26.886 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 2076, 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 21, 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 3, 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 2076, 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2076, 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1.181965061, 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000569347 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2076, 2024-04-26T20:37:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2077 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 2076, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 2076, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 0, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 1331, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 0, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 743, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 0, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 0, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 0, 2024-04-26T20:37:26.888 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-04-26T20:37:26.889 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-04-26T20:37:26.890 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 97, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 11, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 5, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 5, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 0, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 2, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 0 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 0, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-04-26T20:37:26.891 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "osd-slow-ops": { 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 0, 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 0, 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 0, 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:26.892 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 2319, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 5057247, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 2319, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2319, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 5057247, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 2076, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 3111557, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2076, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 3111557, 2024-04-26T20:37:26.894 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:26.895 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.895 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.895 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:26.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.895 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-04-26T20:37:26.895 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:26.895 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-04-26T20:37:26.895 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:26.895 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-04-26T20:37:26.895 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 2076, 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 2076, 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2076, 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 2076, 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:26.896 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:26.897 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x558ebcd126e0": { 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:26.898 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:26.899 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:26.899 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:26.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:26.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:26.899 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:37:27.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:26 smithi070 ceph-mon[29124]: pgmap v314: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-26T20:37:27.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:26 smithi098 ceph-mon[32591]: pgmap v314: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-26T20:37:27.359 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:26 smithi080 ceph-mon[32278]: pgmap v314: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-26T20:37:27.589 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-04-26T20:37:27.589 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-04-26T20:37:27.589 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-04-26T20:37:27.589 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-04-26T20:37:27.589 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T20:37:27.589 DEBUG:tasks.check_counter:Getting stats from d 2024-04-26T20:37:27.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-26T20:37:27.831 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:37:29.004 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:28 smithi070 ceph-mon[29124]: pgmap v315: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-26T20:37:29.010 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:28 smithi098 ceph-mon[32591]: pgmap v315: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-26T20:37:29.022 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:28 smithi080 ceph-mon[32278]: pgmap v315: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-26T20:37:29.573 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 0, 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2, 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 0, 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 0, 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.001095362, 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000000000, 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000192897, 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T20:37:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 6, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 158, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 3264, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 184880, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.013857405, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.009345893, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.002338162, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 156, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.014463231, 2024-04-26T20:37:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000092713 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 184880 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 215, 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 205, 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 1449328, 2024-04-26T20:37:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 125984, 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.042355545, 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.013587120, 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.032574607, 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.004299520, 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 204, 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.010372105, 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000050843 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1449328, 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 125984 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 148977, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 30, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 217, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1419036, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 217, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 217, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1419036, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:29.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:29.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:29.585 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:37:30.297 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-26T20:37:30.298 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-26T20:37:30.298 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-04-26T20:37:30.298 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-04-26T20:37:30.298 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-04-26T20:37:30.298 DEBUG:tasks.check_counter:Getting stats from g 2024-04-26T20:37:30.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-26T20:37:30.536 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:37:30.949 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:30 smithi070 ceph-mon[29124]: pgmap v316: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 94 B/s wr, 12 op/s 2024-04-26T20:37:31.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:30 smithi098 ceph-mon[32591]: pgmap v316: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 94 B/s wr, 12 op/s 2024-04-26T20:37:31.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:30 smithi080 ceph-mon[32278]: pgmap v316: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 94 B/s wr, 12 op/s 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 730, 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 732, 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 245225, 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 232141, 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 6, 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.083460694, 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.035927405, 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.017246085, 2024-04-26T20:37:32.332 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.021622511, 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 730, 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.038542224, 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000052797 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T20:37:32.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 1597, 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 1569, 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2174928, 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 556319, 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.127681440, 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.038106213, 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.053213626, 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.038833582, 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:32.334 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1569, 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.050940368, 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000032466 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1581952, 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 127280 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 5, 2024-04-26T20:37:32.335 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 157, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 1668, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 437925, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 7, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 5, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.012113391, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.007685695, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.002436736, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000053602, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 154, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.015031975, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000097610 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 436960 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-04-26T20:37:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3537, 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.088388521, 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000024989 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 0, 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 0, 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 0, 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 0, 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-04-26T20:37:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 36, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 0, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 36, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 0, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 36, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 0, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 1, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 0, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 0, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 0, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 0, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:37:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2024-04-26T20:37:32.341 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:37:32.342 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 0, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 0, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 0 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 0, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 0, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-04-26T20:37:32.343 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2024-04-26T20:37:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 0, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 107, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 0, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2024-04-26T20:37:32.345 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 2, 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 4443698, 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 4441093, 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 107 2024-04-26T20:37:32.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 7, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 126, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 119, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 3, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 20, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 17, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 36, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 200, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 164, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 0, 2024-04-26T20:37:32.347 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 0, 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 53824, 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 215416 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 0, 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 0, 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 0, 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 0, 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 0, 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.348 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-04-26T20:37:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-04-26T20:37:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-04-26T20:37:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-04-26T20:37:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 1, 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 3, 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 2, 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 1, 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 0, 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 0, 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 1762, 2024-04-26T20:37:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 197701, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 61, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-04-26T20:37:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 8360, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 191, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 48410, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 403, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 2082, 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 21, 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 3, 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 2082, 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2082, 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2.555924316, 2024-04-26T20:37:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001227629 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2082, 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2083 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 2082, 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 2082, 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 0, 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 1341, 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 0, 2024-04-26T20:37:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 739, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-04-26T20:37:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-04-26T20:37:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 97, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 11, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 6, 2024-04-26T20:37:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 6, 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 0, 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 2, 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 0 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 0, 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd-slow-ops": { 2024-04-26T20:37:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 0, 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 0, 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 0, 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-04-26T20:37:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 2328, 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 2196945, 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 2328, 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2328, 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 2196945, 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 2082, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 249399, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2082, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 249399, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 2082, 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 2082, 2024-04-26T20:37:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2082, 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 2082, 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-04-26T20:37:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x5640bab726e0": { 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-04-26T20:37:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:32.377 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:37:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:32 smithi070 ceph-mon[29124]: pgmap v317: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-26T20:37:33.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:32 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:37:33.038 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:32 smithi098 ceph-mon[32591]: pgmap v317: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-26T20:37:33.038 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:32 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:37:33.071 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:32 smithi080 ceph-mon[32278]: pgmap v317: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-26T20:37:33.071 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:32 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:37:33.122 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-04-26T20:37:33.122 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-04-26T20:37:33.122 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-04-26T20:37:33.122 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-04-26T20:37:33.122 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T20:37:33.122 DEBUG:tasks.check_counter:Getting stats from j 2024-04-26T20:37:33.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-26T20:37:34.012 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:37:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: pgmap v318: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T20:37:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:34 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: pgmap v318: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:34 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: pgmap v318: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:34 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:35.727 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 221, 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 209, 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 1452816, 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 127712, 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.045259586, 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.013810965, 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.034937293, 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.004260888, 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 209, 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.012250829, 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000058616 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1452816, 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 127712 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 2, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 159, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 320, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 184960, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.014016108, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.009691053, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.001970267, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 156, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.014127084, 2024-04-26T20:37:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000090558 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 184960 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 0, 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2, 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 0, 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 0, 2024-04-26T20:37:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.000341305, 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000000000, 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000279065, 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 150008, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 31, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-04-26T20:37:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-04-26T20:37:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 219, 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1419296, 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 219, 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 219, 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1419296, 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T20:37:35.738 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T20:37:36.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:35 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-04-26T20:37:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:35 smithi070 ceph-mon[29124]: Unable to set osd_memory_target on smithi098 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-26T20:37:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:35 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T20:37:36.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:35 smithi070 ceph-mon[29124]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-26T20:37:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:35 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-04-26T20:37:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:35 smithi098 ceph-mon[32591]: Unable to set osd_memory_target on smithi098 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-26T20:37:36.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:35 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T20:37:36.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:35 smithi098 ceph-mon[32591]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-26T20:37:36.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:35 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-04-26T20:37:36.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:35 smithi080 ceph-mon[32278]: Unable to set osd_memory_target on smithi098 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-04-26T20:37:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:35 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T20:37:36.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:35 smithi080 ceph-mon[32278]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-26T20:37:36.447 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-04-26T20:37:36.447 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-04-26T20:37:36.447 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-04-26T20:37:36.447 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-04-26T20:37:36.447 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-04-26T20:37:36.447 DEBUG:tasks.check_counter:Getting stats from b 2024-04-26T20:37:36.448 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-26T20:37:36.696 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:37:37.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:36 smithi070 ceph-mon[29124]: pgmap v319: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:37:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:36 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:37.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:36 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:37.088 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:36 smithi080 ceph-mon[32278]: pgmap v319: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:37:37.088 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:36 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:37.088 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:36 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:37.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:36 smithi098 ceph-mon[32591]: pgmap v319: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:37:37.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:36 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:37.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:36 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:38.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:37 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:37 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:37 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:37 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:37 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:37 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:37 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:37 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:37 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:37:38.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:37 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:37:38.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:37 smithi070 ceph-mon[29124]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:38.124 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:37 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:37 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:37 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:37 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:37 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:37 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:37 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:37 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:37 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:37:38.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:37 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:37:38.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:37 smithi080 ceph-mon[32278]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:38.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:37 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:37 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:37 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:37 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:37 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:37 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:37 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:37 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:37:38.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:37 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:37:38.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:37 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:37:38.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:37 smithi098 ceph-mon[32591]: from='mgr.15333 ' entity='mgr.x' 2024-04-26T20:37:38.521 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T20:37:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 6767, 2024-04-26T20:37:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 5372, 2024-04-26T20:37:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 2676242, 2024-04-26T20:37:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 48623375, 2024-04-26T20:37:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 13, 2024-04-26T20:37:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 4, 2024-04-26T20:37:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.541344947, 2024-04-26T20:37:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.223650993, 2024-04-26T20:37:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.169269256, 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.139852148, 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 5371, 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.324071379, 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000060337 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 4940, 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000640530, 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000129 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 312864 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 47958, 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 85135, 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 15540308, 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 75840416, 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 18, 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 9, 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 2.432555180, 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 1.189234663, 2024-04-26T20:37:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 3.032637400, 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.224042027, 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 85132, 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 3.604441531, 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000042339 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 70832, 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.011099450, 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000156 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 413376, 2024-04-26T20:37:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 246480 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 5746, 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 4524, 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 3945127, 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 22506346, 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 8, 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 7, 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.547757183, 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.250774239, 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.288730069, 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.107883584, 2024-04-26T20:37:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 4523, 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.185920632, 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000041105 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 5483, 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000821993, 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000149 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1653360, 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 135424 2024-04-26T20:37:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 1, 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-MDSRank": { 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2412, 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 28.948982599, 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.012002065 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-PurgeQueue": { 2024-04-26T20:37:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 14577, 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 2.382255846, 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000163425 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": { 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "request": 20404, 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "reply": 20394, 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "reply_latency": { 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 20394, 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 38.916344827, 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.001908225 2024-04-26T20:37:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_reply": 0, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "forward": 10, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_complete": 42, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_keys": 0, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_commit": 193, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_split": 20, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_merge": 3, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes": 5236, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_top": 861, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_bottom": 3479, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pin_tail": 896, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pinned": 4005, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_expired": 3735, 2024-04-26T20:37:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_with_caps": 3, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": 3, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "subtrees": 5, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse": 20703, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_hit": 20662, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_forward": 0, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_discover": 0, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_remote_ino": 0, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_lock": 0, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "load_cent": 0, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "q": 0, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "exported": 13, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "exported_inodes": 3472, 2024-04-26T20:37:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "imported": 13, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "imported_inodes": 828, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_dir_fetch": 0, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_peer_discover": 0, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rfiles": 4, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rbytes": 234, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rsnaps": 6, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_set_tag": 0, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:37:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_file_inodes": 0, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_inode_file_caps": 16, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_revoke": 3101, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_grant": 21783, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps": 20180, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps_dirty": 14361, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_cap_release": 1927, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "process_request_cap_release": 10130 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache": { 2024-04-26T20:37:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update": 0, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update_receipt": 0, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_try_discover": 0, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_send_discover": 0, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_handle_discover": 17, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays": 168, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_delayed": 0, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_created": 8409, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_enqueued": 8241, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_reintegrated": 0, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_migrated": 0, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_processing": 0, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:37:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_started": 2, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_completed": 2, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_exportdir": 13, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_flush": 0, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragmentdir": 23, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragstats": 0, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_inodestats": 0 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log": { 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "evlrg": 0, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "evadd": 46162, 2024-04-26T20:37:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "evex": 0, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "evtrm": 0, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "ev": 46162, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "evexg": 0, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "evexd": 0, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "segadd": 58, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "segex": 0, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "segtrm": 0, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "seg": 58, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "segmjr": 5, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "segexg": 0, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "segexd": 0, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "expos": 4194304, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "wrpos": 114056770, 2024-04-26T20:37:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "rdpos": 0, 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "jlat": { 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 1316, 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 84.741509949, 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.064393244 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "replayed": 0 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_mem": { 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "ino": 2225, 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "ino+": 14033, 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "ino-": 11808, 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "dir": 266, 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "dir+": 815, 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "dir-": 549, 2024-04-26T20:37:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "dn": 5244, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "dn+": 20543, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "dn-": 15299, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "cap": 3, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "cap+": 10716, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "cap-": 10713, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "rss": 114884, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "heap": 231800 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_server": { 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_client_request": 22741, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_server_request": 457, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_request": 20404, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_session": 43, 2024-04-26T20:37:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_peer_request": 930, 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "req_create_latency": { 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 10088, 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 15.949794141, 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.001581066 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getattr_latency": { 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 106, 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.030746143, 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000290057 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getfilelock_latency": { 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "req_link_latency": { 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookup_latency": { 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 223, 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.531863002, 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.002385035 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookuphash_latency": { 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupino_latency": { 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 1, 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000162859, 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000162859 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupname_latency": { 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupparent_latency": { 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupsnap_latency": { 2024-04-26T20:37:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lssnap_latency": { 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 10, 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.001924146, 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000192414 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mkdir_latency": { 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 623, 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.690740525, 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.001108732 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mknod_latency": { 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mksnap_latency": { 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 10, 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.049453217, 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.004945321 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "req_open_latency": { 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 1, 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000311066, 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000311066 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "req_readdir_latency": { 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 908, 2024-04-26T20:37:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 1.361001135, 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.001498899 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rename_latency": { 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2, 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.002725197, 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.001362598 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "req_renamesnap_latency": { 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "req_snapdiff_latency": { 2024-04-26T20:37:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmdir_latency": { 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 475, 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 7.425239296, 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.015632082 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmsnap_latency": { 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 4, 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.018303479, 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.004575869 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmxattr_latency": { 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setattr_latency": { 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2, 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.747446614, 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.373723307 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setdirlayout_latency": { 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setfilelock_latency": { 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setlayout_latency": { 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setxattr_latency": { 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 7, 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.018166227, 2024-04-26T20:37:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.002595175 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "req_symlink_latency": { 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "req_unlink_latency": { 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 7934, 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 12.088467780, 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.001523628 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getvxattr_latency": { 2024-04-26T20:37:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_sessions": { 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "session_count": 2, 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "session_add": 5, 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "session_remove": 3, 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_open": 2, 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_stale": 0, 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "total_load": 133, 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "average_load": 66, 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "avg_session_uptime": 596, 2024-04-26T20:37:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "mdthresh_evicted": 0 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 1773295, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 2671, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 528, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 6, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-26T20:37:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 8360, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 191, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 9568225, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 153690, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter": { 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "op_active": 0, 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "op_laggy": 0, 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send": 10807, 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send_bytes": 115634957, 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "op_resend": 32, 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "op_reply": 10807, 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "op_latency": { 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 10807, 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 50.210837576, 2024-04-26T20:37:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.004646140 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "op_inflight": 0, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "oplen_avg": { 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 10807, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 11173 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "op": 10807, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "op_r": 169, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "op_w": 10638, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "op_rmw": 0, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "op_pg": 0, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_stat": 2, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_create": 11, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_read": 77, 2024-04-26T20:37:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_write": 1393, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writefull": 51, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writesame": 0, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_append": 0, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_zero": 0, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_truncate": 20, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_delete": 8894, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_mapext": 0, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_sparse_read": 0, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_clonerange": 0, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_getxattr": 0, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_setxattr": 22, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_rmxattr": 0, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_call": 0, 2024-04-26T20:37:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_watch": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_notify": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_other": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_active": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_send": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_resend": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_ping": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_active": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_send": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_resend": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_active": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_send": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_resend": 0, 2024-04-26T20:37:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_active": 0, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_send": 0, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_resend": 0, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "command_active": 0, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "command_send": 0, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "command_resend": 0, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "map_epoch": 97, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "map_full": 0, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "map_inc": 12, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_sessions": 12, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_open": 12, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_close": 0, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_laggy": 0, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_wr": 506, 2024-04-26T20:37:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_rd": 132, 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_del": 65 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "oft": { 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_objs": 1, 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_updates": 0, 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_removes": 0 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "osd-slow-ops": { 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_ops_count": 7 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "purge_queue": { 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops": 0, 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops_high_water": 40, 2024-04-26T20:37:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing": 0, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_high_water": 6, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed_ops": 8336, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed": 8241, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_item_in_journal": 0 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 60467, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 17323248, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 60467, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 60467, 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 17323248, 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_bytes": { 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 10807, 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 116486159, 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 10807, 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 116486159, 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_ops": { 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 1024, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 10807, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 10807, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 10807, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 10807, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 8241, 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 853637, 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 8241, 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 77, 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 853637, 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle-0x55b70266e460": { 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 46162, 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 109862466, 2024-04-26T20:37:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 46162, 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 1316, 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 109862466, 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:38.566 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T20:37:39.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:38 smithi070 ceph-mon[29124]: pgmap v320: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:37:39.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:38 smithi070 ceph-mon[29124]: Adjusting osd_memory_target on smithi070 to 176.2M 2024-04-26T20:37:39.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:38 smithi070 ceph-mon[29124]: Unable to set osd_memory_target on smithi070 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:37:39.193 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:38 smithi080 ceph-mon[32278]: pgmap v320: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:37:39.193 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:38 smithi080 ceph-mon[32278]: Adjusting osd_memory_target on smithi070 to 176.2M 2024-04-26T20:37:39.194 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:38 smithi080 ceph-mon[32278]: Unable to set osd_memory_target on smithi070 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:37:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:38 smithi098 ceph-mon[32591]: pgmap v320: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:37:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:38 smithi098 ceph-mon[32591]: Adjusting osd_memory_target on smithi070 to 176.2M 2024-04-26T20:37:39.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:38 smithi098 ceph-mon[32591]: Unable to set osd_memory_target on smithi070 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:37:39.219 INFO:tasks.check_counter:Daemon mds.b mds.exported=13 2024-04-26T20:37:39.219 INFO:tasks.check_counter:Daemon mds.b mds.imported=13 2024-04-26T20:37:39.219 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-04-26T20:37:39.219 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-04-26T20:37:39.220 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-04-26T20:37:39.220 DEBUG:tasks.check_counter:Getting stats from e 2024-04-26T20:37:39.220 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-26T20:37:39.474 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:37:40.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:40 smithi080 ceph-mon[32278]: pgmap v321: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:41.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:40 smithi070 ceph-mon[29124]: pgmap v321: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:41.137 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T20:37:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 1573, 2024-04-26T20:37:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 1574, 2024-04-26T20:37:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 46603808, 2024-04-26T20:37:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 499906, 2024-04-26T20:37:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 8, 2024-04-26T20:37:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 4, 2024-04-26T20:37:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.166216940, 2024-04-26T20:37:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.051775282, 2024-04-26T20:37:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.054176912, 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.046763670, 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 1572, 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.057334762, 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000036472 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T20:37:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 134, 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 289, 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 37791377, 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 482290, 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 8, 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 6, 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.038768522, 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.008651086, 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.024954876, 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.002548325, 2024-04-26T20:37:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 287, 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.023080203, 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000080418 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 441520 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 1029, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 1003, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 27758965, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 377915, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 5, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 4, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.119810107, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.032174359, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.064225352, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.026579246, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 1002, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.035192478, 2024-04-26T20:37:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000035122 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1580528, 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 130192 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 1, 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-26T20:37:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-MDSRank": { 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 3985, 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.101092313, 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000025368 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-PurgeQueue": { 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": { 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "request": 0, 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "reply": 0, 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "reply_latency": { 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_reply": 0, 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "forward": 0, 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_complete": 0, 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_keys": 0, 2024-04-26T20:37:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_commit": 0, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_split": 0, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_merge": 0, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes": 12636, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_top": 0, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_bottom": 12636, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pin_tail": 0, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pinned": 12636, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_expired": 0, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_with_caps": 0, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": 0, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "subtrees": 2, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse": 0, 2024-04-26T20:37:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_hit": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_forward": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_discover": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_remote_ino": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_lock": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "load_cent": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "q": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "exported": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "exported_inodes": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "imported": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "imported_inodes": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_dir_fetch": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:37:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_peer_discover": 0, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rfiles": 4, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rbytes": 234, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rsnaps": 6, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_set_tag": 0, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_file_inodes": 0, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T20:37:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_grant": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_cap_release": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "process_request_cap_release": 0 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache": { 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update_receipt": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_try_discover": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_send_discover": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_handle_discover": 0, 2024-04-26T20:37:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_delayed": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_created": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_enqueued": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_reintegrated": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_migrated": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_processing": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_started": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_completed": 0, 2024-04-26T20:37:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_exportdir": 0, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_flush": 0, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragstats": 0, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_inodestats": 0 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log": { 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "evlrg": 0, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "evadd": 0, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "evex": 0, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "evtrm": 0, 2024-04-26T20:37:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "ev": 46162, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "evexg": 0, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "evexd": 0, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "segadd": 0, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "segex": 0, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "segtrm": 0, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "seg": 58, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "segmjr": 5, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "segexg": 0, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "segexd": 0, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "expos": 4194304, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "wrpos": 114056770, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "rdpos": 114056658, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "jlat": { 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "replayed": 46162 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_mem": { 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "ino": 2025, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "ino+": 13693, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "ino-": 11668, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "dir": 242, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "dir+": 798, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "dir-": 556, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "dn": 12636, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "dn+": 20128, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "dn-": 7492, 2024-04-26T20:37:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "cap": 0, 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "cap+": 0, 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "cap-": 0, 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "rss": 81728, 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "heap": 215416 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_server": { 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_client_request": 0, 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_server_request": 0, 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_request": 0, 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_session": 0, 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_peer_request": 0, 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "req_create_latency": { 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getattr_latency": { 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getfilelock_latency": { 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "req_link_latency": { 2024-04-26T20:37:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookup_latency": { 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookuphash_latency": { 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupino_latency": { 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupname_latency": { 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupparent_latency": { 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupsnap_latency": { 2024-04-26T20:37:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lssnap_latency": { 2024-04-26T20:37:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mkdir_latency": { 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mknod_latency": { 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mksnap_latency": { 2024-04-26T20:37:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "req_open_latency": { 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "req_readdir_latency": { 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rename_latency": { 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "req_renamesnap_latency": { 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "req_snapdiff_latency": { 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmdir_latency": { 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmsnap_latency": { 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmxattr_latency": { 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setattr_latency": { 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setdirlayout_latency": { 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setfilelock_latency": { 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setlayout_latency": { 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setxattr_latency": { 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "req_symlink_latency": { 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "req_unlink_latency": { 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getvxattr_latency": { 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_sessions": { 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "session_count": 2, 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "session_add": 5, 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "session_remove": 3, 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_open": 4, 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_stale": 0, 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "total_load": 0, 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "average_load": 0, 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "avg_session_uptime": 4980, 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "mdthresh_evicted": 0 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-26T20:37:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 311055, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 2248, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 0, 2024-04-26T20:37:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 8360, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 191, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 14086064, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 154934, 2024-04-26T20:37:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter": { 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "op_active": 0, 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "op_laggy": 0, 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send": 2479, 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send_bytes": 26, 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "op_resend": 4, 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "op_reply": 2479, 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "op_latency": { 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2479, 2024-04-26T20:37:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 2.656938556, 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.001071778 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "op_inflight": 0, 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "oplen_avg": { 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2479, 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 2480 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "op": 2479, 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "op_r": 2479, 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "op_w": 0, 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "op_rmw": 0, 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "op_pg": 0, 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_stat": 1609, 2024-04-26T20:37:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_create": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_read": 867, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_write": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writefull": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writesame": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_append": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_zero": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_truncate": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_delete": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_mapext": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_sparse_read": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_clonerange": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_getxattr": 2, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_setxattr": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:37:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_rmxattr": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_call": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_watch": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_notify": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_other": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_active": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_send": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_resend": 0, 2024-04-26T20:37:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_ping": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_active": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_send": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_resend": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_active": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_send": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_resend": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_active": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_send": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_resend": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "command_active": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "command_send": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "command_resend": 0, 2024-04-26T20:37:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "map_epoch": 97, 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "map_full": 0, 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "map_inc": 11, 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_sessions": 10, 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_open": 10, 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_close": 0, 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_laggy": 0, 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_wr": 0, 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_rd": 2, 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_del": 0 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "oft": { 2024-04-26T20:37:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_objs": 0, 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_updates": 0, 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_removes": 0 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "osd-slow-ops": { 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_ops_count": 0 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "purge_queue": { 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops": 0, 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing": 0, 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_high_water": 0, 2024-04-26T20:37:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed_ops": 0, 2024-04-26T20:37:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed": 0, 2024-04-26T20:37:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_item_in_journal": 0 2024-04-26T20:37:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T20:37:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 2732, 2024-04-26T20:37:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 111892608, 2024-04-26T20:37:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 2732, 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2732, 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 111892608, 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_bytes": { 2024-04-26T20:37:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 2479, 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 109877704, 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2479, 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 109877704, 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_ops": { 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 1024, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 2479, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 2479, 2024-04-26T20:37:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2479, 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 2479, 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 0, 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 0, 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle-0x5559af32c6e0": { 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 0, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 0, 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:41.184 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T20:37:41.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:40 smithi098 ceph-mon[32591]: pgmap v321: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:42.070 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-04-26T20:37:42.070 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-04-26T20:37:42.071 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-04-26T20:37:42.071 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-04-26T20:37:42.071 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T20:37:42.071 DEBUG:tasks.check_counter:Getting stats from h 2024-04-26T20:37:42.071 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-26T20:37:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:37:42.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:42 smithi080 ceph-mon[32278]: pgmap v322: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:37:43.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:42 smithi070 ceph-mon[29124]: pgmap v322: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:37:43.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:42 smithi098 ceph-mon[32591]: pgmap v322: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:37:44.109 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T20:37:44.109 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:44.109 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 589, 2024-04-26T20:37:44.109 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 595, 2024-04-26T20:37:44.109 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 1763625, 2024-04-26T20:37:44.109 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 3449659, 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 17, 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 7, 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.075684267, 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.025657194, 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.045694571, 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.011131635, 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 589, 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.029234830, 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000049634 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 162, 2024-04-26T20:37:44.110 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000029436, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000181 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1603984, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 147360 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 1692, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 2649, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 1426535, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 1682040, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 11, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 7, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.152685633, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.074301272, 2024-04-26T20:37:44.111 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.077911700, 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.006145499, 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2652, 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.099365636, 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000037468 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 3762, 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000612543, 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000162 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 441168 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.112 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 960, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 2372, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 331779, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 1185956, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 12, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 9, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.070372922, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.032236584, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.033699831, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.004663881, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2370, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.074499276, 2024-04-26T20:37:44.113 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000031434 2024-04-26T20:37:44.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.114 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:44.114 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 1720, 2024-04-26T20:37:44.114 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000384428, 2024-04-26T20:37:44.114 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000223 2024-04-26T20:37:44.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.114 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 2672, 2024-04-26T20:37:44.114 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 2416 2024-04-26T20:37:44.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.115 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-26T20:37:44.115 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 1, 2024-04-26T20:37:44.115 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-26T20:37:44.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.115 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-MDSRank": { 2024-04-26T20:37:44.115 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T20:37:44.115 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T20:37:44.115 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 220, 2024-04-26T20:37:44.115 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.465089872, 2024-04-26T20:37:44.116 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.002114044 2024-04-26T20:37:44.116 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:44.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.116 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-PurgeQueue": { 2024-04-26T20:37:44.116 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T20:37:44.116 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T20:37:44.117 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 751, 2024-04-26T20:37:44.117 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.046497243, 2024-04-26T20:37:44.117 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000061913 2024-04-26T20:37:44.117 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:44.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.117 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": { 2024-04-26T20:37:44.117 INFO:teuthology.orchestra.run.smithi080.stdout: "request": 601, 2024-04-26T20:37:44.117 INFO:teuthology.orchestra.run.smithi080.stdout: "reply": 597, 2024-04-26T20:37:44.118 INFO:teuthology.orchestra.run.smithi080.stdout: "reply_latency": { 2024-04-26T20:37:44.118 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 597, 2024-04-26T20:37:44.118 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 1.153004593, 2024-04-26T20:37:44.118 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.001931330 2024-04-26T20:37:44.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.118 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_reply": 0, 2024-04-26T20:37:44.119 INFO:teuthology.orchestra.run.smithi080.stdout: "forward": 4, 2024-04-26T20:37:44.119 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_complete": 0, 2024-04-26T20:37:44.119 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_keys": 0, 2024-04-26T20:37:44.119 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_commit": 11, 2024-04-26T20:37:44.119 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_split": 0, 2024-04-26T20:37:44.119 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_merge": 0, 2024-04-26T20:37:44.120 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes": 587, 2024-04-26T20:37:44.120 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_top": 3, 2024-04-26T20:37:44.120 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_bottom": 2, 2024-04-26T20:37:44.120 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pin_tail": 582, 2024-04-26T20:37:44.120 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pinned": 582, 2024-04-26T20:37:44.121 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_expired": 361, 2024-04-26T20:37:44.121 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_with_caps": 1, 2024-04-26T20:37:44.121 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": 2, 2024-04-26T20:37:44.121 INFO:teuthology.orchestra.run.smithi080.stdout: "subtrees": 3, 2024-04-26T20:37:44.121 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse": 954, 2024-04-26T20:37:44.121 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_hit": 720, 2024-04-26T20:37:44.122 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_forward": 0, 2024-04-26T20:37:44.122 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_discover": 5, 2024-04-26T20:37:44.122 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:37:44.122 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_remote_ino": 0, 2024-04-26T20:37:44.122 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_lock": 0, 2024-04-26T20:37:44.122 INFO:teuthology.orchestra.run.smithi080.stdout: "load_cent": 0, 2024-04-26T20:37:44.123 INFO:teuthology.orchestra.run.smithi080.stdout: "q": 0, 2024-04-26T20:37:44.123 INFO:teuthology.orchestra.run.smithi080.stdout: "exported": 6, 2024-04-26T20:37:44.123 INFO:teuthology.orchestra.run.smithi080.stdout: "exported_inodes": 338, 2024-04-26T20:37:44.123 INFO:teuthology.orchestra.run.smithi080.stdout: "imported": 6, 2024-04-26T20:37:44.123 INFO:teuthology.orchestra.run.smithi080.stdout: "imported_inodes": 837, 2024-04-26T20:37:44.123 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_dir_fetch": 0, 2024-04-26T20:37:44.124 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:37:44.124 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_peer_discover": 0, 2024-04-26T20:37:44.124 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rfiles": 4, 2024-04-26T20:37:44.124 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rbytes": 234, 2024-04-26T20:37:44.124 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rsnaps": 2, 2024-04-26T20:37:44.124 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:37:44.125 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_set_tag": 0, 2024-04-26T20:37:44.125 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:37:44.125 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:37:44.125 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:37:44.125 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:37:44.125 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:37:44.125 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_file_inodes": 0, 2024-04-26T20:37:44.126 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:37:44.126 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_revoke": 80, 2024-04-26T20:37:44.126 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_grant": 513, 2024-04-26T20:37:44.126 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:37:44.126 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:37:44.126 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:37:44.127 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps": 77, 2024-04-26T20:37:44.127 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:37:44.127 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_cap_release": 7, 2024-04-26T20:37:44.127 INFO:teuthology.orchestra.run.smithi080.stdout: "process_request_cap_release": 592 2024-04-26T20:37:44.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.127 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache": { 2024-04-26T20:37:44.127 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update": 0, 2024-04-26T20:37:44.127 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update_receipt": 0, 2024-04-26T20:37:44.127 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_try_discover": 0, 2024-04-26T20:37:44.128 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_send_discover": 5, 2024-04-26T20:37:44.128 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_handle_discover": 0, 2024-04-26T20:37:44.128 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays": 35, 2024-04-26T20:37:44.128 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_delayed": 0, 2024-04-26T20:37:44.128 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:37:44.128 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_created": 436, 2024-04-26T20:37:44.129 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_enqueued": 401, 2024-04-26T20:37:44.129 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_reintegrated": 0, 2024-04-26T20:37:44.129 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_migrated": 0, 2024-04-26T20:37:44.129 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_processing": 0, 2024-04-26T20:37:44.129 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:37:44.129 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:37:44.129 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_started": 0, 2024-04-26T20:37:44.129 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_completed": 0, 2024-04-26T20:37:44.129 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:37:44.129 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:37:44.129 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:37:44.130 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_exportdir": 6, 2024-04-26T20:37:44.130 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_flush": 0, 2024-04-26T20:37:44.130 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:37:44.130 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragstats": 0, 2024-04-26T20:37:44.130 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_inodestats": 0 2024-04-26T20:37:44.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.130 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log": { 2024-04-26T20:37:44.130 INFO:teuthology.orchestra.run.smithi080.stdout: "evlrg": 0, 2024-04-26T20:37:44.130 INFO:teuthology.orchestra.run.smithi080.stdout: "evadd": 1289, 2024-04-26T20:37:44.130 INFO:teuthology.orchestra.run.smithi080.stdout: "evex": 0, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "evtrm": 0, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "ev": 1289, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "evexg": 0, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "evexd": 0, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "segadd": 3, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "segex": 0, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "segtrm": 0, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "seg": 3, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "segmjr": 2, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "segexg": 0, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "segexd": 0, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "expos": 4194304, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "wrpos": 7305856, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "rdpos": 0, 2024-04-26T20:37:44.131 INFO:teuthology.orchestra.run.smithi080.stdout: "jlat": { 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 82, 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.170863452, 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.002083700 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: "replayed": 0 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_mem": { 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: "ino": 316, 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: "ino+": 871, 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: "ino-": 555, 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: "dir": 56, 2024-04-26T20:37:44.132 INFO:teuthology.orchestra.run.smithi080.stdout: "dir+": 70, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "dir-": 14, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "dn": 587, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "dn+": 1349, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "dn-": 762, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "cap": 2, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "cap+": 444, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "cap-": 442, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "rss": 62916, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "heap": 223608 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_server": { 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_client_request": 1037, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_server_request": 5, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_request": 601, 2024-04-26T20:37:44.133 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_session": 29, 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_peer_request": 185, 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: "req_create_latency": { 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getattr_latency": { 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 4, 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000789407, 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000197351 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.134 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getfilelock_latency": { 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: "req_link_latency": { 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookup_latency": { 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 115, 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.035615964, 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000309704 2024-04-26T20:37:44.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookuphash_latency": { 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupino_latency": { 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 1, 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000086055, 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000086055 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupname_latency": { 2024-04-26T20:37:44.136 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupparent_latency": { 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupsnap_latency": { 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.137 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lssnap_latency": { 2024-04-26T20:37:44.138 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.138 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.138 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mkdir_latency": { 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mknod_latency": { 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mksnap_latency": { 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.139 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: "req_open_latency": { 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: "req_readdir_latency": { 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 41, 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.029303873, 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000714728 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rename_latency": { 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.140 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: "req_renamesnap_latency": { 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: "req_snapdiff_latency": { 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmdir_latency": { 2024-04-26T20:37:44.141 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 35, 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.508673820, 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.014533537 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmsnap_latency": { 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmxattr_latency": { 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.142 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setattr_latency": { 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setdirlayout_latency": { 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setfilelock_latency": { 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.143 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setlayout_latency": { 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setxattr_latency": { 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: "req_symlink_latency": { 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: "req_unlink_latency": { 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 401, 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.578535474, 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.001442731 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getvxattr_latency": { 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:44.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.146 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_sessions": { 2024-04-26T20:37:44.146 INFO:teuthology.orchestra.run.smithi080.stdout: "session_count": 2, 2024-04-26T20:37:44.146 INFO:teuthology.orchestra.run.smithi080.stdout: "session_add": 5, 2024-04-26T20:37:44.146 INFO:teuthology.orchestra.run.smithi080.stdout: "session_remove": 3, 2024-04-26T20:37:44.146 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_open": 2, 2024-04-26T20:37:44.146 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_stale": 0, 2024-04-26T20:37:44.146 INFO:teuthology.orchestra.run.smithi080.stdout: "total_load": 572, 2024-04-26T20:37:44.146 INFO:teuthology.orchestra.run.smithi080.stdout: "average_load": 286, 2024-04-26T20:37:44.146 INFO:teuthology.orchestra.run.smithi080.stdout: "avg_session_uptime": 602, 2024-04-26T20:37:44.146 INFO:teuthology.orchestra.run.smithi080.stdout: "mdthresh_evicted": 0 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:44.147 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:44.148 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 585686, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 523, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:37:44.149 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 0, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 8360, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 191, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 1280584, 2024-04-26T20:37:44.150 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 19390, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter": { 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "op_active": 0, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "op_laggy": 0, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send": 563, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send_bytes": 3169937, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "op_resend": 33, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "op_reply": 563, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "op_latency": { 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 563, 2024-04-26T20:37:44.151 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 1.163973037, 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.002067447 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "op_inflight": 0, 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "oplen_avg": { 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 563, 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 599 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "op": 563, 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "op_r": 10, 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "op_w": 553, 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "op_rmw": 0, 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "op_pg": 0, 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_stat": 0, 2024-04-26T20:37:44.152 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_create": 10, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_read": 10, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_write": 92, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writefull": 15, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writesame": 0, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_append": 0, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_zero": 0, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_truncate": 0, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_delete": 413, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_mapext": 0, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_sparse_read": 0, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_clonerange": 0, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_getxattr": 0, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_setxattr": 20, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:37:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_rmxattr": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_call": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_watch": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_notify": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_other": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_active": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_send": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_resend": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_ping": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_active": 0, 2024-04-26T20:37:44.154 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_send": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_resend": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_active": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_send": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_resend": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_active": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_send": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_resend": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "command_active": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "command_send": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "command_resend": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "map_epoch": 97, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "map_full": 0, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "map_inc": 11, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_sessions": 12, 2024-04-26T20:37:44.155 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_open": 12, 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_close": 0, 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_laggy": 0, 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_wr": 33, 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_rd": 0, 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_del": 6 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "oft": { 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_objs": 1, 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_updates": 0, 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_removes": 0 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "osd-slow-ops": { 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_ops_count": 0 2024-04-26T20:37:44.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "purge_queue": { 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops": 0, 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops_high_water": 6, 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing": 0, 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_high_water": 6, 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed_ops": 401, 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed": 401, 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_item_in_journal": 0 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:44.157 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 3237, 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 3223076, 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 3237, 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 3237, 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 3223076, 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.158 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_bytes": { 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 563, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 3210438, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 563, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 3210438, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.159 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_ops": { 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 1024, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 563, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 563, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 563, 2024-04-26T20:37:44.160 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 563, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 401, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 40501, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 401, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 10, 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 40501, 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle-0x55c4c937a460": { 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:44.162 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 1289, 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 3111552, 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 1289, 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 82, 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 3111552, 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:44.163 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T20:37:44.881 INFO:tasks.check_counter:Daemon mds.h mds.exported=6 2024-04-26T20:37:44.881 INFO:tasks.check_counter:Daemon mds.h mds.imported=6 2024-04-26T20:37:44.881 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=2 2024-04-26T20:37:44.881 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-04-26T20:37:44.881 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T20:37:44.881 DEBUG:tasks.check_counter:Getting stats from k 2024-04-26T20:37:44.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-26T20:37:44.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:44 smithi080 ceph-mon[32278]: pgmap v323: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:45.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:44 smithi070 ceph-mon[29124]: pgmap v323: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:45.118 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:37:45.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:44 smithi098 ceph-mon[32591]: pgmap v323: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:46.836 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:46 smithi080 ceph-mon[32278]: pgmap v324: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:37:46.870 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T20:37:46.871 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:46.871 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 270, 2024-04-26T20:37:46.871 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 272, 2024-04-26T20:37:46.871 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 4265539, 2024-04-26T20:37:46.871 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 85924, 2024-04-26T20:37:46.871 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 6, 2024-04-26T20:37:46.871 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 2, 2024-04-26T20:37:46.872 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.026374498, 2024-04-26T20:37:46.872 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.008878579, 2024-04-26T20:37:46.872 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.008113675, 2024-04-26T20:37:46.872 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.006491422, 2024-04-26T20:37:46.872 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:46.872 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 270, 2024-04-26T20:37:46.872 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.009939185, 2024-04-26T20:37:46.872 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000036811 2024-04-26T20:37:46.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.872 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:46.872 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 636, 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 796, 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 3594600, 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 644833, 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 7, 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 5, 2024-04-26T20:37:46.873 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.066226306, 2024-04-26T20:37:46.874 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.025055095, 2024-04-26T20:37:46.874 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.016407829, 2024-04-26T20:37:46.874 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.016830656, 2024-04-26T20:37:46.874 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:46.874 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 793, 2024-04-26T20:37:46.874 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.044776260, 2024-04-26T20:37:46.874 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000056464 2024-04-26T20:37:46.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.874 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:46.874 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.874 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.875 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.875 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T20:37:46.875 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 443216 2024-04-26T20:37:46.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.875 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:46.875 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 1488, 2024-04-26T20:37:46.875 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 1460, 2024-04-26T20:37:46.875 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 1954276, 2024-04-26T20:37:46.875 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 524324, 2024-04-26T20:37:46.875 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 4, 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 3, 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.179559811, 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.058728673, 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.067544011, 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.051111794, 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 1460, 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.067184661, 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000046016 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.876 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1584736, 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 133184 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 1, 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-MDSRank": { 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 3594, 2024-04-26T20:37:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.103439789, 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000028781 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-PurgeQueue": { 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": { 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: "request": 0, 2024-04-26T20:37:46.878 INFO:teuthology.orchestra.run.smithi080.stdout: "reply": 0, 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "reply_latency": { 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_reply": 0, 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "forward": 0, 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_complete": 0, 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_keys": 0, 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_commit": 0, 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_split": 0, 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_merge": 0, 2024-04-26T20:37:46.879 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes": 1927, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_top": 0, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_bottom": 1927, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pin_tail": 0, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pinned": 1927, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_expired": 0, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_with_caps": 0, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": 0, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "subtrees": 1, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse": 0, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_hit": 0, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_forward": 0, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_discover": 0, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:37:46.880 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_remote_ino": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_lock": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "load_cent": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "q": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "exported": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "exported_inodes": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "imported": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "imported_inodes": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_dir_fetch": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_peer_discover": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rfiles": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rbytes": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rsnaps": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:37:46.881 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_set_tag": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_file_inodes": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_grant": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:37:46.882 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps": 0, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_cap_release": 0, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "process_request_cap_release": 0 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache": { 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update": 0, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update_receipt": 0, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_try_discover": 0, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_send_discover": 0, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_handle_discover": 0, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays": 0, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_delayed": 0, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:37:46.883 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_created": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_enqueued": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_reintegrated": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_migrated": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_processing": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_started": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_completed": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_exportdir": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_flush": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:37:46.884 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragstats": 0, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_inodestats": 0 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log": { 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "evlrg": 0, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "evadd": 0, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "evex": 0, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "evtrm": 0, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "ev": 3074, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "evexg": 0, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "evexd": 0, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "segadd": 0, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "segex": 0, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "segtrm": 0, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "seg": 5, 2024-04-26T20:37:46.885 INFO:teuthology.orchestra.run.smithi080.stdout: "segmjr": 2, 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: "segexg": 0, 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: "segexd": 0, 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: "expos": 4194304, 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: "wrpos": 11818998, 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: "rdpos": 11814413, 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: "jlat": { 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: "replayed": 3074 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.886 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_mem": { 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "ino": 652, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "ino+": 1382, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "ino-": 730, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "dir": 67, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "dir+": 80, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "dir-": 13, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "dn": 1927, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "dn+": 2136, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "dn-": 209, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "cap": 0, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "cap+": 0, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "cap-": 0, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "rss": 55432, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "heap": 215416 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_server": { 2024-04-26T20:37:46.887 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_client_request": 0, 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_server_request": 0, 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_request": 0, 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_session": 0, 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_peer_request": 0, 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "req_create_latency": { 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getattr_latency": { 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getfilelock_latency": { 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: "req_link_latency": { 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookup_latency": { 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.889 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookuphash_latency": { 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupino_latency": { 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupname_latency": { 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.890 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupparent_latency": { 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupsnap_latency": { 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lssnap_latency": { 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.891 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.892 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.892 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mkdir_latency": { 2024-04-26T20:37:46.892 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.892 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mknod_latency": { 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mksnap_latency": { 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "req_open_latency": { 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.893 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: "req_readdir_latency": { 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rename_latency": { 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: "req_renamesnap_latency": { 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: "req_snapdiff_latency": { 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmdir_latency": { 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.895 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmsnap_latency": { 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmxattr_latency": { 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.896 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setattr_latency": { 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setdirlayout_latency": { 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setfilelock_latency": { 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.897 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setlayout_latency": { 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setxattr_latency": { 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.898 INFO:teuthology.orchestra.run.smithi080.stdout: "req_symlink_latency": { 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "req_unlink_latency": { 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getvxattr_latency": { 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.899 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.900 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.900 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:46.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.900 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_sessions": { 2024-04-26T20:37:46.900 INFO:teuthology.orchestra.run.smithi080.stdout: "session_count": 2, 2024-04-26T20:37:46.900 INFO:teuthology.orchestra.run.smithi080.stdout: "session_add": 4, 2024-04-26T20:37:46.900 INFO:teuthology.orchestra.run.smithi080.stdout: "session_remove": 2, 2024-04-26T20:37:46.900 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_open": 2, 2024-04-26T20:37:46.900 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_stale": 0, 2024-04-26T20:37:46.900 INFO:teuthology.orchestra.run.smithi080.stdout: "total_load": 0, 2024-04-26T20:37:46.900 INFO:teuthology.orchestra.run.smithi080.stdout: "average_load": 0, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "avg_session_uptime": 2923, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "mdthresh_evicted": 0 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:46.901 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:46.902 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 223972, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 752, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:37:46.903 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 0, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 8360, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 191, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-26T20:37:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 2994736, 2024-04-26T20:37:46.905 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 34078, 2024-04-26T20:37:46.905 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:46.905 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-26T20:37:46.905 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:46.905 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-26T20:37:46.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.905 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter": { 2024-04-26T20:37:46.905 INFO:teuthology.orchestra.run.smithi080.stdout: "op_active": 0, 2024-04-26T20:37:46.905 INFO:teuthology.orchestra.run.smithi080.stdout: "op_laggy": 0, 2024-04-26T20:37:46.905 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send": 2134, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send_bytes": 21, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "op_resend": 3, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "op_reply": 2134, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "op_latency": { 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2134, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 1.215971865, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000569808 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "op_inflight": 0, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "oplen_avg": { 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2134, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 2135 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "op": 2134, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "op_r": 2134, 2024-04-26T20:37:46.906 INFO:teuthology.orchestra.run.smithi080.stdout: "op_w": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "op_rmw": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "op_pg": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_stat": 1371, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_create": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_read": 761, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_write": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writefull": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writesame": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_append": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_zero": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_truncate": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_delete": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_mapext": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_sparse_read": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_clonerange": 0, 2024-04-26T20:37:46.907 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_getxattr": 1, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_setxattr": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_rmxattr": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_call": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_watch": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_notify": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_other": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_active": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_send": 0, 2024-04-26T20:37:46.908 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_resend": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_ping": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_active": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_send": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_resend": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_active": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_send": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_resend": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_active": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_send": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_resend": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "command_active": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "command_send": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "command_resend": 0, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "map_epoch": 97, 2024-04-26T20:37:46.909 INFO:teuthology.orchestra.run.smithi080.stdout: "map_full": 0, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "map_inc": 11, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_sessions": 6, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_open": 6, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_close": 0, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_laggy": 0, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_wr": 0, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_rd": 2, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_del": 0 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "oft": { 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_objs": 0, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_updates": 0, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_removes": 0 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: "osd-slow-ops": { 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_ops_count": 0 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "purge_queue": { 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops": 0, 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing": 0, 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_high_water": 0, 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed_ops": 0, 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed": 0, 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_item_in_journal": 0 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:46.911 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 2390, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 9583439, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 2390, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2390, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 9583439, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_bytes": { 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:46.912 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 2134, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 7624699, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2134, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 7624699, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:46.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_ops": { 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 1024, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 2134, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 2134, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2134, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 2134, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.914 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 0, 2024-04-26T20:37:46.915 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 0, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle-0x55ae0388a6e0": { 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T20:37:46.916 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T20:37:46.917 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 0, 2024-04-26T20:37:46.917 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 0, 2024-04-26T20:37:46.917 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T20:37:46.917 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T20:37:46.917 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T20:37:46.917 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T20:37:46.917 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:46.917 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T20:37:46.917 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T20:37:47.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:46 smithi070 ceph-mon[29124]: pgmap v324: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:37:47.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:46 smithi098 ceph-mon[32591]: pgmap v324: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:37:47.681 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-04-26T20:37:47.681 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-04-26T20:37:47.682 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-04-26T20:37:47.682 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-04-26T20:37:47.682 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T20:37:47.682 DEBUG:tasks.check_counter:Getting stats from c 2024-04-26T20:37:47.682 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-26T20:37:47.932 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:37:49.039 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:48 smithi070 ceph-mon[29124]: pgmap v325: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:37:49.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:48 smithi098 ceph-mon[32591]: pgmap v325: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:37:49.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:48 smithi080 ceph-mon[32278]: pgmap v325: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:37:49.851 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 272, 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 400, 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 115823, 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 4583364, 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 12, 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 5, 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.038252549, 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.018400190, 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.010613020, 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.006075067, 2024-04-26T20:37:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 398, 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.039266815, 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000098660 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 100, 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000023443, 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000234 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 314736 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 700, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 684, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1756297, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 3063479, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 13, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 6, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.089626873, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.032982059, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.049065059, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.014267862, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 683, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.048035789, 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000070330 2024-04-26T20:37:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 125, 2024-04-26T20:37:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000028870, 2024-04-26T20:37:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000230 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 1606608, 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 141120 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 3446, 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 7052, 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 2533048, 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 3642752, 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 13, 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 8, 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.233542205, 2024-04-26T20:37:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.109362434, 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.129740573, 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.010424338, 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 7050, 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.185407178, 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000026298 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 6720, 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.001735325, 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000258 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 4960, 2024-04-26T20:37:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 133632 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 220, 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.059154503, 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.004814338 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-04-26T20:37:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-04-26T20:37:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1153, 2024-04-26T20:37:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.114065609, 2024-04-26T20:37:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000098929 2024-04-26T20:37:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-04-26T20:37:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 772, 2024-04-26T20:37:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 772, 2024-04-26T20:37:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-04-26T20:37:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 772, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.828214481, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.002368153 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 20, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 1, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 1204, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 1, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 2, 2024-04-26T20:37:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 1201, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 1201, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 289, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 3, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 980, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 774, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 4, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 1000, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 1, 2024-04-26T20:37:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 3, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 200, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 3, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 1367, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 4, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 234, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 2, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:37:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 591, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 811, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 1114, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 524, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 6, 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 768 2024-04-26T20:37:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 4, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 49, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 708, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 659, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-04-26T20:37:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 3, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 1, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-04-26T20:37:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 3074, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 3074, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 5, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 5, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 11818998, 2024-04-26T20:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 0, 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 77, 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.182213560, 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.002366409 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 0 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 589, 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 1393, 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 804, 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 82, 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 91, 2024-04-26T20:37:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 9, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 1204, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 2152, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 948, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 711, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 711, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 67624, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 223608 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 1340, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 1, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 772, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 24, 2024-04-26T20:37:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 105, 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000297536, 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000297536 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2, 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000947245, 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000473622 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-04-26T20:37:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-04-26T20:37:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-04-26T20:37:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-04-26T20:37:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 61, 2024-04-26T20:37:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.038200827, 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000626243 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 49, 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.843196723, 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.017208096 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 659, 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.945572150, 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001434859 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 2, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 4, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 2, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 2, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 756, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 378, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 585, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 715418, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 843, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8360, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 191, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 2421928, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 34542, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-04-26T20:37:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 836, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 7902759, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 33, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 836, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 836, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.635977606, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001956911 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 836, 2024-04-26T20:37:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 883 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 836, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 13, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 823, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 0, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 10, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 13, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 90, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 16, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-04-26T20:37:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 1, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 672, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 20, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-04-26T20:37:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-04-26T20:37:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 97, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 11, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 12, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 12, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 53, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 0, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 8 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 1, 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 6, 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 6, 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 659, 2024-04-26T20:37:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 659, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 4414, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 4020064, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 4414, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 4414, 2024-04-26T20:37:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 4020064, 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-04-26T20:37:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 836, 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 7969318, 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 836, 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 7969318, 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 836, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 836, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 836, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 836, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 659, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 66559, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 659, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 13, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 66559, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x55802ee88460": { 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 3074, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 7624694, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 3074, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 77, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 7624694, 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:49.899 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T20:37:50.648 INFO:tasks.check_counter:Daemon mds.c mds.exported=3 2024-04-26T20:37:50.648 INFO:tasks.check_counter:Daemon mds.c mds.imported=3 2024-04-26T20:37:50.648 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=2 2024-04-26T20:37:50.648 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-04-26T20:37:50.648 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T20:37:50.648 DEBUG:tasks.check_counter:Getting stats from f 2024-04-26T20:37:50.648 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-26T20:37:50.895 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:37:50.969 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:50 smithi080 ceph-mon[32278]: pgmap v326: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:51.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:50 smithi070 ceph-mon[29124]: pgmap v326: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:51.039 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:50 smithi098 ceph-mon[32591]: pgmap v326: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:52.571 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T20:37:52.571 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:52.571 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 652, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 836, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 417478, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 706248, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 11, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.076009802, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.030171093, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.040808271, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.005703424, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 838, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.052292443, 2024-04-26T20:37:52.572 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000062401 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1343, 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000303462, 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000225 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 447, 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 532, 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1686371, 2024-04-26T20:37:52.573 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 354880, 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 15, 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 8, 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.068712597, 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.022600969, 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.051150693, 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.006076828, 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 528, 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.035843131, 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000067884 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.574 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 227, 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000087155, 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000383 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 1597840, 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 138672 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 100, 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 260, 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 75456, 2024-04-26T20:37:52.575 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 526165, 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 12, 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 7, 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.018584228, 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.008498631, 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.008376817, 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000844989, 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 257, 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.036003504, 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000140091 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 121, 2024-04-26T20:37:52.576 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000043789, 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000361 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 2160, 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 447360 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 60, 2024-04-26T20:37:52.577 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.035485534, 2024-04-26T20:37:52.578 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000591425 2024-04-26T20:37:52.578 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:52.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.578 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-04-26T20:37:52.578 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-04-26T20:37:52.578 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-04-26T20:37:52.578 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 66, 2024-04-26T20:37:52.578 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.006651414, 2024-04-26T20:37:52.578 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000100779 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 63, 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 63, 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 63, 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.074082327, 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001175909 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-04-26T20:37:52.579 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 11, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 16, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 0, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 1, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 15, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 15, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 167, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 2, 2024-04-26T20:37:52.580 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 131, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 93, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 4, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 1000, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 1, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 2, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 148, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 2, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 151, 2024-04-26T20:37:52.581 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 4, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 234, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 2, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:37:52.582 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 4, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 33, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 3, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 1, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 60 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-04-26T20:37:52.583 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 6, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 1, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 31, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 30, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:37:52.584 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 2, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 107, 2024-04-26T20:37:52.585 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 107, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 2, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 2, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-04-26T20:37:52.586 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 4443698, 2024-04-26T20:37:52.587 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 0, 2024-04-26T20:37:52.587 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-04-26T20:37:52.587 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 15, 2024-04-26T20:37:52.587 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.026286524, 2024-04-26T20:37:52.587 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001752434 2024-04-26T20:37:52.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.587 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 0 2024-04-26T20:37:52.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.587 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-04-26T20:37:52.587 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 18, 2024-04-26T20:37:52.587 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 136, 2024-04-26T20:37:52.588 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 118, 2024-04-26T20:37:52.588 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 14, 2024-04-26T20:37:52.588 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 31, 2024-04-26T20:37:52.588 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 17, 2024-04-26T20:37:52.588 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 16, 2024-04-26T20:37:52.588 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 213, 2024-04-26T20:37:52.588 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 197, 2024-04-26T20:37:52.588 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-04-26T20:37:52.588 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 34, 2024-04-26T20:37:52.588 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 34, 2024-04-26T20:37:52.588 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 57028, 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 223608 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 102, 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 1, 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 63, 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 16, 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 34, 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-04-26T20:37:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.001513091, 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001513091 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-04-26T20:37:52.590 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 30, 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.009897760, 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000329925 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.592 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-04-26T20:37:52.592 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.592 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.592 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.592 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-04-26T20:37:52.592 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.592 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.592 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.593 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-04-26T20:37:52.593 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.593 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.593 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.593 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-04-26T20:37:52.593 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.593 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.593 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.594 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-04-26T20:37:52.594 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.594 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000907297, 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000907297 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.596 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.597 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-04-26T20:37:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-04-26T20:37:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.010109709, 2024-04-26T20:37:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.010109709 2024-04-26T20:37:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-04-26T20:37:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-04-26T20:37:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.599 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.600 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-04-26T20:37:52.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.601 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.601 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-04-26T20:37:52.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.601 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.601 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-04-26T20:37:52.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 30, 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.051654470, 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001721815 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.602 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-04-26T20:37:52.603 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-04-26T20:37:52.603 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 3, 2024-04-26T20:37:52.603 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 2, 2024-04-26T20:37:52.603 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-04-26T20:37:52.603 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-04-26T20:37:52.603 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 60, 2024-04-26T20:37:52.603 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 60, 2024-04-26T20:37:52.603 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 1774, 2024-04-26T20:37:52.603 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-04-26T20:37:52.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.604 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-04-26T20:37:52.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:52.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:52.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:52.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:52.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:52.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:52.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:52.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:52.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:52.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:52.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:52.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 309104, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 131, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:52.607 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8360, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 191, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 75170, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 521, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.608 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-04-26T20:37:52.609 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-04-26T20:37:52.609 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-04-26T20:37:52.609 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 96, 2024-04-26T20:37:52.609 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 263625, 2024-04-26T20:37:52.609 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 33, 2024-04-26T20:37:52.609 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 96, 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 96, 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.312995727, 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.003260372 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 96, 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 122 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 96, 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 1, 2024-04-26T20:37:52.610 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 95, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 0, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 10, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 1, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 16, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 10, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-04-26T20:37:52.611 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 42, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 0, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 20, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-04-26T20:37:52.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-04-26T20:37:52.613 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 97, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 11, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 12, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 12, 2024-04-26T20:37:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 20, 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 0, 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 3 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 1, 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-04-26T20:37:52.615 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 6, 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 6, 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 30, 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 30, 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:52.616 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 1195, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 2055142, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 1195, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 1195, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 2055142, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.617 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 96, 2024-04-26T20:37:52.618 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 266655, 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 96, 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 266655, 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-04-26T20:37:52.619 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 96, 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 96, 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 96, 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 96, 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.620 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 30, 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 3030, 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 30, 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:52.621 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:52.622 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 1, 2024-04-26T20:37:52.622 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 3030, 2024-04-26T20:37:52.622 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:52.622 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.622 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.622 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.622 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:52.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:52.622 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x55bf2f5063c0": { 2024-04-26T20:37:52.622 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:52.622 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 107, 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 249394, 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 107, 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 15, 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 249394, 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:52.623 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:52.624 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:52.624 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:52.624 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:52.624 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T20:37:52.881 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:52 smithi098 ceph-mon[32591]: pgmap v327: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:37:53.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:52 smithi070 ceph-mon[29124]: pgmap v327: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:37:53.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:52 smithi080 ceph-mon[32278]: pgmap v327: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:37:53.379 INFO:tasks.check_counter:Daemon mds.f mds.exported=2 2024-04-26T20:37:53.379 INFO:tasks.check_counter:Daemon mds.f mds.imported=2 2024-04-26T20:37:53.379 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=2 2024-04-26T20:37:53.379 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-04-26T20:37:53.379 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T20:37:53.379 DEBUG:tasks.check_counter:Getting stats from i 2024-04-26T20:37:53.380 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-26T20:37:53.616 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:37:55.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:54 smithi070 ceph-mon[29124]: pgmap v328: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:55.058 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:54 smithi098 ceph-mon[32591]: pgmap v328: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:55.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:54 smithi080 ceph-mon[32278]: pgmap v328: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:37:55.316 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T20:37:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 8093, 2024-04-26T20:37:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 15223, 2024-04-26T20:37:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 2433521, 2024-04-26T20:37:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 23413798, 2024-04-26T20:37:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 17, 2024-04-26T20:37:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 7, 2024-04-26T20:37:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.441862639, 2024-04-26T20:37:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.234068560, 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.346407414, 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.025449701, 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 15217, 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.805273918, 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000052919 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 11938, 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.002086537, 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000174 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 928, 2024-04-26T20:37:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 976 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 1949, 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 2222, 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 3383481, 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 3350333, 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 9, 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 5, 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.194365050, 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.072881522, 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.099455693, 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.029976184, 2024-04-26T20:37:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2225, 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.104487000, 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000046960 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1710, 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000398028, 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000232 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 1609280, 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 136608 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 802, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 958, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 475460, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 3058196, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 12, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 7, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.097348404, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.048956083, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.021614822, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.020692435, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 956, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.066255039, 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000069304 2024-04-26T20:37:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 106, 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000076180, 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000718 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 4192, 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 447344 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-04-26T20:37:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 265, 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 4.488700441, 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.016938492 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3734, 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.475125756, 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000127243 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 3519, 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 3519, 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3519, 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 6.587984994, 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001872118 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 28, 2024-04-26T20:37:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 2, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 2278, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 0, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 1, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 2277, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 2277, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 209, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 2, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 3866, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 3713, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-04-26T20:37:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 2, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 1000, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 1, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 2, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 142, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 2, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 1117, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 4, 2024-04-26T20:37:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 234, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 2, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 2, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 142, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 3979, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:37:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 3103, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 2337, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 613, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 2497 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 2, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 57, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-04-26T20:37:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 2177, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 2120, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 2, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-04-26T20:37:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 2, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 8665, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 8665, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 14, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-04-26T20:37:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 14, 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 27430464, 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 0, 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 120, 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.680306864, 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.014002557 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 0 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1039, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 3262, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 2223, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 105, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 119, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 14, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 2278, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 4433, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 2155, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 2178, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 2178, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 86508, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 223608 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 3864, 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 1, 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 3519, 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 16, 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 149, 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1060, 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.125721796, 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001062001 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 193, 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.058685148, 2024-04-26T20:37:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000304068 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-04-26T20:37:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-04-26T20:37:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-04-26T20:37:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 89, 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.074226767, 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000834008 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-04-26T20:37:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 57, 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.128873197, 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.019804792 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-04-26T20:37:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2120, 2024-04-26T20:37:55.342 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 4.200478086, 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001981357 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 3, 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 2, 2024-04-26T20:37:55.343 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 3004, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 3004, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 1773, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:55.344 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:55.345 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:55.346 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 780911, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 1321, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 616, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 7, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:55.347 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8360, 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 191, 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 4318213, 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 69936, 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-04-26T20:37:55.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 2401, 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 24098576, 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 33, 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 2401, 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2401, 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 9.712866872, 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.004045342 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-04-26T20:37:55.349 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2401, 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 2464 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 2401, 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 32, 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 2369, 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 0, 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 10, 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 32, 2024-04-26T20:37:55.350 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 152, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 22, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 2, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 2137, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 0, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 20, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-04-26T20:37:55.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:37:55.352 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-04-26T20:37:55.352 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-04-26T20:37:55.352 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-04-26T20:37:55.352 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:37:55.352 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-04-26T20:37:55.352 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:37:55.352 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-04-26T20:37:55.352 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-04-26T20:37:55.352 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-04-26T20:37:55.352 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-04-26T20:37:55.352 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-04-26T20:37:55.353 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 97, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 11, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 12, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 12, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 76, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 0, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 13 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 1, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:37:55.354 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 6, 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 6, 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 2120, 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 2120, 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-04-26T20:37:55.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 10840, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 5415786, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 10840, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 10840, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 5415786, 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:55.356 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:55.357 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 2401, 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 24321176, 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2401, 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 24321176, 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-04-26T20:37:55.358 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:55.359 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-04-26T20:37:55.359 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-04-26T20:37:55.359 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:55.359 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:55.359 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 2401, 2024-04-26T20:37:55.359 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 2401, 2024-04-26T20:37:55.359 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2401, 2024-04-26T20:37:55.359 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 2401, 2024-04-26T20:37:55.359 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:55.359 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.359 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 2120, 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 222600, 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 2120, 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 32, 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 222600, 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x561f2bcfc460": { 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 8665, 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 23236160, 2024-04-26T20:37:55.361 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 8665, 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 120, 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 23236160, 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:55.362 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T20:37:56.106 INFO:tasks.check_counter:Daemon mds.i mds.exported=2 2024-04-26T20:37:56.106 INFO:tasks.check_counter:Daemon mds.i mds.imported=2 2024-04-26T20:37:56.106 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=2 2024-04-26T20:37:56.106 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-04-26T20:37:56.106 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T20:37:56.106 DEBUG:tasks.check_counter:Getting stats from l 2024-04-26T20:37:56.107 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid cc0136ee-0409-11ef-bc93-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-26T20:37:56.343 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:37:57.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:56 smithi070 ceph-mon[29124]: pgmap v329: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:37:57.155 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:56 smithi098 ceph-mon[32591]: pgmap v329: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:37:57.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:56 smithi080 ceph-mon[32278]: pgmap v329: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 1012, 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 986, 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1836224, 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 375084, 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 1, 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.135477779, 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.043503552, 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.056487431, 2024-04-26T20:37:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.035057849, 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 985, 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.056134313, 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000056989 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 1582880, 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 135312 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:37:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 508, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 670, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 4319340, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 607770, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 7, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 5, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.058213397, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.020197913, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.014207977, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.018090751, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 667, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.032961682, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000049417 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 446800 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 954, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 954, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 19291961, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 302555, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 4, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.083753831, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.025394794, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.027710938, 2024-04-26T20:37:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.023341871, 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 953, 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.031056503, 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000032588 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 448 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3634, 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.113299574, 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000031177 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-04-26T20:37:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 0, 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 0, 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-04-26T20:37:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 0, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 4276, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 0, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 4276, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 4276, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 0, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 1, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 0, 2024-04-26T20:37:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 0, 2024-04-26T20:37:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:37:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 0 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 0, 2024-04-26T20:37:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-04-26T20:37:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 0, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 8665, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 0, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 14, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-04-26T20:37:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 27430464, 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 27428849, 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 8665 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1090, 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 3258, 2024-04-26T20:37:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 2168, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 100, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 115, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 15, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 4276, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 4429, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 153, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 0, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 0, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 62016, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 215416 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 0, 2024-04-26T20:37:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 0, 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 0, 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-04-26T20:37:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-04-26T20:37:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-04-26T20:37:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-04-26T20:37:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-04-26T20:37:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-04-26T20:37:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 3, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 2, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 0, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 0, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 1780, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:37:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:37:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-04-26T20:37:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 240383, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 1196, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-04-26T20:37:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8360, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 191, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 5748808, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 68883, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-04-26T20:37:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 2210, 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 21, 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 3, 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 2210, 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2210, 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.292982283, 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000585059 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-04-26T20:37:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2210, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 2211 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 2210, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 2210, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 0, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 1425, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 0, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 783, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 0, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 0, 2024-04-26T20:37:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 1, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:37:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-04-26T20:37:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 97, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 11, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 6, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 6, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-04-26T20:37:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 0, 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 2, 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 0 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 0, 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 0, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 0, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 0, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 2470, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 25209141, 2024-04-26T20:37:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 2470, 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2470, 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 25209141, 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 2210, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 23236165, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2210, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 23236165, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 2210, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 2210, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2210, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 2210, 2024-04-26T20:37:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x55828faaa6e0": { 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-04-26T20:37:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T20:37:58.074 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T20:37:58.842 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-04-26T20:37:58.842 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-04-26T20:37:58.842 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-04-26T20:37:58.842 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-04-26T20:37:58.842 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T20:37:58.843 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T20:37:58.856 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T20:37:58.856 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:37:58.856 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:37:58.878 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T20:37:58.878 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:37:58.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.089+0000 7f0ee9647640 1 -- 172.21.15.70:0/1727140369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4101810 msgr2=0x7f0ee4101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.089+0000 7f0ee9647640 1 --2- 172.21.15.70:0/1727140369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4101810 0x7f0ee4101c90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009930 tx=0x7f0ed802a420 comp rx=0 tx=0).stop 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.089+0000 7f0ee9647640 1 -- 172.21.15.70:0/1727140369 shutdown_connections 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.089+0000 7f0ee9647640 1 --2- 172.21.15.70:0/1727140369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee41021d0 0x7f0ee410e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.089+0000 7f0ee9647640 1 --2- 172.21.15.70:0/1727140369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4101810 0x7f0ee4101c90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.089+0000 7f0ee9647640 1 --2- 172.21.15.70:0/1727140369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ee4107820 0x7f0ee4107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.089+0000 7f0ee9647640 1 -- 172.21.15.70:0/1727140369 >> 172.21.15.70:0/1727140369 conn(0x7f0ee4078930 msgr2=0x7f0ee4078d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.089+0000 7f0ee9647640 1 -- 172.21.15.70:0/1727140369 shutdown_connections 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.089+0000 7f0ee9647640 1 -- 172.21.15.70:0/1727140369 wait complete. 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee9647640 1 Processor -- start 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee9647640 1 -- start start 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee9647640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee4101810 0x7f0ee4199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee9647640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ee41021d0 0x7f0ee4199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee9647640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4107820 0x7f0ee419dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee9647640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4112d20 con 0x7f0ee4107820 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee9647640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4112ba0 con 0x7f0ee41021d0 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee9647640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4112ea0 con 0x7f0ee4101810 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4107820 0x7f0ee419dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4107820 0x7f0ee419dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56356/0 (socket says 172.21.15.70:56356) 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee37fe640 1 -- 172.21.15.70:0/2611913429 learned_addr learned my addr 172.21.15.70:0/2611913429 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.090+0000 7f0ee2ffd640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee4101810 0x7f0ee4199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ee27fc640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ee41021d0 0x7f0ee4199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ee37fe640 1 -- 172.21.15.70:0/2611913429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee4101810 msgr2=0x7f0ee4199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ee37fe640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee4101810 0x7f0ee4199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ee37fe640 1 -- 172.21.15.70:0/2611913429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ee41021d0 msgr2=0x7f0ee4199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ee37fe640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ee41021d0 0x7f0ee4199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ee37fe640 1 -- 172.21.15.70:0/2611913429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee419e210 con 0x7f0ee4107820 2024-04-26T20:37:59.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ee2ffd640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee4101810 0x7f0ee4199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:37:59.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ee37fe640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4107820 0x7f0ee419dae0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00b970 tx=0x7f0edc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:59.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ecbfff640 1 -- 172.21.15.70:0/2611913429 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc019070 con 0x7f0ee4107820 2024-04-26T20:37:59.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ee9647640 1 -- 172.21.15.70:0/2611913429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee419e500 con 0x7f0ee4107820 2024-04-26T20:37:59.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ecbfff640 1 -- 172.21.15.70:0/2611913429 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0edc00cb40 con 0x7f0ee4107820 2024-04-26T20:37:59.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ecbfff640 1 -- 172.21.15.70:0/2611913429 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc007650 con 0x7f0ee4107820 2024-04-26T20:37:59.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.091+0000 7f0ee9647640 1 -- 172.21.15.70:0/2611913429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee41a5d90 con 0x7f0ee4107820 2024-04-26T20:37:59.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.092+0000 7f0ee9647640 1 -- 172.21.15.70:0/2611913429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee4069c30 con 0x7f0ee4107820 2024-04-26T20:37:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.093+0000 7f0ecbfff640 1 -- 172.21.15.70:0/2611913429 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f0edc01c070 con 0x7f0ee4107820 2024-04-26T20:37:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.093+0000 7f0ecbfff640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f0ecc0a3d20 0x7f0ecc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.094+0000 7f0ee2ffd640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f0ecc0a3d20 0x7f0ecc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.094+0000 7f0ecbfff640 1 -- 172.21.15.70:0/2611913429 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7f0edc0cfdc0 con 0x7f0ee4107820 2024-04-26T20:37:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.094+0000 7f0ee2ffd640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f0ecc0a3d20 0x7f0ecc0a61e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40058c0 tx=0x7f0ed4005850 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:59.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.098+0000 7f0ecbfff640 1 -- 172.21.15.70:0/2611913429 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f0edc09c520 con 0x7f0ee4107820 2024-04-26T20:37:59.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:58 smithi098 ceph-mon[32591]: pgmap v330: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:37:59.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:58 smithi080 ceph-mon[32278]: pgmap v330: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:37:59.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.276+0000 7f0ee9647640 1 -- 172.21.15.70:0/2611913429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ee4109810 con 0x7f0ee4107820 2024-04-26T20:37:59.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.277+0000 7f0ecbfff640 1 -- 172.21.15.70:0/2611913429 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+23173 (secure 0 0 0) 0x7f0edc09be20 con 0x7f0ee4107820 2024-04-26T20:37:59.279 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:37:59.279 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":97,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:37:18.134943+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":6}]},{"pgid":"2.16","mappings":[{"from":2,"to":4},{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3045016659":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/1870744030":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/828657527":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:6800/828657527":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1996137110":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/3579803061":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/358585512":"2024-04-27T20:27:18.831654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:37:59.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.279+0000 7f0ee9647640 1 -- 172.21.15.70:0/2611913429 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f0ecc0a3d20 msgr2=0x7f0ecc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.279+0000 7f0ee9647640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f0ecc0a3d20 0x7f0ecc0a61e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40058c0 tx=0x7f0ed4005850 comp rx=0 tx=0).stop 2024-04-26T20:37:59.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.279+0000 7f0ee9647640 1 -- 172.21.15.70:0/2611913429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4107820 msgr2=0x7f0ee419dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.279+0000 7f0ee9647640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4107820 0x7f0ee419dae0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00b970 tx=0x7f0edc00be30 comp rx=0 tx=0).stop 2024-04-26T20:37:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.280+0000 7f0ee9647640 1 -- 172.21.15.70:0/2611913429 shutdown_connections 2024-04-26T20:37:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.280+0000 7f0ee9647640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f0ecc0a3d20 0x7f0ecc0a61e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.280+0000 7f0ee9647640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4107820 0x7f0ee419dae0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.280+0000 7f0ee9647640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ee41021d0 0x7f0ee4199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.280+0000 7f0ee9647640 1 --2- 172.21.15.70:0/2611913429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee4101810 0x7f0ee4199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.280+0000 7f0ee9647640 1 -- 172.21.15.70:0/2611913429 >> 172.21.15.70:0/2611913429 conn(0x7f0ee4078930 msgr2=0x7f0ee4103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.280+0000 7f0ee9647640 1 -- 172.21.15.70:0/2611913429 shutdown_connections 2024-04-26T20:37:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.280+0000 7f0ee9647640 1 -- 172.21.15.70:0/2611913429 wait complete. 2024-04-26T20:37:59.284 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:58 smithi070 ceph-mon[29124]: pgmap v330: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:37:59.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:20:33.781367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:25:13.606603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:25:14.309945+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 96, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:37:59.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:37:59.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.391+0000 7f00f4378640 1 -- 172.21.15.70:0/3389932644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ec103ba0 msgr2=0x7f00ec103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.391+0000 7f00f4378640 1 --2- 172.21.15.70:0/3389932644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ec103ba0 0x7f00ec103f80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009900 tx=0x7f00e802a480 comp rx=0 tx=0).stop 2024-04-26T20:37:59.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.391+0000 7f00f4378640 1 -- 172.21.15.70:0/3389932644 shutdown_connections 2024-04-26T20:37:59.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.391+0000 7f00f4378640 1 --2- 172.21.15.70:0/3389932644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec10cee0 0x7f00ec10f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.391+0000 7f00f4378640 1 --2- 172.21.15.70:0/3389932644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00ec1044c0 0x7f00ec10c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.391+0000 7f00f4378640 1 --2- 172.21.15.70:0/3389932644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ec103ba0 0x7f00ec103f80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.391+0000 7f00f4378640 1 -- 172.21.15.70:0/3389932644 >> 172.21.15.70:0/3389932644 conn(0x7f00ec0789e0 msgr2=0x7f00ec078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:59.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f4378640 1 -- 172.21.15.70:0/3389932644 shutdown_connections 2024-04-26T20:37:59.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f4378640 1 -- 172.21.15.70:0/3389932644 wait complete. 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f4378640 1 Processor -- start 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f4378640 1 -- start start 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f4378640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00ec103ba0 0x7f00ec199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f4378640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1044c0 0x7f00ec199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f4378640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ec10cee0 0x7f00ec19db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f4378640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec112d10 con 0x7f00ec10cee0 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f4378640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec112b90 con 0x7f00ec1044c0 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f4378640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec112e90 con 0x7f00ec103ba0 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f2915640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ec10cee0 0x7f00ec19db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f2915640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ec10cee0 0x7f00ec19db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56380/0 (socket says 172.21.15.70:56380) 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.392+0000 7f00f2915640 1 -- 172.21.15.70:0/2957991926 learned_addr learned my addr 172.21.15.70:0/2957991926 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00f2114640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00ec103ba0 0x7f00ec199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00f1913640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1044c0 0x7f00ec199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00f2915640 1 -- 172.21.15.70:0/2957991926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00ec103ba0 msgr2=0x7f00ec199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00f2915640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00ec103ba0 0x7f00ec199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00f2915640 1 -- 172.21.15.70:0/2957991926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1044c0 msgr2=0x7f00ec199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00f2915640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1044c0 0x7f00ec199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00f2915640 1 -- 172.21.15.70:0/2957991926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec19e240 con 0x7f00ec10cee0 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00f1913640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1044c0 0x7f00ec199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00f2915640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ec10cee0 0x7f00ec19db10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f00e400ea60 tx=0x7f00e400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00e37fe640 1 -- 172.21.15.70:0/2957991926 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e400ce40 con 0x7f00ec10cee0 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00e37fe640 1 -- 172.21.15.70:0/2957991926 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00e4005020 con 0x7f00ec10cee0 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00e37fe640 1 -- 172.21.15.70:0/2957991926 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4010690 con 0x7f00ec10cee0 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00f4378640 1 -- 172.21.15.70:0/2957991926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ec19e530 con 0x7f00ec10cee0 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.393+0000 7f00f4378640 1 -- 172.21.15.70:0/2957991926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ec1a5dc0 con 0x7f00ec10cee0 2024-04-26T20:37:59.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.394+0000 7f00f4378640 1 -- 172.21.15.70:0/2957991926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00ec0697e0 con 0x7f00ec10cee0 2024-04-26T20:37:59.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.395+0000 7f00e37fe640 1 -- 172.21.15.70:0/2957991926 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f00e4005540 con 0x7f00ec10cee0 2024-04-26T20:37:59.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.395+0000 7f00e37fe640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f00d80a3d20 0x7f00d80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.396+0000 7f00f2114640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f00d80a3d20 0x7f00d80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.396+0000 7f00e37fe640 1 -- 172.21.15.70:0/2957991926 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7f00e40d0ee0 con 0x7f00ec10cee0 2024-04-26T20:37:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.396+0000 7f00f2114640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f00d80a3d20 0x7f00d80a61e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f00e8005ab0 tx=0x7f00e8005a20 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.400+0000 7f00e37fe640 1 -- 172.21.15.70:0/2957991926 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f00e409d530 con 0x7f00ec10cee0 2024-04-26T20:37:59.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.581+0000 7f00f4378640 1 -- 172.21.15.70:0/2957991926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f00ec02dad0 con 0x7f00ec10cee0 2024-04-26T20:37:59.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.581+0000 7f00e37fe640 1 -- 172.21.15.70:0/2957991926 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) ==== 93+0+10 (secure 0 0 0) 0x7f00e409ce30 con 0x7f00ec10cee0 2024-04-26T20:37:59.582 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-04-26T20:37:59.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 -- 172.21.15.70:0/2957991926 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f00d80a3d20 msgr2=0x7f00d80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f00d80a3d20 0x7f00d80a61e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f00e8005ab0 tx=0x7f00e8005a20 comp rx=0 tx=0).stop 2024-04-26T20:37:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 -- 172.21.15.70:0/2957991926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ec10cee0 msgr2=0x7f00ec19db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ec10cee0 0x7f00ec19db10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f00e400ea60 tx=0x7f00e400ef20 comp rx=0 tx=0).stop 2024-04-26T20:37:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 -- 172.21.15.70:0/2957991926 shutdown_connections 2024-04-26T20:37:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f00d80a3d20 0x7f00d80a61e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ec10cee0 0x7f00ec19db10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1044c0 0x7f00ec199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 --2- 172.21.15.70:0/2957991926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00ec103ba0 0x7f00ec199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 -- 172.21.15.70:0/2957991926 >> 172.21.15.70:0/2957991926 conn(0x7f00ec0789e0 msgr2=0x7f00ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 -- 172.21.15.70:0/2957991926 shutdown_connections 2024-04-26T20:37:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.583+0000 7f00f4378640 1 -- 172.21.15.70:0/2957991926 wait complete. 2024-04-26T20:37:59.595 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:37:59.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.694+0000 7f2fb1938640 1 -- 172.21.15.70:0/2782641034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fac101800 msgr2=0x7f2fac101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.694+0000 7f2fb1938640 1 --2- 172.21.15.70:0/2782641034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fac101800 0x7f2fac101c80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009930 tx=0x7f2f9c02a420 comp rx=0 tx=0).stop 2024-04-26T20:37:59.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.694+0000 7f2fb1938640 1 -- 172.21.15.70:0/2782641034 shutdown_connections 2024-04-26T20:37:59.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.694+0000 7f2fb1938640 1 --2- 172.21.15.70:0/2782641034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fac1021c0 0x7f2fac10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.694+0000 7f2fb1938640 1 --2- 172.21.15.70:0/2782641034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fac101800 0x7f2fac101c80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.694+0000 7f2fb1938640 1 --2- 172.21.15.70:0/2782641034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fac107810 0x7f2fac107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.694+0000 7f2fb1938640 1 -- 172.21.15.70:0/2782641034 >> 172.21.15.70:0/2782641034 conn(0x7f2fac0789e0 msgr2=0x7f2fac078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.694+0000 7f2fb1938640 1 -- 172.21.15.70:0/2782641034 shutdown_connections 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.694+0000 7f2fb1938640 1 -- 172.21.15.70:0/2782641034 wait complete. 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fb1938640 1 Processor -- start 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fb1938640 1 -- start start 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fb1938640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fac101800 0x7f2fac199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fb1938640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fac1021c0 0x7f2fac19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fb1938640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fac107810 0x7f2fac1a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fb1938640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac111bf0 con 0x7f2fac107810 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fb1938640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac111a70 con 0x7f2fac101800 2024-04-26T20:37:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fb1938640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac111d70 con 0x7f2fac1021c0 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fab7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fac107810 0x7f2fac1a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fab7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fac107810 0x7f2fac1a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56702/0 (socket says 172.21.15.70:56702) 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fab7fe640 1 -- 172.21.15.70:0/2107597458 learned_addr learned my addr 172.21.15.70:0/2107597458 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2faa7fc640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fac1021c0 0x7f2fac19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2faaffd640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fac101800 0x7f2fac199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fab7fe640 1 -- 172.21.15.70:0/2107597458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fac1021c0 msgr2=0x7f2fac19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fab7fe640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fac1021c0 0x7f2fac19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fab7fe640 1 -- 172.21.15.70:0/2107597458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fac101800 msgr2=0x7f2fac199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fab7fe640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fac101800 0x7f2fac199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2fab7fe640 1 -- 172.21.15.70:0/2107597458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fac1a5530 con 0x7f2fac107810 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.695+0000 7f2faaffd640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fac101800 0x7f2fac199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.696+0000 7f2fab7fe640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fac107810 0x7f2fac1a4ff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400cab0 tx=0x7f2fa400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.696+0000 7f2fb0936640 1 -- 172.21.15.70:0/2107597458 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa400ae20 con 0x7f2fac107810 2024-04-26T20:37:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.696+0000 7f2fb0936640 1 -- 172.21.15.70:0/2107597458 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2fa400f920 con 0x7f2fac107810 2024-04-26T20:37:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.696+0000 7f2fb1938640 1 -- 172.21.15.70:0/2107597458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fac1a5700 con 0x7f2fac107810 2024-04-26T20:37:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.696+0000 7f2fb0936640 1 -- 172.21.15.70:0/2107597458 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4018ad0 con 0x7f2fac107810 2024-04-26T20:37:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.696+0000 7f2fb1938640 1 -- 172.21.15.70:0/2107597458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fac1a5b70 con 0x7f2fac107810 2024-04-26T20:37:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.697+0000 7f2fb1938640 1 -- 172.21.15.70:0/2107597458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fac0697e0 con 0x7f2fac107810 2024-04-26T20:37:59.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.698+0000 7f2fb0936640 1 -- 172.21.15.70:0/2107597458 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f2fa4018d10 con 0x7f2fac107810 2024-04-26T20:37:59.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.698+0000 7f2fb0936640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f2f940a3d20 0x7f2f940a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.699+0000 7f2faaffd640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f2f940a3d20 0x7f2f940a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.699+0000 7f2fb0936640 1 -- 172.21.15.70:0/2107597458 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7f2fa40d0cc0 con 0x7f2fac107810 2024-04-26T20:37:59.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.699+0000 7f2faaffd640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f2f940a3d20 0x7f2f940a61e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0005e10 tx=0x7f2fa0005da0 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:37:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.702+0000 7f2fb0936640 1 -- 172.21.15.70:0/2107597458 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2fa4014030 con 0x7f2fac107810 2024-04-26T20:37:59.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.880+0000 7f2fb1938640 1 -- 172.21.15.70:0/2107597458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2fac1a5ec0 con 0x7f2fac107810 2024-04-26T20:37:59.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.880+0000 7f2fb0936640 1 -- 172.21.15.70:0/2107597458 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) ==== 104+0+11 (secure 0 0 0) 0x7f2fa409d3a0 con 0x7f2fac107810 2024-04-26T20:37:59.881 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-04-26T20:37:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.882+0000 7f2fb1938640 1 -- 172.21.15.70:0/2107597458 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f2f940a3d20 msgr2=0x7f2f940a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.882+0000 7f2fb1938640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f2f940a3d20 0x7f2f940a61e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0005e10 tx=0x7f2fa0005da0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.882+0000 7f2fb1938640 1 -- 172.21.15.70:0/2107597458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fac107810 msgr2=0x7f2fac1a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.882+0000 7f2fb1938640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fac107810 0x7f2fac1a4ff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400cab0 tx=0x7f2fa400cf70 comp rx=0 tx=0).stop 2024-04-26T20:37:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.882+0000 7f2fb1938640 1 -- 172.21.15.70:0/2107597458 shutdown_connections 2024-04-26T20:37:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.882+0000 7f2fb1938640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f2f940a3d20 0x7f2f940a61e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.882+0000 7f2fb1938640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fac107810 0x7f2fac1a4ff0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.882+0000 7f2fb1938640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fac1021c0 0x7f2fac19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.882+0000 7f2fb1938640 1 --2- 172.21.15.70:0/2107597458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fac101800 0x7f2fac199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.882+0000 7f2fb1938640 1 -- 172.21.15.70:0/2107597458 >> 172.21.15.70:0/2107597458 conn(0x7f2fac0789e0 msgr2=0x7f2fac1042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.883+0000 7f2fb1938640 1 -- 172.21.15.70:0/2107597458 shutdown_connections 2024-04-26T20:37:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.883+0000 7f2fb1938640 1 -- 172.21.15.70:0/2107597458 wait complete. 2024-04-26T20:37:59.893 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:59 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2611913429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:37:59.893 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:37:59 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2957991926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:37:59.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:37:59.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.994+0000 7faa8afbf640 1 -- 172.21.15.70:0/1539505001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa841017f0 msgr2=0x7faa84101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.994+0000 7faa8afbf640 1 --2- 172.21.15.70:0/1539505001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa841017f0 0x7faa84101c70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7faa70009930 tx=0x7faa7002a420 comp rx=0 tx=0).stop 2024-04-26T20:37:59.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.994+0000 7faa8afbf640 1 -- 172.21.15.70:0/1539505001 shutdown_connections 2024-04-26T20:37:59.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.994+0000 7faa8afbf640 1 --2- 172.21.15.70:0/1539505001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa841021b0 0x7faa8410e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.994+0000 7faa8afbf640 1 --2- 172.21.15.70:0/1539505001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa841017f0 0x7faa84101c70 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.994+0000 7faa8afbf640 1 --2- 172.21.15.70:0/1539505001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa84107800 0x7faa84107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.994+0000 7faa8afbf640 1 -- 172.21.15.70:0/1539505001 >> 172.21.15.70:0/1539505001 conn(0x7faa84078950 msgr2=0x7faa84078d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.994+0000 7faa8afbf640 1 -- 172.21.15.70:0/1539505001 shutdown_connections 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.994+0000 7faa8afbf640 1 -- 172.21.15.70:0/1539505001 wait complete. 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa8afbf640 1 Processor -- start 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa8afbf640 1 -- start start 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa8afbf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa841017f0 0x7faa841981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa8afbf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa841021b0 0x7faa84198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa8afbf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa84107800 0x7faa8419ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa8afbf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faa84111c00 con 0x7faa841021b0 2024-04-26T20:37:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa8afbf640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faa84111a80 con 0x7faa84107800 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa8afbf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa84111d80 con 0x7faa841017f0 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa83fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa841021b0 0x7faa84198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa83fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa841021b0 0x7faa84198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56714/0 (socket says 172.21.15.70:56714) 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa83fff640 1 -- 172.21.15.70:0/361604870 learned_addr learned my addr 172.21.15.70:0/361604870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa88d5b640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa841017f0 0x7faa841981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa8955c640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa84107800 0x7faa8419ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa83fff640 1 -- 172.21.15.70:0/361604870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa841017f0 msgr2=0x7faa841981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa83fff640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa841017f0 0x7faa841981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa83fff640 1 -- 172.21.15.70:0/361604870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa84107800 msgr2=0x7faa8419ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa83fff640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa84107800 0x7faa8419ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa83fff640 1 -- 172.21.15.70:0/361604870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8419d1b0 con 0x7faa841021b0 2024-04-26T20:37:59.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.995+0000 7faa83fff640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa841021b0 0x7faa84198700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faa70009a50 tx=0x7faa700043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:00.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.996+0000 7faa81ffb640 1 -- 172.21.15.70:0/361604870 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7003f030 con 0x7faa841021b0 2024-04-26T20:38:00.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.996+0000 7faa81ffb640 1 -- 172.21.15.70:0/361604870 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa70003cd0 con 0x7faa841021b0 2024-04-26T20:38:00.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.996+0000 7faa8afbf640 1 -- 172.21.15.70:0/361604870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8419d440 con 0x7faa841021b0 2024-04-26T20:38:00.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.996+0000 7faa81ffb640 1 -- 172.21.15.70:0/361604870 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70035070 con 0x7faa841021b0 2024-04-26T20:38:00.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.996+0000 7faa8afbf640 1 -- 172.21.15.70:0/361604870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa841a4d30 con 0x7faa841021b0 2024-04-26T20:38:00.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.997+0000 7faa8afbf640 1 -- 172.21.15.70:0/361604870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa84102f30 con 0x7faa841021b0 2024-04-26T20:38:00.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.998+0000 7faa81ffb640 1 -- 172.21.15.70:0/361604870 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7faa70031bd0 con 0x7faa841021b0 2024-04-26T20:38:00.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.999+0000 7faa81ffb640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7faa740a3da0 0x7faa740a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:00.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.999+0000 7faa88d5b640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7faa740a3da0 0x7faa740a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:00.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.999+0000 7faa81ffb640 1 -- 172.21.15.70:0/361604870 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7faa700f16f0 con 0x7faa841021b0 2024-04-26T20:38:00.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:37:59.999+0000 7faa88d5b640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7faa740a3da0 0x7faa740a6260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa78009890 tx=0x7faa78008040 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:00.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.002+0000 7faa81ffb640 1 -- 172.21.15.70:0/361604870 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7faa700bdce0 con 0x7faa841021b0 2024-04-26T20:38:00.042 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:59 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2611913429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:38:00.042 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:37:59 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2957991926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:38:00.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.200+0000 7faa8afbf640 1 -- 172.21.15.70:0/361604870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faa84109de0 con 0x7faa841021b0 2024-04-26T20:38:00.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.201+0000 7faa81ffb640 1 -- 172.21.15.70:0/361604870 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) ==== 100+0+11 (secure 0 0 0) 0x7faa700bd5e0 con 0x7faa841021b0 2024-04-26T20:38:00.202 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-04-26T20:38:00.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 -- 172.21.15.70:0/361604870 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7faa740a3da0 msgr2=0x7faa740a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:00.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7faa740a3da0 0x7faa740a6260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa78009890 tx=0x7faa78008040 comp rx=0 tx=0).stop 2024-04-26T20:38:00.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 -- 172.21.15.70:0/361604870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa841021b0 msgr2=0x7faa84198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:00.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa841021b0 0x7faa84198700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faa70009a50 tx=0x7faa700043b0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 -- 172.21.15.70:0/361604870 shutdown_connections 2024-04-26T20:38:00.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7faa740a3da0 0x7faa740a6260 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa84107800 0x7faa8419ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa841021b0 0x7faa84198700 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 --2- 172.21.15.70:0/361604870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa841017f0 0x7faa841981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 -- 172.21.15.70:0/361604870 >> 172.21.15.70:0/361604870 conn(0x7faa84078950 msgr2=0x7faa84104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:00.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 -- 172.21.15.70:0/361604870 shutdown_connections 2024-04-26T20:38:00.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.203+0000 7faa8afbf640 1 -- 172.21.15.70:0/361604870 wait complete. 2024-04-26T20:38:00.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:59 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2611913429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:38:00.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:37:59 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2957991926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:38:00.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:38:00.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.313+0000 7ff4b4db6640 1 -- 172.21.15.70:0/3997800772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4b0107c90 msgr2=0x7ff4b010f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.313+0000 7ff4b4db6640 1 --2- 172.21.15.70:0/3997800772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4b0107c90 0x7ff4b010f8a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009ca0 tx=0x7ff4a802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.314+0000 7ff4b4db6640 1 -- 172.21.15.70:0/3997800772 shutdown_connections 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.314+0000 7ff4b4db6640 1 --2- 172.21.15.70:0/3997800772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4b0107c90 0x7ff4b010f8a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.314+0000 7ff4b4db6640 1 --2- 172.21.15.70:0/3997800772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4b0101e80 0x7ff4b01075b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.314+0000 7ff4b4db6640 1 --2- 172.21.15.70:0/3997800772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4b01014d0 0x7ff4b01018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.314+0000 7ff4b4db6640 1 -- 172.21.15.70:0/3997800772 >> 172.21.15.70:0/3997800772 conn(0x7ff4b0076ae0 msgr2=0x7ff4b0076ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.314+0000 7ff4b4db6640 1 -- 172.21.15.70:0/3997800772 shutdown_connections 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.314+0000 7ff4b4db6640 1 -- 172.21.15.70:0/3997800772 wait complete. 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.314+0000 7ff4b4db6640 1 Processor -- start 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.314+0000 7ff4b4db6640 1 -- start start 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.314+0000 7ff4b4db6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4b01014d0 0x7ff4b0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.314+0000 7ff4b4db6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4b0107c90 0x7ff4b0199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4b4db6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4b019db90 0x7ff4b019e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4b4db6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b0112e20 con 0x7ff4b0107c90 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4b4db6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b0112ca0 con 0x7ff4b019db90 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4b4db6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b0112fa0 con 0x7ff4b01014d0 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4add9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4b0107c90 0x7ff4b0199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4aed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4b019db90 0x7ff4b019e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4aed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4b019db90 0x7ff4b019e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.70:50882/0 (socket says 172.21.15.70:50882) 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4add9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4b0107c90 0x7ff4b0199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56734/0 (socket says 172.21.15.70:56734) 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4aed9d640 1 -- 172.21.15.70:0/138583004 learned_addr learned my addr 172.21.15.70:0/138583004 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4ae59c640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4b01014d0 0x7ff4b0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4aed9d640 1 -- 172.21.15.70:0/138583004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4b01014d0 msgr2=0x7ff4b0199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4aed9d640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4b01014d0 0x7ff4b0199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4aed9d640 1 -- 172.21.15.70:0/138583004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4b0107c90 msgr2=0x7ff4b0199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4aed9d640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4b0107c90 0x7ff4b0199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4aed9d640 1 -- 172.21.15.70:0/138583004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b019e680 con 0x7ff4b019db90 2024-04-26T20:38:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4add9b640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4b0107c90 0x7ff4b0199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:38:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4aed9d640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4b019db90 0x7ff4b019e040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8033040 tx=0x7ff4a8003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff49f7fe640 1 -- 172.21.15.70:0/138583004 <== mon.2 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8031650 con 0x7ff4b019db90 2024-04-26T20:38:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4b4db6640 1 -- 172.21.15.70:0/138583004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b019e910 con 0x7ff4b019db90 2024-04-26T20:38:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff49f7fe640 1 -- 172.21.15.70:0/138583004 <== mon.2 v2:172.21.15.80:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff4a80317f0 con 0x7ff4b019db90 2024-04-26T20:38:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff49f7fe640 1 -- 172.21.15.70:0/138583004 <== mon.2 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a802fa30 con 0x7ff4b019db90 2024-04-26T20:38:00.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.315+0000 7ff4b4db6640 1 -- 172.21.15.70:0/138583004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b01a6160 con 0x7ff4b019db90 2024-04-26T20:38:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.316+0000 7ff4b4db6640 1 -- 172.21.15.70:0/138583004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b006aaa0 con 0x7ff4b019db90 2024-04-26T20:38:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.317+0000 7ff49f7fe640 1 -- 172.21.15.70:0/138583004 <== mon.2 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7ff4a802fbf0 con 0x7ff4b019db90 2024-04-26T20:38:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.318+0000 7ff49f7fe640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ff4980a3d20 0x7ff4980a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.318+0000 7ff4ae59c640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ff4980a3d20 0x7ff4980a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.318+0000 7ff49f7fe640 1 -- 172.21.15.70:0/138583004 <== mon.2 v2:172.21.15.80:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7ff4a80f1cd0 con 0x7ff4b019db90 2024-04-26T20:38:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.318+0000 7ff4ae59c640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ff4980a3d20 0x7ff4980a61e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009990 tx=0x7ff4a0009110 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.322+0000 7ff49f7fe640 1 -- 172.21.15.70:0/138583004 <== mon.2 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff4a80be3d0 con 0x7ff4b019db90 2024-04-26T20:38:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.512+0000 7ff4b4db6640 1 -- 172.21.15.70:0/138583004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff4b0069c30 con 0x7ff4b019db90 2024-04-26T20:38:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.512+0000 7ff49f7fe640 1 -- 172.21.15.70:0/138583004 <== mon.2 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v97) ==== 81+0+1000 (secure 0 0 0) 0x7ff4b0069c30 con 0x7ff4b019db90 2024-04-26T20:38:00.513 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/2279707405 2024-04-27T20:18:07.694178+0000 2024-04-26T20:38:00.513 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3800276670 2024-04-27T20:17:39.758227+0000 2024-04-26T20:38:00.513 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3005389885 2024-04-27T20:18:07.694178+0000 2024-04-26T20:38:00.513 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3045016659 2024-04-27T20:27:18.831654+0000 2024-04-26T20:38:00.513 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1870744030 2024-04-27T20:27:18.831654+0000 2024-04-26T20:38:00.513 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3852527117 2024-04-27T20:17:39.758227+0000 2024-04-26T20:38:00.514 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/2279707405 2024-04-27T20:18:07.694178+0000 2024-04-26T20:38:00.514 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/3935679702 2024-04-27T20:17:39.758227+0000 2024-04-26T20:38:00.514 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/3935679702 2024-04-27T20:17:39.758227+0000 2024-04-26T20:38:00.514 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/671108886 2024-04-27T20:17:39.758227+0000 2024-04-26T20:38:00.514 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/828657527 2024-04-27T20:27:18.831654+0000 2024-04-26T20:38:00.514 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1905137810 2024-04-27T20:18:07.694178+0000 2024-04-26T20:38:00.514 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/828657527 2024-04-27T20:27:18.831654+0000 2024-04-26T20:38:00.514 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3780213411 2024-04-27T20:18:07.694178+0000 2024-04-26T20:38:00.514 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1996137110 2024-04-27T20:27:18.831654+0000 2024-04-26T20:38:00.514 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3579803061 2024-04-27T20:27:18.831654+0000 2024-04-26T20:38:00.514 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/358585512 2024-04-27T20:27:18.831654+0000 2024-04-26T20:38:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:listed 17 entries 2024-04-26T20:38:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 -- 172.21.15.70:0/138583004 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ff4980a3d20 msgr2=0x7ff4980a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ff4980a3d20 0x7ff4980a61e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009990 tx=0x7ff4a0009110 comp rx=0 tx=0).stop 2024-04-26T20:38:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 -- 172.21.15.70:0/138583004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4b019db90 msgr2=0x7ff4b019e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4b019db90 0x7ff4b019e040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8033040 tx=0x7ff4a8003ce0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 -- 172.21.15.70:0/138583004 shutdown_connections 2024-04-26T20:38:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7ff4980a3d20 0x7ff4980a61e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4b019db90 0x7ff4b019e040 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4b0107c90 0x7ff4b0199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 --2- 172.21.15.70:0/138583004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4b01014d0 0x7ff4b0199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 -- 172.21.15.70:0/138583004 >> 172.21.15.70:0/138583004 conn(0x7ff4b0076ae0 msgr2=0x7ff4b00ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 -- 172.21.15.70:0/138583004 shutdown_connections 2024-04-26T20:38:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.514+0000 7ff4b4db6640 1 -- 172.21.15.70:0/138583004 wait complete. 2024-04-26T20:38:00.526 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T20:38:00.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:38:00.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T20:38:00.619 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T20:38:00.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:38:00.619 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T20:38:00.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:38:00.644 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-04-26T20:38:00.699 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T20:38:00.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:38:00.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T20:38:00.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:38:00.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-04-26T20:38:00.854 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-26T20:38:00.864 INFO:tasks.cephadm:Teardown begin 2024-04-26T20:38:00.864 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T20:38:00.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:38:00.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.962+0000 7f1ca4c50640 1 -- 172.21.15.70:0/727253124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca01032c0 msgr2=0x7f1ca010f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:00.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.962+0000 7f1ca4c50640 1 --2- 172.21.15.70:0/727253124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca01032c0 0x7f1ca010f7d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009cd0 tx=0x7f1c9802a8e0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.962+0000 7f1ca4c50640 1 -- 172.21.15.70:0/727253124 shutdown_connections 2024-04-26T20:38:00.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.962+0000 7f1ca4c50640 1 --2- 172.21.15.70:0/727253124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca01032c0 0x7f1ca010f7d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.962+0000 7f1ca4c50640 1 --2- 172.21.15.70:0/727253124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ca0102900 0x7f1ca0102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.962+0000 7f1ca4c50640 1 --2- 172.21.15.70:0/727253124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca0108910 0x7f1ca0108cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.962+0000 7f1ca4c50640 1 -- 172.21.15.70:0/727253124 >> 172.21.15.70:0/727253124 conn(0x7f1ca00fe410 msgr2=0x7f1ca0100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:00.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.962+0000 7f1ca4c50640 1 -- 172.21.15.70:0/727253124 shutdown_connections 2024-04-26T20:38:00.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.962+0000 7f1ca4c50640 1 -- 172.21.15.70:0/727253124 wait complete. 2024-04-26T20:38:00.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.962+0000 7f1ca4c50640 1 Processor -- start 2024-04-26T20:38:00.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.962+0000 7f1ca4c50640 1 -- start start 2024-04-26T20:38:00.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1ca4c50640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca0102900 0x7f1ca0199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:00.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1ca4c50640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ca01032c0 0x7f1ca01997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:00.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1ca4c50640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca0108910 0x7f1ca019db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:00.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1ca4c50640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0112cc0 con 0x7f1ca0108910 2024-04-26T20:38:00.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1ca4c50640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0112b40 con 0x7f1ca01032c0 2024-04-26T20:38:00.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1ca4c50640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0112e40 con 0x7f1ca0102900 2024-04-26T20:38:00.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca0108910 0x7f1ca019db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:00.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca0108910 0x7f1ca019db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56754/0 (socket says 172.21.15.70:56754) 2024-04-26T20:38:00.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9ed9d640 1 -- 172.21.15.70:0/2694008078 learned_addr learned my addr 172.21.15.70:0/2694008078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:38:00.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9dd9b640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ca01032c0 0x7f1ca01997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:00.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9e59c640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca0102900 0x7f1ca0199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:00.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9ed9d640 1 -- 172.21.15.70:0/2694008078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca0102900 msgr2=0x7f1ca0199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:00.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9ed9d640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca0102900 0x7f1ca0199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9ed9d640 1 -- 172.21.15.70:0/2694008078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ca01032c0 msgr2=0x7f1ca01997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:00.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9ed9d640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ca01032c0 0x7f1ca01997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:00.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9ed9d640 1 -- 172.21.15.70:0/2694008078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca019e250 con 0x7f1ca0108910 2024-04-26T20:38:00.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9e59c640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca0102900 0x7f1ca0199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:38:00.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9dd9b640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ca01032c0 0x7f1ca01997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:38:00.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c9ed9d640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca0108910 0x7f1ca019db20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009df0 tx=0x7f1c98003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:00.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c8f7fe640 1 -- 172.21.15.70:0/2694008078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98004240 con 0x7f1ca0108910 2024-04-26T20:38:00.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c8f7fe640 1 -- 172.21.15.70:0/2694008078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1c98003e30 con 0x7f1ca0108910 2024-04-26T20:38:00.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1c8f7fe640 1 -- 172.21.15.70:0/2694008078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98045410 con 0x7f1ca0108910 2024-04-26T20:38:00.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1ca4c50640 1 -- 172.21.15.70:0/2694008078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca019e4e0 con 0x7f1ca0108910 2024-04-26T20:38:00.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.963+0000 7f1ca4c50640 1 -- 172.21.15.70:0/2694008078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca01a5dd0 con 0x7f1ca0108910 2024-04-26T20:38:00.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.964+0000 7f1ca4c50640 1 -- 172.21.15.70:0/2694008078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca0069c30 con 0x7f1ca0108910 2024-04-26T20:38:00.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.966+0000 7f1c8f7fe640 1 -- 172.21.15.70:0/2694008078 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f1c98043020 con 0x7f1ca0108910 2024-04-26T20:38:00.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.966+0000 7f1c8f7fe640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f1c880a3d20 0x7f1c880a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:00.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.966+0000 7f1c9e59c640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f1c880a3d20 0x7f1c880a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:00.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.966+0000 7f1c8f7fe640 1 -- 172.21.15.70:0/2694008078 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7f1c9802e030 con 0x7f1ca0108910 2024-04-26T20:38:00.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.966+0000 7f1c9e59c640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f1c880a3d20 0x7f1c880a61e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c94005e00 tx=0x7f1c94005c70 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:00.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:00.969+0000 7f1c8f7fe640 1 -- 172.21.15.70:0/2694008078 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1c9804a060 con 0x7f1ca0108910 2024-04-26T20:38:01.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:00 smithi070 ceph-mon[29124]: pgmap v331: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:38:01.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:00 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2107597458' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:38:01.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:00 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/361604870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:38:01.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:00 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/138583004' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:38:01.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.186+0000 7f1ca4c50640 1 -- 172.21.15.70:0/2694008078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ca019a5b0 con 0x7f1ca0108910 2024-04-26T20:38:01.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.187+0000 7f1c8f7fe640 1 -- 172.21.15.70:0/2694008078 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11905 (secure 0 0 0) 0x7f1c980be030 con 0x7f1ca0108910 2024-04-26T20:38:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:38:01.188 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:25:15.345214+0000","modified":"2024-04-26T20:32:20.226963+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24488,"mds_1":24481,"mds_2":24463,"mds_3":24461,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3333683222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3333683222},{"type":"v1","addr":"172.21.15.70:6841","nonce":3333683222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":3,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":1,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6839/4099319394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4099319394},{"type":"v1","addr":"172.21.15.80:6839","nonce":4099319394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24481,24488,24463,24461,24451]},"id":1}]} 2024-04-26T20:38:01.188 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 40 2024-04-26T20:38:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 -- 172.21.15.70:0/2694008078 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f1c880a3d20 msgr2=0x7f1c880a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f1c880a3d20 0x7f1c880a61e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c94005e00 tx=0x7f1c94005c70 comp rx=0 tx=0).stop 2024-04-26T20:38:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 -- 172.21.15.70:0/2694008078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca0108910 msgr2=0x7f1ca019db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca0108910 0x7f1ca019db20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009df0 tx=0x7f1c98003970 comp rx=0 tx=0).stop 2024-04-26T20:38:01.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 -- 172.21.15.70:0/2694008078 shutdown_connections 2024-04-26T20:38:01.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f1c880a3d20 0x7f1c880a61e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca0108910 0x7f1ca019db20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ca01032c0 0x7f1ca01997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 --2- 172.21.15.70:0/2694008078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ca0102900 0x7f1ca0199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 -- 172.21.15.70:0/2694008078 >> 172.21.15.70:0/2694008078 conn(0x7f1ca00fe410 msgr2=0x7f1ca00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:01.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 -- 172.21.15.70:0/2694008078 shutdown_connections 2024-04-26T20:38:01.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.189+0000 7f1ca4c50640 1 -- 172.21.15.70:0/2694008078 wait complete. 2024-04-26T20:38:01.201 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:38:01.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:00 smithi098 ceph-mon[32591]: pgmap v331: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:38:01.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:00 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2107597458' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:38:01.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:00 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/361604870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:38:01.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:00 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/138583004' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:38:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:00 smithi080 ceph-mon[32278]: pgmap v331: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:38:01.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:00 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2107597458' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:38:01.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:00 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/361604870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:38:01.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:00 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/138583004' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:38:01.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.298+0000 7fea62220640 1 -- 172.21.15.70:0/2837108459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea5c1078b0 msgr2=0x7fea5c107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.298+0000 7fea62220640 1 --2- 172.21.15.70:0/2837108459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea5c1078b0 0x7fea5c107c90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009900 tx=0x7fea4c02a410 comp rx=0 tx=0).stop 2024-04-26T20:38:01.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.298+0000 7fea62220640 1 -- 172.21.15.70:0/2837108459 shutdown_connections 2024-04-26T20:38:01.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.298+0000 7fea62220640 1 --2- 172.21.15.70:0/2837108459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5c102420 0x7fea5c10e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.298+0000 7fea62220640 1 --2- 172.21.15.70:0/2837108459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c101a80 0x7fea5c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.298+0000 7fea62220640 1 --2- 172.21.15.70:0/2837108459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea5c1078b0 0x7fea5c107c90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.298+0000 7fea62220640 1 -- 172.21.15.70:0/2837108459 >> 172.21.15.70:0/2837108459 conn(0x7fea5c078620 msgr2=0x7fea5c078a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.299+0000 7fea62220640 1 -- 172.21.15.70:0/2837108459 shutdown_connections 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.299+0000 7fea62220640 1 -- 172.21.15.70:0/2837108459 wait complete. 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.299+0000 7fea62220640 1 Processor -- start 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.299+0000 7fea62220640 1 -- start start 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.299+0000 7fea62220640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea5c101a80 0x7fea5c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.299+0000 7fea62220640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c102420 0x7fea5c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.299+0000 7fea62220640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5c1078b0 0x7fea5c19dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.299+0000 7fea62220640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c112d20 con 0x7fea5c101a80 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.299+0000 7fea62220640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c112ba0 con 0x7fea5c1078b0 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.299+0000 7fea62220640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c112ea0 con 0x7fea5c102420 2024-04-26T20:38:01.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.299+0000 7fea5b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea5c101a80 0x7fea5c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea5b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea5c101a80 0x7fea5c199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56760/0 (socket says 172.21.15.70:56760) 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea5b7fe640 1 -- 172.21.15.70:0/1999026782 learned_addr learned my addr 172.21.15.70:0/1999026782 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea5bfff640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5c1078b0 0x7fea5c19dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea5affd640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c102420 0x7fea5c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea5b7fe640 1 -- 172.21.15.70:0/1999026782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c102420 msgr2=0x7fea5c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea5b7fe640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c102420 0x7fea5c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea5b7fe640 1 -- 172.21.15.70:0/1999026782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5c1078b0 msgr2=0x7fea5c19dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea5b7fe640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5c1078b0 0x7fea5c19dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea5b7fe640 1 -- 172.21.15.70:0/1999026782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c19e200 con 0x7fea5c101a80 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea5b7fe640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea5c101a80 0x7fea5c199260 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fea4c005ab0 tx=0x7fea4c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea58ff9640 1 -- 172.21.15.70:0/1999026782 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c03f030 con 0x7fea5c101a80 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea62220640 1 -- 172.21.15.70:0/1999026782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5c19e490 con 0x7fea5c101a80 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea58ff9640 1 -- 172.21.15.70:0/1999026782 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fea4c003cd0 con 0x7fea5c101a80 2024-04-26T20:38:01.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea58ff9640 1 -- 172.21.15.70:0/1999026782 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c035070 con 0x7fea5c101a80 2024-04-26T20:38:01.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.300+0000 7fea62220640 1 -- 172.21.15.70:0/1999026782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea5c1a5d80 con 0x7fea5c101a80 2024-04-26T20:38:01.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.301+0000 7fea62220640 1 -- 172.21.15.70:0/1999026782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5c0697e0 con 0x7fea5c101a80 2024-04-26T20:38:01.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.302+0000 7fea58ff9640 1 -- 172.21.15.70:0/1999026782 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fea4c042030 con 0x7fea5c101a80 2024-04-26T20:38:01.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.303+0000 7fea58ff9640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fea480a3d20 0x7fea480a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.303+0000 7fea5affd640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fea480a3d20 0x7fea480a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.303+0000 7fea58ff9640 1 -- 172.21.15.70:0/1999026782 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7fea4c0f1030 con 0x7fea5c101a80 2024-04-26T20:38:01.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.303+0000 7fea5affd640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fea480a3d20 0x7fea480a61e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fea44005fd0 tx=0x7fea44005e20 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:01.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.307+0000 7fea58ff9640 1 -- 172.21.15.70:0/1999026782 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fea4c0bd680 con 0x7fea5c101a80 2024-04-26T20:38:01.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.521+0000 7fea62220640 1 -- 172.21.15.70:0/1999026782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea5c109d10 con 0x7fea5c101a80 2024-04-26T20:38:01.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.522+0000 7fea58ff9640 1 -- 172.21.15.70:0/1999026782 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11905 (secure 0 0 0) 0x7fea4c0bcf80 con 0x7fea5c101a80 2024-04-26T20:38:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:38:01.523 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/931274137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":931274137},{"type":"v1","addr":"172.21.15.70:6835","nonce":931274137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2473693414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2473693414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2473693414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:25:15.345214+0000","modified":"2024-04-26T20:32:20.226963+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24488,"mds_1":24481,"mds_2":24463,"mds_3":24461,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/2998426471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2998426471},{"type":"v1","addr":"172.21.15.70:6839","nonce":2998426471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3333683222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3333683222},{"type":"v1","addr":"172.21.15.70:6841","nonce":3333683222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6833/20228697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":20228697},{"type":"v1","addr":"172.21.15.80:6833","nonce":20228697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/699509756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":699509756},{"type":"v1","addr":"172.21.15.98:6833","nonce":699509756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6835/857349607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":857349607},{"type":"v1","addr":"172.21.15.80:6835","nonce":857349607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6835/2812509799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2812509799},{"type":"v1","addr":"172.21.15.98:6835","nonce":2812509799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":3,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.80:6837/3487724503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":3487724503},{"type":"v1","addr":"172.21.15.80:6837","nonce":3487724503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6837/3751464822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":3751464822},{"type":"v1","addr":"172.21.15.98:6837","nonce":3751464822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":1,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6839/4073846722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":4073846722},{"type":"v1","addr":"172.21.15.98:6839","nonce":4073846722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6839/4099319394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":4099319394},{"type":"v1","addr":"172.21.15.80:6839","nonce":4099319394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24488,"qdb_cluster":[24481,24488,24463,24461,24451]},"id":1}]} 2024-04-26T20:38:01.523 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 40 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 -- 172.21.15.70:0/1999026782 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fea480a3d20 msgr2=0x7fea480a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fea480a3d20 0x7fea480a61e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fea44005fd0 tx=0x7fea44005e20 comp rx=0 tx=0).stop 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 -- 172.21.15.70:0/1999026782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea5c101a80 msgr2=0x7fea5c199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea5c101a80 0x7fea5c199260 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fea4c005ab0 tx=0x7fea4c0042f0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 -- 172.21.15.70:0/1999026782 shutdown_connections 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7fea480a3d20 0x7fea480a61e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea5c1078b0 0x7fea5c19dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c102420 0x7fea5c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 --2- 172.21.15.70:0/1999026782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea5c101a80 0x7fea5c199260 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 -- 172.21.15.70:0/1999026782 >> 172.21.15.70:0/1999026782 conn(0x7fea5c078620 msgr2=0x7fea5c1007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 -- 172.21.15.70:0/1999026782 shutdown_connections 2024-04-26T20:38:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.524+0000 7fea62220640 1 -- 172.21.15.70:0/1999026782 wait complete. 2024-04-26T20:38:01.535 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:38:01.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.632+0000 7f23a0722640 1 -- 172.21.15.70:0/1029444088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2398106bf0 msgr2=0x7f239810e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.632+0000 7f23a0722640 1 --2- 172.21.15.70:0/1029444088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2398106bf0 0x7f239810e730 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2388009900 tx=0x7f238802a410 comp rx=0 tx=0).stop 2024-04-26T20:38:01.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.632+0000 7f23a0722640 1 -- 172.21.15.70:0/1029444088 shutdown_connections 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.632+0000 7f23a0722640 1 --2- 172.21.15.70:0/1029444088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2398106bf0 0x7f239810e730 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.632+0000 7f23a0722640 1 --2- 172.21.15.70:0/1029444088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2398102f20 0x7f23981064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.632+0000 7f23a0722640 1 --2- 172.21.15.70:0/1029444088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2398102570 0x7f2398102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.632+0000 7f23a0722640 1 -- 172.21.15.70:0/1029444088 >> 172.21.15.70:0/1029444088 conn(0x7f2398076ae0 msgr2=0x7f2398076ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.632+0000 7f23a0722640 1 -- 172.21.15.70:0/1029444088 shutdown_connections 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.632+0000 7f23a0722640 1 -- 172.21.15.70:0/1029444088 wait complete. 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f23a0722640 1 Processor -- start 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f23a0722640 1 -- start start 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f23a0722640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2398102570 0x7f23981991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f23a0722640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2398106bf0 0x7f23981996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f23a0722640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f239819da70 0x7f239819df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f23a0722640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2398111c60 con 0x7f2398102570 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f23a0722640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2398111ae0 con 0x7f2398106bf0 2024-04-26T20:38:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f23a0722640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2398111de0 con 0x7f239819da70 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239e4be640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2398102570 0x7f23981991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239e4be640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2398102570 0x7f23981991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56776/0 (socket says 172.21.15.70:56776) 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239e4be640 1 -- 172.21.15.70:0/3185477602 learned_addr learned my addr 172.21.15.70:0/3185477602 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239dcbd640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2398106bf0 0x7f23981996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239ecbf640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f239819da70 0x7f239819df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239e4be640 1 -- 172.21.15.70:0/3185477602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f239819da70 msgr2=0x7f239819df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239e4be640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f239819da70 0x7f239819df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239e4be640 1 -- 172.21.15.70:0/3185477602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2398106bf0 msgr2=0x7f23981996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239e4be640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2398106bf0 0x7f23981996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239e4be640 1 -- 172.21.15.70:0/3185477602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239819e560 con 0x7f2398102570 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239dcbd640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2398106bf0 0x7f23981996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.633+0000 7f239e4be640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2398102570 0x7f23981991b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f239000ba50 tx=0x7f239000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.634+0000 7f23977fe640 1 -- 172.21.15.70:0/3185477602 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390019070 con 0x7f2398102570 2024-04-26T20:38:01.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.634+0000 7f23977fe640 1 -- 172.21.15.70:0/3185477602 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f239000cbe0 con 0x7f2398102570 2024-04-26T20:38:01.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.634+0000 7f23a0722640 1 -- 172.21.15.70:0/3185477602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239819e850 con 0x7f2398102570 2024-04-26T20:38:01.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.634+0000 7f23977fe640 1 -- 172.21.15.70:0/3185477602 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23900076e0 con 0x7f2398102570 2024-04-26T20:38:01.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.634+0000 7f23a0722640 1 -- 172.21.15.70:0/3185477602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23981a5ff0 con 0x7f2398102570 2024-04-26T20:38:01.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.635+0000 7f23a0722640 1 -- 172.21.15.70:0/3185477602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2398069c30 con 0x7f2398102570 2024-04-26T20:38:01.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.636+0000 7f23977fe640 1 -- 172.21.15.70:0/3185477602 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f239001c070 con 0x7f2398102570 2024-04-26T20:38:01.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.636+0000 7f23977fe640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f23800a3d20 0x7f23800a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.637+0000 7f239dcbd640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f23800a3d20 0x7f23800a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.637+0000 7f23977fe640 1 -- 172.21.15.70:0/3185477602 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7f23900d0210 con 0x7f2398102570 2024-04-26T20:38:01.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.637+0000 7f239dcbd640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f23800a3d20 0x7f23800a61e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23981080c0 tx=0x7f238c005f90 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:01.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.640+0000 7f23977fe640 1 -- 172.21.15.70:0/3185477602 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f239009c320 con 0x7f2398102570 2024-04-26T20:38:01.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.822+0000 7f23a0722640 1 -- 172.21.15.70:0/3185477602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2398102f20 con 0x7f2398102570 2024-04-26T20:38:01.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.823+0000 7f23977fe640 1 -- 172.21.15.70:0/3185477602 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+23173 (secure 0 0 0) 0x7f23900a0620 con 0x7f2398102570 2024-04-26T20:38:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T20:38:01.825 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":97,"fsid":"cc0136ee-0409-11ef-bc93-c7b262605968","created":"2024-04-26T20:17:12.718157+0000","modified":"2024-04-26T20:37:18.134943+0000","last_up_change":"2024-04-26T20:24:22.399461+0000","last_in_change":"2024-04-26T20:24:01.492396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:20:33.781367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:25:13.606603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:25:14.309945+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d5da62f-a10b-4799-89d0-24ceef513b9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173414845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173414845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173414845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173414845},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173414845}]},"public_addr":"172.21.15.70:6803/1173414845","cluster_addr":"172.21.15.70:6805/1173414845","heartbeat_back_addr":"172.21.15.70:6809/1173414845","heartbeat_front_addr":"172.21.15.70:6807/1173414845","state":["exists","up"]},{"osd":1,"uuid":"76cf2db0-33a9-490b-905b-207a44bdccde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6801","nonce":2449011375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6803","nonce":2449011375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6807","nonce":2449011375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2449011375},{"type":"v1","addr":"172.21.15.80:6805","nonce":2449011375}]},"public_addr":"172.21.15.80:6801/2449011375","cluster_addr":"172.21.15.80:6803/2449011375","heartbeat_back_addr":"172.21.15.80:6807/2449011375","heartbeat_front_addr":"172.21.15.80:6805/2449011375","state":["exists","up"]},{"osd":2,"uuid":"0c05d101-5533-40fc-b51a-3f427309846d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6801","nonce":3805036241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6803","nonce":3805036241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6807","nonce":3805036241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3805036241},{"type":"v1","addr":"172.21.15.98:6805","nonce":3805036241}]},"public_addr":"172.21.15.98:6801/3805036241","cluster_addr":"172.21.15.98:6803/3805036241","heartbeat_back_addr":"172.21.15.98:6807/3805036241","heartbeat_front_addr":"172.21.15.98:6805/3805036241","state":["exists","up"]},{"osd":3,"uuid":"fdf9d5ab-8f4b-4078-b880-0a7a485e58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6811","nonce":2247334474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6813","nonce":2247334474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6817","nonce":2247334474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2247334474},{"type":"v1","addr":"172.21.15.70:6815","nonce":2247334474}]},"public_addr":"172.21.15.70:6811/2247334474","cluster_addr":"172.21.15.70:6813/2247334474","heartbeat_back_addr":"172.21.15.70:6817/2247334474","heartbeat_front_addr":"172.21.15.70:6815/2247334474","state":["exists","up"]},{"osd":4,"uuid":"47740d51-b10e-46d4-bb29-0d7d5dc763fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6809","nonce":1371786976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6811","nonce":1371786976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6815","nonce":1371786976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1371786976},{"type":"v1","addr":"172.21.15.80:6813","nonce":1371786976}]},"public_addr":"172.21.15.80:6809/1371786976","cluster_addr":"172.21.15.80:6811/1371786976","heartbeat_back_addr":"172.21.15.80:6815/1371786976","heartbeat_front_addr":"172.21.15.80:6813/1371786976","state":["exists","up"]},{"osd":5,"uuid":"42170565-473a-4cee-95f8-cc9f0d195ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6809","nonce":2247181535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6811","nonce":2247181535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6815","nonce":2247181535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2247181535},{"type":"v1","addr":"172.21.15.98:6813","nonce":2247181535}]},"public_addr":"172.21.15.98:6809/2247181535","cluster_addr":"172.21.15.98:6811/2247181535","heartbeat_back_addr":"172.21.15.98:6815/2247181535","heartbeat_front_addr":"172.21.15.98:6813/2247181535","state":["exists","up"]},{"osd":6,"uuid":"3e835c1d-2db6-4e95-8300-e6f1d2be9916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6819","nonce":1060533691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6821","nonce":1060533691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6825","nonce":1060533691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1060533691},{"type":"v1","addr":"172.21.15.70:6823","nonce":1060533691}]},"public_addr":"172.21.15.70:6819/1060533691","cluster_addr":"172.21.15.70:6821/1060533691","heartbeat_back_addr":"172.21.15.70:6825/1060533691","heartbeat_front_addr":"172.21.15.70:6823/1060533691","state":["exists","up"]},{"osd":7,"uuid":"be9f0075-a715-4f28-b180-061b1a7633ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6817","nonce":1066348895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6819","nonce":1066348895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6823","nonce":1066348895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1066348895},{"type":"v1","addr":"172.21.15.80:6821","nonce":1066348895}]},"public_addr":"172.21.15.80:6817/1066348895","cluster_addr":"172.21.15.80:6819/1066348895","heartbeat_back_addr":"172.21.15.80:6823/1066348895","heartbeat_front_addr":"172.21.15.80:6821/1066348895","state":["exists","up"]},{"osd":8,"uuid":"de51eb21-8654-4d96-b398-0059d86c9580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6817","nonce":588538700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6819","nonce":588538700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6823","nonce":588538700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":588538700},{"type":"v1","addr":"172.21.15.98:6821","nonce":588538700}]},"public_addr":"172.21.15.98:6817/588538700","cluster_addr":"172.21.15.98:6819/588538700","heartbeat_back_addr":"172.21.15.98:6823/588538700","heartbeat_front_addr":"172.21.15.98:6821/588538700","state":["exists","up"]},{"osd":9,"uuid":"8ab6f37b-5549-4582-8875-1863243bd85b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6827","nonce":1559827927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6829","nonce":1559827927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6833","nonce":1559827927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1559827927},{"type":"v1","addr":"172.21.15.70:6831","nonce":1559827927}]},"public_addr":"172.21.15.70:6827/1559827927","cluster_addr":"172.21.15.70:6829/1559827927","heartbeat_back_addr":"172.21.15.70:6833/1559827927","heartbeat_front_addr":"172.21.15.70:6831/1559827927","state":["exists","up"]},{"osd":10,"uuid":"1b598502-7650-4dc7-b997-60dd570914c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6825","nonce":3717005547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6827","nonce":3717005547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6831","nonce":3717005547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3717005547},{"type":"v1","addr":"172.21.15.80:6829","nonce":3717005547}]},"public_addr":"172.21.15.80:6825/3717005547","cluster_addr":"172.21.15.80:6827/3717005547","heartbeat_back_addr":"172.21.15.80:6831/3717005547","heartbeat_front_addr":"172.21.15.80:6829/3717005547","state":["exists","up"]},{"osd":11,"uuid":"2994a2a9-f896-4f0d-baab-095277c00bde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6825","nonce":1253190539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6827","nonce":1253190539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6831","nonce":1253190539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1253190539},{"type":"v1","addr":"172.21.15.98:6829","nonce":1253190539}]},"public_addr":"172.21.15.98:6825/1253190539","cluster_addr":"172.21.15.98:6827/1253190539","heartbeat_back_addr":"172.21.15.98:6831/1253190539","heartbeat_front_addr":"172.21.15.98:6829/1253190539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:19:41.095227+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:05.553931+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:29.646721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:20:54.957583+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:19.998801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:21:45.100862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:10.611041+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:22:36.648143+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:02.478665+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:28.211637+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:23:53.991282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:24:20.070789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":6}]},{"pgid":"2.16","mappings":[{"from":2,"to":4},{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3800276670":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/3005389885":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/3045016659":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/1870744030":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/3852527117":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/2279707405":"2024-04-27T20:18:07.694178+0000","172.21.15.70:6801/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6800/3935679702":"2024-04-27T20:17:39.758227+0000","172.21.15.70:0/671108886":"2024-04-27T20:17:39.758227+0000","172.21.15.70:6801/828657527":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/1905137810":"2024-04-27T20:18:07.694178+0000","172.21.15.70:6800/828657527":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/3780213411":"2024-04-27T20:18:07.694178+0000","172.21.15.70:0/1996137110":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/3579803061":"2024-04-27T20:27:18.831654+0000","172.21.15.70:0/358585512":"2024-04-27T20:27:18.831654+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:38:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 -- 172.21.15.70:0/3185477602 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f23800a3d20 msgr2=0x7f23800a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f23800a3d20 0x7f23800a61e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23981080c0 tx=0x7f238c005f90 comp rx=0 tx=0).stop 2024-04-26T20:38:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 -- 172.21.15.70:0/3185477602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2398102570 msgr2=0x7f23981991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2398102570 0x7f23981991b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f239000ba50 tx=0x7f239000bf10 comp rx=0 tx=0).stop 2024-04-26T20:38:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 -- 172.21.15.70:0/3185477602 shutdown_connections 2024-04-26T20:38:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f23800a3d20 0x7f23800a61e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f239819da70 0x7f239819df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2398106bf0 0x7f23981996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 --2- 172.21.15.70:0/3185477602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2398102570 0x7f23981991b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 -- 172.21.15.70:0/3185477602 >> 172.21.15.70:0/3185477602 conn(0x7f2398076ae0 msgr2=0x7f2398105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 -- 172.21.15.70:0/3185477602 shutdown_connections 2024-04-26T20:38:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.826+0000 7f23a0722640 1 -- 172.21.15.70:0/3185477602 wait complete. 2024-04-26T20:38:01.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T20:38:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.936+0000 7f34ee652640 1 -- 172.21.15.70:0/3183234113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e81021c0 msgr2=0x7f34e810e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.936+0000 7f34ee652640 1 --2- 172.21.15.70:0/3183234113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e81021c0 0x7f34e810e6d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009cd0 tx=0x7f34e002a8e0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.936+0000 7f34ee652640 1 -- 172.21.15.70:0/3183234113 shutdown_connections 2024-04-26T20:38:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.936+0000 7f34ee652640 1 --2- 172.21.15.70:0/3183234113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e81021c0 0x7f34e810e6d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.936+0000 7f34ee652640 1 --2- 172.21.15.70:0/3183234113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e8101800 0x7f34e8101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.936+0000 7f34ee652640 1 --2- 172.21.15.70:0/3183234113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e8107810 0x7f34e8107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.936+0000 7f34ee652640 1 -- 172.21.15.70:0/3183234113 >> 172.21.15.70:0/3183234113 conn(0x7f34e80789e0 msgr2=0x7f34e8078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.936+0000 7f34ee652640 1 -- 172.21.15.70:0/3183234113 shutdown_connections 2024-04-26T20:38:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.936+0000 7f34ee652640 1 -- 172.21.15.70:0/3183234113 wait complete. 2024-04-26T20:38:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.936+0000 7f34ee652640 1 Processor -- start 2024-04-26T20:38:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.936+0000 7f34ee652640 1 -- start start 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ee652640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e8101800 0x7f34e81992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ee652640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e81021c0 0x7f34e8199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ee652640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e8107810 0x7f34e819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ee652640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f34e8112d10 con 0x7f34e8107810 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ee652640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34e8112b90 con 0x7f34e81021c0 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ee652640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f34e8112e90 con 0x7f34e8101800 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ecbef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e8107810 0x7f34e819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ecbef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e8107810 0x7f34e819db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56800/0 (socket says 172.21.15.70:56800) 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ecbef640 1 -- 172.21.15.70:0/2766212258 learned_addr learned my addr 172.21.15.70:0/2766212258 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34e7fff640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e8101800 0x7f34e81992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34e77fe640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e81021c0 0x7f34e8199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ecbef640 1 -- 172.21.15.70:0/2766212258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e8101800 msgr2=0x7f34e81992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ecbef640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e8101800 0x7f34e81992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ecbef640 1 -- 172.21.15.70:0/2766212258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e81021c0 msgr2=0x7f34e8199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ecbef640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e81021c0 0x7f34e8199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ecbef640 1 -- 172.21.15.70:0/2766212258 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e819e2c0 con 0x7f34e8107810 2024-04-26T20:38:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34e77fe640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e81021c0 0x7f34e8199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:38:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34ecbef640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e8107810 0x7f34e819db90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009df0 tx=0x7f34e0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.937+0000 7f34e57fa640 1 -- 172.21.15.70:0/2766212258 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0004040 con 0x7f34e8107810 2024-04-26T20:38:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.938+0000 7f34ee652640 1 -- 172.21.15.70:0/2766212258 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e819e550 con 0x7f34e8107810 2024-04-26T20:38:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.938+0000 7f34e57fa640 1 -- 172.21.15.70:0/2766212258 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f34e00046b0 con 0x7f34e8107810 2024-04-26T20:38:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.938+0000 7f34e57fa640 1 -- 172.21.15.70:0/2766212258 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0045410 con 0x7f34e8107810 2024-04-26T20:38:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.938+0000 7f34ee652640 1 -- 172.21.15.70:0/2766212258 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e81a5e40 con 0x7f34e8107810 2024-04-26T20:38:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.938+0000 7f34ee652640 1 -- 172.21.15.70:0/2766212258 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e80697e0 con 0x7f34e8107810 2024-04-26T20:38:01.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.940+0000 7f34e57fa640 1 -- 172.21.15.70:0/2766212258 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f34e0043020 con 0x7f34e8107810 2024-04-26T20:38:01.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.940+0000 7f34e57fa640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f34d00a3d20 0x7f34d00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:01.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.940+0000 7f34e7fff640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f34d00a3d20 0x7f34d00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:01.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.940+0000 7f34e57fa640 1 -- 172.21.15.70:0/2766212258 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8593+0+0 (secure 0 0 0) 0x7f34e002e030 con 0x7f34e8107810 2024-04-26T20:38:01.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.941+0000 7f34e7fff640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f34d00a3d20 0x7f34d00a61e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009990 tx=0x7f34d8009110 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:01.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:01.944+0000 7f34e57fa640 1 -- 172.21.15.70:0/2766212258 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f34e004a060 con 0x7f34e8107810 2024-04-26T20:38:02.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.159+0000 7f34ee652640 1 -- 172.21.15.70:0/2766212258 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f34e819a620 con 0x7f34e8107810 2024-04-26T20:38:02.162 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:01 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2694008078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:38:02.162 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:01 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1999026782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:38:02.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.162+0000 7f34e57fa640 1 -- 172.21.15.70:0/2766212258 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7f34e819a620 con 0x7f34e8107810 2024-04-26T20:38:02.162 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T20:38:02.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.165+0000 7f34ee652640 1 -- 172.21.15.70:0/2766212258 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f34d00a3d20 msgr2=0x7f34d00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:02.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.165+0000 7f34ee652640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f34d00a3d20 0x7f34d00a61e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009990 tx=0x7f34d8009110 comp rx=0 tx=0).stop 2024-04-26T20:38:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.165+0000 7f34ee652640 1 -- 172.21.15.70:0/2766212258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e8107810 msgr2=0x7f34e819db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.165+0000 7f34ee652640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e8107810 0x7f34e819db90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009df0 tx=0x7f34e0003970 comp rx=0 tx=0).stop 2024-04-26T20:38:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.165+0000 7f34ee652640 1 -- 172.21.15.70:0/2766212258 shutdown_connections 2024-04-26T20:38:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.166+0000 7f34ee652640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f34d00a3d20 0x7f34d00a61e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.166+0000 7f34ee652640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34e8107810 0x7f34e819db90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.166+0000 7f34ee652640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e81021c0 0x7f34e8199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.166+0000 7f34ee652640 1 --2- 172.21.15.70:0/2766212258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e8101800 0x7f34e81992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.166+0000 7f34ee652640 1 -- 172.21.15.70:0/2766212258 >> 172.21.15.70:0/2766212258 conn(0x7f34e80789e0 msgr2=0x7f34e81043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.166+0000 7f34ee652640 1 -- 172.21.15.70:0/2766212258 shutdown_connections 2024-04-26T20:38:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.166+0000 7f34ee652640 1 -- 172.21.15.70:0/2766212258 wait complete. 2024-04-26T20:38:02.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T20:38:02.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:01 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2694008078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:38:02.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:01 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1999026782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:38:02.209 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:01 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2694008078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:38:02.209 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:01 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1999026782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:38:02.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.283+0000 7efc71445640 1 -- 172.21.15.70:0/221896778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc6c107810 msgr2=0x7efc6c107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:02.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.283+0000 7efc71445640 1 --2- 172.21.15.70:0/221896778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc6c107810 0x7efc6c107bf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009930 tx=0x7efc5c02a420 comp rx=0 tx=0).stop 2024-04-26T20:38:02.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.283+0000 7efc71445640 1 -- 172.21.15.70:0/221896778 shutdown_connections 2024-04-26T20:38:02.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.283+0000 7efc71445640 1 --2- 172.21.15.70:0/221896778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6c1021c0 0x7efc6c10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:02.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.283+0000 7efc71445640 1 --2- 172.21.15.70:0/221896778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc6c101800 0x7efc6c101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.283+0000 7efc71445640 1 --2- 172.21.15.70:0/221896778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc6c107810 0x7efc6c107bf0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.283+0000 7efc71445640 1 -- 172.21.15.70:0/221896778 >> 172.21.15.70:0/221896778 conn(0x7efc6c0789e0 msgr2=0x7efc6c078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.283+0000 7efc71445640 1 -- 172.21.15.70:0/221896778 shutdown_connections 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.283+0000 7efc71445640 1 -- 172.21.15.70:0/221896778 wait complete. 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc71445640 1 Processor -- start 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc71445640 1 -- start start 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc71445640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc6c101800 0x7efc6c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc71445640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc6c1021c0 0x7efc6c199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc71445640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6c107810 0x7efc6c19daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc71445640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c112cb0 con 0x7efc6c1021c0 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc71445640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c112b30 con 0x7efc6c107810 2024-04-26T20:38:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc71445640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c112e30 con 0x7efc6c101800 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc627fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc6c1021c0 0x7efc6c199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc627fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc6c1021c0 0x7efc6c199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56832/0 (socket says 172.21.15.70:56832) 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc627fc640 1 -- 172.21.15.70:0/1410259281 learned_addr learned my addr 172.21.15.70:0/1410259281 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc6affd640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc6c101800 0x7efc6c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc627fc640 1 -- 172.21.15.70:0/1410259281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc6c101800 msgr2=0x7efc6c199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc627fc640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc6c101800 0x7efc6c199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc627fc640 1 -- 172.21.15.70:0/1410259281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6c107810 msgr2=0x7efc6c19daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc627fc640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6c107810 0x7efc6c19daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc627fc640 1 -- 172.21.15.70:0/1410259281 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c19e220 con 0x7efc6c1021c0 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.284+0000 7efc6affd640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc6c101800 0x7efc6c199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.285+0000 7efc627fc640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc6c1021c0 0x7efc6c199770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc5400e9f0 tx=0x7efc5400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.285+0000 7efc68ff9640 1 -- 172.21.15.70:0/1410259281 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5400cd80 con 0x7efc6c1021c0 2024-04-26T20:38:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.285+0000 7efc68ff9640 1 -- 172.21.15.70:0/1410259281 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efc540054f0 con 0x7efc6c1021c0 2024-04-26T20:38:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.285+0000 7efc71445640 1 -- 172.21.15.70:0/1410259281 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6c19e510 con 0x7efc6c1021c0 2024-04-26T20:38:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.285+0000 7efc68ff9640 1 -- 172.21.15.70:0/1410259281 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54010690 con 0x7efc6c1021c0 2024-04-26T20:38:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.285+0000 7efc71445640 1 -- 172.21.15.70:0/1410259281 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6c1a5da0 con 0x7efc6c1021c0 2024-04-26T20:38:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.286+0000 7efc71445640 1 -- 172.21.15.70:0/1410259281 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc6c0697e0 con 0x7efc6c1021c0 2024-04-26T20:38:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.287+0000 7efc68ff9640 1 -- 172.21.15.70:0/1410259281 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7efc540046c0 con 0x7efc6c1021c0 2024-04-26T20:38:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.287+0000 7efc68ff9640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7efc580a3d20 0x7efc580a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.287+0000 7efc6affd640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7efc580a3d20 0x7efc580a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.287+0000 7efc68ff9640 1 -- 172.21.15.70:0/1410259281 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8979+0+0 (secure 0 0 0) 0x7efc540d0ea0 con 0x7efc6c1021c0 2024-04-26T20:38:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.288+0000 7efc6affd640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7efc580a3d20 0x7efc580a61e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc5c000c00 tx=0x7efc5c032c30 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:02.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.292+0000 7efc68ff9640 1 -- 172.21.15.70:0/1410259281 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7efc5409d370 con 0x7efc6c1021c0 2024-04-26T20:38:02.469 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e[61590]: ignoring --setuser ceph since I am not root 2024-04-26T20:38:02.469 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e[61590]: ignoring --setgroup ceph since I am not root 2024-04-26T20:38:02.470 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e[61590]: starting mds.e at 2024-04-26T20:38:02.470 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b[62209]: ignoring --setuser ceph since I am not root 2024-04-26T20:38:02.470 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b[62209]: ignoring --setgroup ceph since I am not root 2024-04-26T20:38:02.471 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b[62209]: starting mds.b at 2024-04-26T20:38:02.471 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k[61270]: ignoring --setuser ceph since I am not root 2024-04-26T20:38:02.471 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k[61270]: ignoring --setgroup ceph since I am not root 2024-04-26T20:38:02.471 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-mds[61274]: -- 172.21.15.80:0/446997712 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556e68b0ba40 con 0x556e68ade800 2024-04-26T20:38:02.471 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k[61270]: starting mds.k at 2024-04-26T20:38:02.471 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h[61900]: ignoring --setuser ceph since I am not root 2024-04-26T20:38:02.471 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h[61900]: ignoring --setgroup ceph since I am not root 2024-04-26T20:38:02.471 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-mds[61904]: -- 172.21.15.80:0/3677474138 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ec7bc47a40 con 0x55ec7bc1ac00 2024-04-26T20:38:02.472 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h[61900]: starting mds.h at 2024-04-26T20:38:02.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:02.508+0000 7efc71445640 1 -- 172.21.15.70:0/1410259281 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7efc6c02dad0 con 0x7efc6c1021c0 2024-04-26T20:38:02.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a[29120]: 2024-04-26T20:38:02.160+0000 7f6ee9a52700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:38:02.535 INFO:journalctl@ceph.mds.a.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-a[71148]: starting mds.a at 2024-04-26T20:38:02.535 INFO:journalctl@ceph.mds.g.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-g[70787]: ignoring --setuser ceph since I am not root 2024-04-26T20:38:02.535 INFO:journalctl@ceph.mds.g.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-g[70787]: ignoring --setgroup ceph since I am not root 2024-04-26T20:38:02.535 INFO:journalctl@ceph.mds.g.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-mds[70791]: -- 172.21.15.70:0/1281254312 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d8e1db7a40 con 0x55d8e1d8a800 2024-04-26T20:38:02.535 INFO:journalctl@ceph.mds.g.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-g[70787]: starting mds.g at 2024-04-26T20:38:02.708 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c[63506]: ignoring --setuser ceph since I am not root 2024-04-26T20:38:02.708 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c[63506]: ignoring --setgroup ceph since I am not root 2024-04-26T20:38:02.709 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mds[63510]: -- 172.21.15.98:0/2414066822 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cb797b5a40 con 0x55cb79788c00 2024-04-26T20:38:02.709 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c[63506]: starting mds.c at 2024-04-26T20:38:02.709 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i[63814]: ignoring --setuser ceph since I am not root 2024-04-26T20:38:02.709 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i[63814]: ignoring --setgroup ceph since I am not root 2024-04-26T20:38:02.709 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mds[63818]: -- 172.21.15.98:0/473663994 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559117673a40 con 0x559117646800 2024-04-26T20:38:02.709 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i[63814]: starting mds.i at 2024-04-26T20:38:02.709 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l[62884]: ignoring --setuser ceph since I am not root 2024-04-26T20:38:02.710 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l[62884]: ignoring --setgroup ceph since I am not root 2024-04-26T20:38:02.710 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mds[62888]: -- 172.21.15.98:0/2993049699 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c13f3a5a40 con 0x55c13f378800 2024-04-26T20:38:02.710 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l[62884]: starting mds.l at 2024-04-26T20:38:02.710 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f[63184]: ignoring --setuser ceph since I am not root 2024-04-26T20:38:02.710 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f[63184]: ignoring --setgroup ceph since I am not root 2024-04-26T20:38:02.710 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mds[63188]: -- 172.21.15.98:0/2679454807 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a738509a40 con 0x55a7384dd000 2024-04-26T20:38:02.710 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f[63184]: starting mds.f at 2024-04-26T20:38:03.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.164+0000 7efc68ff9640 1 -- 172.21.15.70:0/1410259281 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7efc540870a0 con 0x7efc6c1021c0 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 -- 172.21.15.70:0/1410259281 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7efc580a3d20 msgr2=0x7efc580a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7efc580a3d20 0x7efc580a61e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc5c000c00 tx=0x7efc5c032c30 comp rx=0 tx=0).stop 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 -- 172.21.15.70:0/1410259281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc6c1021c0 msgr2=0x7efc6c199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc6c1021c0 0x7efc6c199770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc5400e9f0 tx=0x7efc5400edf0 comp rx=0 tx=0).stop 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 -- 172.21.15.70:0/1410259281 shutdown_connections 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7efc580a3d20 0x7efc580a61e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6c107810 0x7efc6c19daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc6c1021c0 0x7efc6c199770 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 --2- 172.21.15.70:0/1410259281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc6c101800 0x7efc6c199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 -- 172.21.15.70:0/1410259281 >> 172.21.15.70:0/1410259281 conn(0x7efc6c0789e0 msgr2=0x7efc6c104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 -- 172.21.15.70:0/1410259281 shutdown_connections 2024-04-26T20:38:03.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.167+0000 7efc71445640 1 -- 172.21.15.70:0/1410259281 wait complete. 2024-04-26T20:38:03.182 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-mon[29124]: pgmap v332: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:38:03.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/3185477602' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:38:03.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2766212258' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-26T20:38:03.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-mon[29124]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T20:38:03.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-mon[29124]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:38:03.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2766212258' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-26T20:38:03.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-mon[29124]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T20:38:03.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-mon[29124]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-26T20:38:03.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:02 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1410259281' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:38:03.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T20:38:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mon[32591]: pgmap v332: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:38:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/3185477602' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:38:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2766212258' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-26T20:38:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mon[32591]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T20:38:03.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mon[32591]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:38:03.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2766212258' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-26T20:38:03.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mon[32591]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T20:38:03.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mon[32591]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-26T20:38:03.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:02 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1410259281' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:38:03.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-mon[32278]: pgmap v332: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T20:38:03.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/3185477602' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:38:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2766212258' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-26T20:38:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-mon[32278]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T20:38:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-mon[32278]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:38:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2766212258' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-26T20:38:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-mon[32278]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T20:38:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-mon[32278]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-26T20:38:03.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:02 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1410259281' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:38:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.286+0000 7f7b56693640 1 -- 172.21.15.70:0/1551467448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b50101800 msgr2=0x7f7b50101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.286+0000 7f7b56693640 1 --2- 172.21.15.70:0/1551467448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b50101800 0x7f7b50101c80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009930 tx=0x7f7b4402a420 comp rx=0 tx=0).stop 2024-04-26T20:38:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.286+0000 7f7b56693640 1 -- 172.21.15.70:0/1551467448 shutdown_connections 2024-04-26T20:38:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.286+0000 7f7b56693640 1 --2- 172.21.15.70:0/1551467448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b501021c0 0x7f7b5010e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.286+0000 7f7b56693640 1 --2- 172.21.15.70:0/1551467448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b50101800 0x7f7b50101c80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.286+0000 7f7b56693640 1 --2- 172.21.15.70:0/1551467448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b50107810 0x7f7b50107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.286+0000 7f7b56693640 1 -- 172.21.15.70:0/1551467448 >> 172.21.15.70:0/1551467448 conn(0x7f7b50078920 msgr2=0x7f7b50078d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.286+0000 7f7b56693640 1 -- 172.21.15.70:0/1551467448 shutdown_connections 2024-04-26T20:38:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.286+0000 7f7b56693640 1 -- 172.21.15.70:0/1551467448 wait complete. 2024-04-26T20:38:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.286+0000 7f7b56693640 1 Processor -- start 2024-04-26T20:38:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.286+0000 7f7b56693640 1 -- start start 2024-04-26T20:38:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b56693640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b50101800 0x7f7b501981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b56693640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b501021c0 0x7f7b50198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b56693640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b50107810 0x7f7b5019caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b56693640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7b50111c80 con 0x7f7b501021c0 2024-04-26T20:38:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b56693640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7b50111b00 con 0x7f7b50101800 2024-04-26T20:38:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b56693640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7b50111e00 con 0x7f7b50107810 2024-04-26T20:38:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b501021c0 0x7f7b50198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b501021c0 0x7f7b50198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56852/0 (socket says 172.21.15.70:56852) 2024-04-26T20:38:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4f7fe640 1 -- 172.21.15.70:0/2502979461 learned_addr learned my addr 172.21.15.70:0/2502979461 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:38:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4ffff640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b50101800 0x7f7b501981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b54c30640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b50107810 0x7f7b5019caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4f7fe640 1 -- 172.21.15.70:0/2502979461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b50107810 msgr2=0x7f7b5019caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4f7fe640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b50107810 0x7f7b5019caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4f7fe640 1 -- 172.21.15.70:0/2502979461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b50101800 msgr2=0x7f7b501981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4f7fe640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b50101800 0x7f7b501981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4f7fe640 1 -- 172.21.15.70:0/2502979461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5019d1d0 con 0x7f7b501021c0 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4ffff640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b50101800 0x7f7b501981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4f7fe640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b501021c0 0x7f7b50198720 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7b4402a940 tx=0x7f7b44003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4d7fa640 1 -- 172.21.15.70:0/2502979461 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44035070 con 0x7f7b501021c0 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b56693640 1 -- 172.21.15.70:0/2502979461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5019d460 con 0x7f7b501021c0 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.287+0000 7f7b4d7fa640 1 -- 172.21.15.70:0/2502979461 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b44031bf0 con 0x7f7b501021c0 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.288+0000 7f7b4d7fa640 1 -- 172.21.15.70:0/2502979461 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44038dd0 con 0x7f7b501021c0 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.288+0000 7f7b56693640 1 -- 172.21.15.70:0/2502979461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b5006b020 con 0x7f7b501021c0 2024-04-26T20:38:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.288+0000 7f7b56693640 1 -- 172.21.15.70:0/2502979461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b50102f40 con 0x7f7b501021c0 2024-04-26T20:38:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.290+0000 7f7b4d7fa640 1 -- 172.21.15.70:0/2502979461 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f7b44038500 con 0x7f7b501021c0 2024-04-26T20:38:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.290+0000 7f7b4d7fa640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f7b380a3d20 0x7f7b380a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.290+0000 7f7b4ffff640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f7b380a3d20 0x7f7b380a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.290+0000 7f7b4d7fa640 1 -- 172.21.15.70:0/2502979461 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8979+0+0 (secure 0 0 0) 0x7f7b440f2df0 con 0x7f7b501021c0 2024-04-26T20:38:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.291+0000 7f7b4ffff640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f7b380a3d20 0x7f7b380a61e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b40006fd0 tx=0x7f7b40008040 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.294+0000 7f7b4d7fa640 1 -- 172.21.15.70:0/2502979461 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7b440bf2c0 con 0x7f7b501021c0 2024-04-26T20:38:03.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:03.469+0000 7f7b56693640 1 -- 172.21.15.70:0/2502979461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7b5006ba40 con 0x7f7b501021c0 2024-04-26T20:38:04.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.165+0000 7f7b4d7fa640 1 -- 172.21.15.70:0/2502979461 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) ==== 181+0+0 (secure 0 0 0) 0x7f7b440bebc0 con 0x7f7b501021c0 2024-04-26T20:38:04.167 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2024-04-26T20:38:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 -- 172.21.15.70:0/2502979461 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f7b380a3d20 msgr2=0x7f7b380a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f7b380a3d20 0x7f7b380a61e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b40006fd0 tx=0x7f7b40008040 comp rx=0 tx=0).stop 2024-04-26T20:38:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 -- 172.21.15.70:0/2502979461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b501021c0 msgr2=0x7f7b50198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b501021c0 0x7f7b50198720 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7b4402a940 tx=0x7f7b44003d60 comp rx=0 tx=0).stop 2024-04-26T20:38:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 -- 172.21.15.70:0/2502979461 shutdown_connections 2024-04-26T20:38:04.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f7b380a3d20 0x7f7b380a61e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:04.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b50107810 0x7f7b5019caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:04.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b501021c0 0x7f7b50198720 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 --2- 172.21.15.70:0/2502979461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b50101800 0x7f7b501981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 -- 172.21.15.70:0/2502979461 >> 172.21.15.70:0/2502979461 conn(0x7f7b50078920 msgr2=0x7f7b50104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 -- 172.21.15.70:0/2502979461 shutdown_connections 2024-04-26T20:38:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.169+0000 7f7b56693640 1 -- 172.21.15.70:0/2502979461 wait complete. 2024-04-26T20:38:04.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T20:38:04.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T20:38:04.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: Cluster is now healthy 2024-04-26T20:38:04.184 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1410259281' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:38:04.184 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.80:6832/706345114,v1:172.21.15.80:6833/706345114] up:boot 2024-04-26T20:38:04.184 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.80:6834/2801695626,v1:172.21.15.80:6835/2801695626] up:boot 2024-04-26T20:38:04.184 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.70:6838/4268087742,v1:172.21.15.70:6840/4268087742] up:boot 2024-04-26T20:38:04.184 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.98:6832/3441533673,v1:172.21.15.98:6834/3441533673] up:boot 2024-04-26T20:38:04.184 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.70:6839/1929419136,v1:172.21.15.70:6841/1929419136] up:boot 2024-04-26T20:38:04.185 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.98:6833/1563033706,v1:172.21.15.98:6835/1563033706] up:boot 2024-04-26T20:38:04.185 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.98:6837/2668255024,v1:172.21.15.98:6839/2668255024] up:boot 2024-04-26T20:38:04.185 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.98:6836/2704058630,v1:172.21.15.98:6838/2704058630] up:boot 2024-04-26T20:38:04.185 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.80:6836/3117461468,v1:172.21.15.80:6837/3117461468] up:boot 2024-04-26T20:38:04.185 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: mds.? [v2:172.21.15.80:6838/3570343476,v1:172.21.15.80:6839/3570343476] up:boot 2024-04-26T20:38:04.185 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: fsmap 12 up:standby 2024-04-26T20:38:04.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:38:04.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:38:04.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:38:04.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:38:04.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:38:04.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:38:04.187 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:38:04.187 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:38:04.187 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:38:04.187 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:38:04.187 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:03 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2502979461' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:38:04.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T20:38:04.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T20:38:04.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T20:38:04.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: Cluster is now healthy 2024-04-26T20:38:04.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1410259281' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:38:04.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.80:6832/706345114,v1:172.21.15.80:6833/706345114] up:boot 2024-04-26T20:38:04.209 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.80:6834/2801695626,v1:172.21.15.80:6835/2801695626] up:boot 2024-04-26T20:38:04.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.70:6838/4268087742,v1:172.21.15.70:6840/4268087742] up:boot 2024-04-26T20:38:04.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.98:6832/3441533673,v1:172.21.15.98:6834/3441533673] up:boot 2024-04-26T20:38:04.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.70:6839/1929419136,v1:172.21.15.70:6841/1929419136] up:boot 2024-04-26T20:38:04.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.98:6833/1563033706,v1:172.21.15.98:6835/1563033706] up:boot 2024-04-26T20:38:04.210 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.98:6837/2668255024,v1:172.21.15.98:6839/2668255024] up:boot 2024-04-26T20:38:04.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.98:6836/2704058630,v1:172.21.15.98:6838/2704058630] up:boot 2024-04-26T20:38:04.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.80:6836/3117461468,v1:172.21.15.80:6837/3117461468] up:boot 2024-04-26T20:38:04.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: mds.? [v2:172.21.15.80:6838/3570343476,v1:172.21.15.80:6839/3570343476] up:boot 2024-04-26T20:38:04.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: fsmap 12 up:standby 2024-04-26T20:38:04.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:38:04.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:38:04.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:38:04.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:38:04.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:38:04.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:38:04.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:38:04.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:38:04.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:38:04.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:38:04.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:03 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2502979461' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:38:04.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T20:38:04.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T20:38:04.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: Cluster is now healthy 2024-04-26T20:38:04.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1410259281' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:38:04.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.80:6832/706345114,v1:172.21.15.80:6833/706345114] up:boot 2024-04-26T20:38:04.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.80:6834/2801695626,v1:172.21.15.80:6835/2801695626] up:boot 2024-04-26T20:38:04.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.70:6838/4268087742,v1:172.21.15.70:6840/4268087742] up:boot 2024-04-26T20:38:04.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.98:6832/3441533673,v1:172.21.15.98:6834/3441533673] up:boot 2024-04-26T20:38:04.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.70:6839/1929419136,v1:172.21.15.70:6841/1929419136] up:boot 2024-04-26T20:38:04.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.98:6833/1563033706,v1:172.21.15.98:6835/1563033706] up:boot 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.98:6837/2668255024,v1:172.21.15.98:6839/2668255024] up:boot 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.98:6836/2704058630,v1:172.21.15.98:6838/2704058630] up:boot 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.80:6836/3117461468,v1:172.21.15.80:6837/3117461468] up:boot 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: mds.? [v2:172.21.15.80:6838/3570343476,v1:172.21.15.80:6839/3570343476] up:boot 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: fsmap 12 up:standby 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:38:04.221 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:38:04.222 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='mgr.15333 172.21.15.70:0/2393155365' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:38:04.222 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:03 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2502979461' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:38:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.295+0000 7f01f9af9640 1 -- 172.21.15.70:0/1335574096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f410cf00 msgr2=0x7f01f410f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.295+0000 7f01f9af9640 1 --2- 172.21.15.70:0/1335574096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f410cf00 0x7f01f410f3a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009ca0 tx=0x7f01ec02a9e0 comp rx=0 tx=0).stop 2024-04-26T20:38:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.295+0000 7f01f9af9640 1 -- 172.21.15.70:0/1335574096 shutdown_connections 2024-04-26T20:38:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.295+0000 7f01f9af9640 1 --2- 172.21.15.70:0/1335574096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f410cf00 0x7f01f410f3a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.295+0000 7f01f9af9640 1 --2- 172.21.15.70:0/1335574096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f41044e0 0x7f01f410c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.295+0000 7f01f9af9640 1 --2- 172.21.15.70:0/1335574096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01f4103bc0 0x7f01f4103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:04.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.295+0000 7f01f9af9640 1 -- 172.21.15.70:0/1335574096 >> 172.21.15.70:0/1335574096 conn(0x7f01f4078950 msgr2=0x7f01f4078d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:04.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.295+0000 7f01f9af9640 1 -- 172.21.15.70:0/1335574096 shutdown_connections 2024-04-26T20:38:04.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.295+0000 7f01f9af9640 1 -- 172.21.15.70:0/1335574096 wait complete. 2024-04-26T20:38:04.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f9af9640 1 Processor -- start 2024-04-26T20:38:04.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f9af9640 1 -- start start 2024-04-26T20:38:04.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f9af9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01f4103bc0 0x7f01f41990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:04.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f9af9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f41044e0 0x7f01f41995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:04.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f9af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f410cf00 0x7f01f419d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:04.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f9af9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4112cd0 con 0x7f01f410cf00 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f9af9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4112b50 con 0x7f01f41044e0 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f9af9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4112e50 con 0x7f01f4103bc0 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f410cf00 0x7f01f419d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f410cf00 0x7f01f419d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56874/0 (socket says 172.21.15.70:56874) 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f3fff640 1 -- 172.21.15.70:0/1839543679 learned_addr learned my addr 172.21.15.70:0/1839543679 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f37fe640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01f4103bc0 0x7f01f41990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f2ffd640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f41044e0 0x7f01f41995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f3fff640 1 -- 172.21.15.70:0/1839543679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01f4103bc0 msgr2=0x7f01f41990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f3fff640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01f4103bc0 0x7f01f41990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f3fff640 1 -- 172.21.15.70:0/1839543679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f41044e0 msgr2=0x7f01f41995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f3fff640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f41044e0 0x7f01f41995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.296+0000 7f01f3fff640 1 -- 172.21.15.70:0/1839543679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f419e0a0 con 0x7f01f410cf00 2024-04-26T20:38:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.297+0000 7f01f3fff640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f410cf00 0x7f01f419d970 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f01ec004af0 tx=0x7f01ec003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:04.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.297+0000 7f01f0ff9640 1 -- 172.21.15.70:0/1839543679 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec047070 con 0x7f01f410cf00 2024-04-26T20:38:04.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.297+0000 7f01f9af9640 1 -- 172.21.15.70:0/1839543679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f419e330 con 0x7f01f410cf00 2024-04-26T20:38:04.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.297+0000 7f01f0ff9640 1 -- 172.21.15.70:0/1839543679 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01ec02fb10 con 0x7f01f410cf00 2024-04-26T20:38:04.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.297+0000 7f01f0ff9640 1 -- 172.21.15.70:0/1839543679 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec033050 con 0x7f01f410cf00 2024-04-26T20:38:04.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.297+0000 7f01f9af9640 1 -- 172.21.15.70:0/1839543679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f41a5c20 con 0x7f01f410cf00 2024-04-26T20:38:04.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.298+0000 7f01f9af9640 1 -- 172.21.15.70:0/1839543679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f406b820 con 0x7f01f410cf00 2024-04-26T20:38:04.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.299+0000 7f01f0ff9640 1 -- 172.21.15.70:0/1839543679 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f01ec04a070 con 0x7f01f410cf00 2024-04-26T20:38:04.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.299+0000 7f01f0ff9640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f01dc0a3d20 0x7f01dc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:38:04.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.299+0000 7f01f37fe640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f01dc0a3d20 0x7f01dc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:38:04.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.299+0000 7f01f0ff9640 1 -- 172.21.15.70:0/1839543679 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8417+0+0 (secure 0 0 0) 0x7f01ec0f1430 con 0x7f01f410cf00 2024-04-26T20:38:04.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.300+0000 7f01f37fe640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f01dc0a3d20 0x7f01dc0a61e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f01e8005fd0 tx=0x7f01e800b390 comp rx=0 tx=0).ready entity=mgr.15333 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:38:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.304+0000 7f01f0ff9640 1 -- 172.21.15.70:0/1839543679 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f01ec07f060 con 0x7f01f410cf00 2024-04-26T20:38:04.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:04.481+0000 7f01f9af9640 1 -- 172.21.15.70:0/1839543679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f01f41a5df0 con 0x7f01f410cf00 2024-04-26T20:38:05.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.167+0000 7f01f0ff9640 1 -- 172.21.15.70:0/1839543679 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) ==== 169+0+0 (secure 0 0 0) 0x7f01ec0bdb30 con 0x7f01f410cf00 2024-04-26T20:38:05.168 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2024-04-26T20:38:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 -- 172.21.15.70:0/1839543679 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f01dc0a3d20 msgr2=0x7f01dc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f01dc0a3d20 0x7f01dc0a61e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f01e8005fd0 tx=0x7f01e800b390 comp rx=0 tx=0).stop 2024-04-26T20:38:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 -- 172.21.15.70:0/1839543679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f410cf00 msgr2=0x7f01f419d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:38:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f410cf00 0x7f01f419d970 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f01ec004af0 tx=0x7f01ec003bf0 comp rx=0 tx=0).stop 2024-04-26T20:38:05.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 -- 172.21.15.70:0/1839543679 shutdown_connections 2024-04-26T20:38:05.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.70:6800/212113189,v1:172.21.15.70:6801/212113189] conn(0x7f01dc0a3d20 0x7f01dc0a61e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:05.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f410cf00 0x7f01f419d970 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:05.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f41044e0 0x7f01f41995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:05.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 --2- 172.21.15.70:0/1839543679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01f4103bc0 0x7f01f41990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:38:05.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 -- 172.21.15.70:0/1839543679 >> 172.21.15.70:0/1839543679 conn(0x7f01f4078950 msgr2=0x7f01f40fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:38:05.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 -- 172.21.15.70:0/1839543679 shutdown_connections 2024-04-26T20:38:05.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T20:38:05.170+0000 7f01f9af9640 1 -- 172.21.15.70:0/1839543679 wait complete. 2024-04-26T20:38:05.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:04 smithi070 ceph-mon[29124]: pgmap v334: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:38:05.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:04 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/2502979461' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T20:38:05.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:04 smithi070 ceph-mon[29124]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T20:38:05.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:04 smithi070 ceph-mon[29124]: from='client.? 172.21.15.70:0/1839543679' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:38:05.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:38:05.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:04 smithi098 ceph-mon[32591]: pgmap v334: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:38:05.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:04 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/2502979461' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T20:38:05.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:04 smithi098 ceph-mon[32591]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T20:38:05.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:04 smithi098 ceph-mon[32591]: from='client.? 172.21.15.70:0/1839543679' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:38:05.211 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:38:05.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:04 smithi080 ceph-mon[32278]: pgmap v334: 97 pgs: 97 active+clean; 140 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:38:05.219 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:04 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/2502979461' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T20:38:05.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:04 smithi080 ceph-mon[32278]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T20:38:05.220 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:04 smithi080 ceph-mon[32278]: from='client.? 172.21.15.70:0/1839543679' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:38:05.242 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:38:05.272 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-26T20:38:05.272 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T20:38:05.287 DEBUG:teuthology.orchestra.run.smithi080:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T20:38:05.302 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T20:38:05.328 INFO:tasks.cephadm:Stopping all daemons... 2024-04-26T20:38:05.328 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-26T20:38:05.328 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.a 2024-04-26T20:38:05.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:05 smithi070 systemd[1]: Stopping Ceph mon.a for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:06.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a[29120]: 2024-04-26T20:38:05.630+0000 7f6eef25d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:06.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a[29120]: 2024-04-26T20:38:05.630+0000 7f6eef25d700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-26T20:38:06.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:05 smithi070 podman[87398]: 2024-04-26 20:38:05.876120973 +0000 UTC m=+0.361145532 container died add84205b42ce68c4672f0303eaf68c11c16d818f5d0887cdd7c970fd225e35a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-04-26T20:38:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:06 smithi070 podman[87398]: 2024-04-26 20:38:06.28139527 +0000 UTC m=+0.766419831 container cleanup add84205b42ce68c4672f0303eaf68c11c16d818f5d0887cdd7c970fd225e35a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:38:06.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Apr 26 20:38:06 smithi070 bash[87398]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-a 2024-04-26T20:38:06.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.a.service' 2024-04-26T20:38:06.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:06.899 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-26T20:38:06.899 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-26T20:38:06.900 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.b 2024-04-26T20:38:07.204 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:06 smithi080 systemd[1]: Stopping Ceph mon.b for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:07.469 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:07 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-b[32274]: 2024-04-26T20:38:07.203+0000 7f5aab0c2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:07.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:07 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-b[32274]: 2024-04-26T20:38:07.203+0000 7f5aab0c2700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-26T20:38:07.470 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:07 smithi080 podman[67695]: 2024-04-26 20:38:07.224472093 +0000 UTC m=+0.136129887 container died 370a2df9f6d978e9fcd7e4e7f988724ca83800935b1d2d4595c68cb27ee58e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:38:07.882 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:07 smithi080 podman[67695]: 2024-04-26 20:38:07.630288865 +0000 UTC m=+0.541946669 container cleanup 370a2df9f6d978e9fcd7e4e7f988724ca83800935b1d2d4595c68cb27ee58e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:38:07.882 INFO:journalctl@ceph.mon.b.smithi080.stdout:Apr 26 20:38:07 smithi080 bash[67695]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-b 2024-04-26T20:38:08.043 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.b.service' 2024-04-26T20:38:08.091 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:08.091 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-26T20:38:08.091 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-26T20:38:08.092 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.c 2024-04-26T20:38:08.406 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:08 smithi098 systemd[1]: Stopping Ceph mon.c for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:08.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:08 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-c[32584]: 2024-04-26T20:38:08.405+0000 7f4c0d03f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:08.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:08 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-c[32584]: 2024-04-26T20:38:08.405+0000 7f4c0d03f700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-26T20:38:08.708 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:08 smithi098 podman[69285]: 2024-04-26 20:38:08.549363882 +0000 UTC m=+0.265573554 container died fc5a964d39891b78083d5ba0e0ba046558d398a52d6535ced6e3f1d5dc317f4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-c, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-26T20:38:09.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:08 smithi098 podman[69285]: 2024-04-26 20:38:08.941090272 +0000 UTC m=+0.657299947 container cleanup fc5a964d39891b78083d5ba0e0ba046558d398a52d6535ced6e3f1d5dc317f4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2) 2024-04-26T20:38:09.208 INFO:journalctl@ceph.mon.c.smithi098.stdout:Apr 26 20:38:08 smithi098 bash[69285]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mon-c 2024-04-26T20:38:09.367 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mon.c.service' 2024-04-26T20:38:09.418 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:09.418 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-26T20:38:09.418 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-26T20:38:09.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.x 2024-04-26T20:38:09.773 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:38:09 smithi070 systemd[1]: Stopping Ceph mgr.x for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:10.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:38:09 smithi070 podman[87520]: 2024-04-26 20:38:09.775474966 +0000 UTC m=+0.164750451 container died 9c91667f298040849b2512114f964a4b0787d5de81b8b4309e7b3b32640338b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-26T20:38:10.447 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:38:10 smithi070 podman[87520]: 2024-04-26 20:38:10.195118579 +0000 UTC m=+0.584394054 container cleanup 9c91667f298040849b2512114f964a4b0787d5de81b8b4309e7b3b32640338b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:38:10.447 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Apr 26 20:38:10 smithi070 bash[87520]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-x 2024-04-26T20:38:10.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.x.service' 2024-04-26T20:38:10.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:10.702 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-26T20:38:10.702 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-26T20:38:10.702 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.y 2024-04-26T20:38:11.047 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:38:10 smithi080 systemd[1]: Stopping Ceph mgr.y for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:11.361 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:38:11 smithi080 podman[67817]: 2024-04-26 20:38:11.047095586 +0000 UTC m=+0.152372584 container died 19002b95cc562f06195983f2094d3daa05b6a13a1ba52df44781ba932f8fd35a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS) 2024-04-26T20:38:11.696 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:38:11 smithi080 podman[67817]: 2024-04-26 20:38:11.45231045 +0000 UTC m=+0.557587447 container cleanup 19002b95cc562f06195983f2094d3daa05b6a13a1ba52df44781ba932f8fd35a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-26T20:38:11.696 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Apr 26 20:38:11 smithi080 bash[67817]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-y 2024-04-26T20:38:11.821 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.y.service' 2024-04-26T20:38:11.853 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:11.853 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-26T20:38:11.853 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-26T20:38:11.853 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.z 2024-04-26T20:38:12.187 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:38:11 smithi098 systemd[1]: Stopping Ceph mgr.z for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:12.458 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:38:12 smithi098 podman[69409]: 2024-04-26 20:38:12.186404163 +0000 UTC m=+0.145523149 container died b82314337253928e117005c64db48eadad517bc8e00af65fd633d8feaea08ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux ) 2024-04-26T20:38:12.843 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:38:12 smithi098 podman[69409]: 2024-04-26 20:38:12.591067756 +0000 UTC m=+0.550186744 container cleanup b82314337253928e117005c64db48eadad517bc8e00af65fd633d8feaea08ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-04-26T20:38:12.843 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Apr 26 20:38:12 smithi098 bash[69409]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mgr-z 2024-04-26T20:38:13.008 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mgr.z.service' 2024-04-26T20:38:13.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:13.042 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-26T20:38:13.042 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-26T20:38:13.042 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.0 2024-04-26T20:38:13.344 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:13 smithi070 systemd[1]: Stopping Ceph osd.0 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:13.785 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:13 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0[43900]: 2024-04-26T20:38:13.343+0000 7fe943f87700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:13.785 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:13 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0[43900]: 2024-04-26T20:38:13.343+0000 7fe943f87700 -1 osd.0 100 *** Got signal Terminated *** 2024-04-26T20:38:13.785 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:13 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0[43900]: 2024-04-26T20:38:13.343+0000 7fe943f87700 -1 osd.0 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:38:19.035 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:18 smithi070 podman[87642]: 2024-04-26 20:38:18.694004845 +0000 UTC m=+5.465168746 container died 1e59bcaec0d2574cb6d8627ca6a5dc044f2188712e17806a9a00f24a4fcc167f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-26T20:38:19.520 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:19 smithi070 podman[87642]: 2024-04-26 20:38:19.201600255 +0000 UTC m=+5.972764160 container cleanup 1e59bcaec0d2574cb6d8627ca6a5dc044f2188712e17806a9a00f24a4fcc167f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-26T20:38:19.521 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:19 smithi070 bash[87642]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0 2024-04-26T20:38:19.784 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:19 smithi070 podman[87659]: 2024-04-26 20:38:19.520747532 +0000 UTC m=+0.825718299 container remove 1e59bcaec0d2574cb6d8627ca6a5dc044f2188712e17806a9a00f24a4fcc167f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-04-26T20:38:20.116 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:19 smithi070 podman[87754]: 2024-04-26 20:38:19.7764209 +0000 UTC m=+0.018173232 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:38:20.116 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:19 smithi070 podman[87754]: 2024-04-26 20:38:19.888509401 +0000 UTC m=+0.130261758 container create 77b46d1e3713cdf26b75ea477fe04122a8b199335f85b5d1e796b60e2018dc27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:38:20.116 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:20 smithi070 podman[87754]: 2024-04-26 20:38:20.116262484 +0000 UTC m=+0.358014799 container init 77b46d1e3713cdf26b75ea477fe04122a8b199335f85b5d1e796b60e2018dc27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-26T20:38:20.414 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:20 smithi070 podman[87754]: 2024-04-26 20:38:20.119441601 +0000 UTC m=+0.361193917 container start 77b46d1e3713cdf26b75ea477fe04122a8b199335f85b5d1e796b60e2018dc27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5) 2024-04-26T20:38:20.414 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:20 smithi070 podman[87754]: 2024-04-26 20:38:20.241550163 +0000 UTC m=+0.483302492 container attach 77b46d1e3713cdf26b75ea477fe04122a8b199335f85b5d1e796b60e2018dc27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-26T20:38:20.769 INFO:journalctl@ceph.osd.0.smithi070.stdout:Apr 26 20:38:20 smithi070 podman[87754]: 2024-04-26 20:38:20.414328549 +0000 UTC m=+0.656080868 container died 77b46d1e3713cdf26b75ea477fe04122a8b199335f85b5d1e796b60e2018dc27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-26T20:38:21.121 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.0.service' 2024-04-26T20:38:21.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:21.161 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-26T20:38:21.161 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-26T20:38:21.161 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.1 2024-04-26T20:38:21.469 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:21 smithi080 systemd[1]: Stopping Ceph osd.1 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:21.969 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:21 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1[36856]: 2024-04-26T20:38:21.531+0000 7fa6751a8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:21.970 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:21 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1[36856]: 2024-04-26T20:38:21.531+0000 7fa6751a8700 -1 osd.1 100 *** Got signal Terminated *** 2024-04-26T20:38:21.970 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:21 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1[36856]: 2024-04-26T20:38:21.531+0000 7fa6751a8700 -1 osd.1 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:38:27.220 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:26 smithi080 podman[67944]: 2024-04-26 20:38:26.903594931 +0000 UTC m=+5.558583474 container died 124032a0c7392bce4a1ea699db811d5e25b49cc914f24078bba1ed41ea5f4c87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:38:27.684 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:27 smithi080 podman[67944]: 2024-04-26 20:38:27.390478737 +0000 UTC m=+6.045467287 container cleanup 124032a0c7392bce4a1ea699db811d5e25b49cc914f24078bba1ed41ea5f4c87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-26T20:38:27.684 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:27 smithi080 bash[67944]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1 2024-04-26T20:38:27.969 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:27 smithi080 podman[67964]: 2024-04-26 20:38:27.68404639 +0000 UTC m=+0.775048080 container remove 124032a0c7392bce4a1ea699db811d5e25b49cc914f24078bba1ed41ea5f4c87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:38:28.271 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:27 smithi080 podman[68054]: 2024-04-26 20:38:27.89343832 +0000 UTC m=+0.018034889 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:38:28.271 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:28 smithi080 podman[68054]: 2024-04-26 20:38:28.026898861 +0000 UTC m=+0.151495434 container create 3840f47865ee2c5755e419d28c57a4dcfea6e058dcd35bde6f3638d437cfc9a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True) 2024-04-26T20:38:28.271 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:28 smithi080 podman[68054]: 2024-04-26 20:38:28.271272512 +0000 UTC m=+0.395869040 container init 3840f47865ee2c5755e419d28c57a4dcfea6e058dcd35bde6f3638d437cfc9a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:38:28.568 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:28 smithi080 podman[68054]: 2024-04-26 20:38:28.274537601 +0000 UTC m=+0.399134138 container start 3840f47865ee2c5755e419d28c57a4dcfea6e058dcd35bde6f3638d437cfc9a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T20:38:28.569 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:28 smithi080 podman[68054]: 2024-04-26 20:38:28.380028406 +0000 UTC m=+0.504624934 container attach 3840f47865ee2c5755e419d28c57a4dcfea6e058dcd35bde6f3638d437cfc9a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-04-26T20:38:28.866 INFO:journalctl@ceph.osd.1.smithi080.stdout:Apr 26 20:38:28 smithi080 podman[68054]: 2024-04-26 20:38:28.568566388 +0000 UTC m=+0.693162920 container died 3840f47865ee2c5755e419d28c57a4dcfea6e058dcd35bde6f3638d437cfc9a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:38:29.222 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.1.service' 2024-04-26T20:38:29.260 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:29.261 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-26T20:38:29.261 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-26T20:38:29.261 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.2 2024-04-26T20:38:29.566 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:29 smithi098 systemd[1]: Stopping Ceph osd.2 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:29.908 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:29 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2[37735]: 2024-04-26T20:38:29.561+0000 7f3aa98ef700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:29.908 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:29 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2[37735]: 2024-04-26T20:38:29.561+0000 7f3aa98ef700 -1 osd.2 100 *** Got signal Terminated *** 2024-04-26T20:38:29.908 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:29 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2[37735]: 2024-04-26T20:38:29.561+0000 7f3aa98ef700 -1 osd.2 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:38:35.208 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:34 smithi098 podman[69531]: 2024-04-26 20:38:34.876339077 +0000 UTC m=+5.428523687 container died 634e6c184481d7ca79365ba157586022dfb4ee067d5d4fbd3b7f3c517ae47bf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T20:38:35.649 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:35 smithi098 podman[69531]: 2024-04-26 20:38:35.405569266 +0000 UTC m=+5.957753883 container cleanup 634e6c184481d7ca79365ba157586022dfb4ee067d5d4fbd3b7f3c517ae47bf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T20:38:35.649 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:35 smithi098 bash[69531]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2 2024-04-26T20:38:35.958 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:35 smithi098 podman[69560]: 2024-04-26 20:38:35.64890729 +0000 UTC m=+0.773514131 container remove 634e6c184481d7ca79365ba157586022dfb4ee067d5d4fbd3b7f3c517ae47bf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:38:36.412 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:36 smithi098 podman[69651]: 2024-04-26 20:38:35.977071495 +0000 UTC m=+0.017617285 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:38:36.412 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:36 smithi098 podman[69651]: 2024-04-26 20:38:36.083397053 +0000 UTC m=+0.123942844 container create 681db276abb271f3c6651b22cde0181f8c484e2aaf661e4f19e4e7864357d0c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424) 2024-04-26T20:38:36.412 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:36 smithi098 podman[69651]: 2024-04-26 20:38:36.303161099 +0000 UTC m=+0.343706894 container init 681db276abb271f3c6651b22cde0181f8c484e2aaf661e4f19e4e7864357d0c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-26T20:38:36.412 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:36 smithi098 podman[69651]: 2024-04-26 20:38:36.306215552 +0000 UTC m=+0.346761355 container start 681db276abb271f3c6651b22cde0181f8c484e2aaf661e4f19e4e7864357d0c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-26T20:38:36.412 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:36 smithi098 podman[69651]: 2024-04-26 20:38:36.411709888 +0000 UTC m=+0.452255690 container attach 681db276abb271f3c6651b22cde0181f8c484e2aaf661e4f19e4e7864357d0c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:38:36.708 INFO:journalctl@ceph.osd.2.smithi098.stdout:Apr 26 20:38:36 smithi098 podman[69651]: 2024-04-26 20:38:36.595119762 +0000 UTC m=+0.635665558 container died 681db276abb271f3c6651b22cde0181f8c484e2aaf661e4f19e4e7864357d0c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:38:37.307 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.2.service' 2024-04-26T20:38:37.344 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:37.345 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-26T20:38:37.345 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-26T20:38:37.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.3 2024-04-26T20:38:37.722 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:37 smithi070 systemd[1]: Stopping Ceph osd.3 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:37.980 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:37 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3[50404]: 2024-04-26T20:38:37.721+0000 7fc63bd03700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:37.980 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:37 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3[50404]: 2024-04-26T20:38:37.721+0000 7fc63bd03700 -1 osd.3 100 *** Got signal Terminated *** 2024-04-26T20:38:37.980 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:37 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3[50404]: 2024-04-26T20:38:37.721+0000 7fc63bd03700 -1 osd.3 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:38:39.602 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:39 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:39.294+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:40.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:39 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:39.601+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:40.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:39 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:39.808+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:40.469 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:40 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:40.200+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:40.626 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:40 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:40.290+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:41.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:40 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:40.625+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:41.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:40 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:40.827+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:41.469 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:41 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:41.203+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:41.606 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:41 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:41.328+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:42.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:41 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:41.605+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:42.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:41 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:41.822+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:42.469 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:42 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:42.218+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:42.594 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:42 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:42.295+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:43.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:42 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:42.593+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:43.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:42 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:42.833+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:43.505 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:43 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:43.282+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:43.506 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:43 smithi070 podman[87862]: 2024-04-26 20:38:43.21130153 +0000 UTC m=+5.673115724 container died 93971dadae6d5e9bc140070587fd2cbdf00793fe7143bded5fe38415d00291bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:38:43.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:43 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:43.353+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:43.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:43 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:43.221+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:43.784 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:43 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:43.609+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:43.785 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:43 smithi070 podman[87862]: 2024-04-26 20:38:43.604298972 +0000 UTC m=+6.066113172 container cleanup 93971dadae6d5e9bc140070587fd2cbdf00793fe7143bded5fe38415d00291bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T20:38:43.785 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:43 smithi070 bash[87862]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3 2024-04-26T20:38:44.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:43 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:43.821+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:44.219 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:43 smithi070 podman[87891]: 2024-04-26 20:38:43.872417106 +0000 UTC m=+0.661985040 container remove 93971dadae6d5e9bc140070587fd2cbdf00793fe7143bded5fe38415d00291bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-26T20:38:44.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:44.302+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:44.535 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:44 smithi070 podman[87981]: 2024-04-26 20:38:44.122349463 +0000 UTC m=+0.018037722 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:38:44.535 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:44 smithi070 podman[87981]: 2024-04-26 20:38:44.24523464 +0000 UTC m=+0.140922899 container create b576e39daeb992d4e2fe6746379730013bcd3272bf9c1ded8e8ca4e086e15f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T20:38:44.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:44 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:44.317+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:44.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:44 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:44.232+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:44.878 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:44 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:44.600+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:44.878 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:44 smithi070 podman[87981]: 2024-04-26 20:38:44.584786343 +0000 UTC m=+0.480474602 container init b576e39daeb992d4e2fe6746379730013bcd3272bf9c1ded8e8ca4e086e15f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-26T20:38:44.879 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:44 smithi070 podman[87981]: 2024-04-26 20:38:44.587809688 +0000 UTC m=+0.483497948 container start b576e39daeb992d4e2fe6746379730013bcd3272bf9c1ded8e8ca4e086e15f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-26T20:38:44.879 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:44 smithi070 podman[87981]: 2024-04-26 20:38:44.684757178 +0000 UTC m=+0.580445455 container attach b576e39daeb992d4e2fe6746379730013bcd3272bf9c1ded8e8ca4e086e15f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5) 2024-04-26T20:38:44.879 INFO:journalctl@ceph.osd.3.smithi070.stdout:Apr 26 20:38:44 smithi070 podman[87981]: 2024-04-26 20:38:44.877865584 +0000 UTC m=+0.773553844 container died b576e39daeb992d4e2fe6746379730013bcd3272bf9c1ded8e8ca4e086e15f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T20:38:45.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:44 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:44.862+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:45.505 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:45 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:45.297+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:45.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.3.service' 2024-04-26T20:38:45.568 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:45.568 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-26T20:38:45.568 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-26T20:38:45.568 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.4 2024-04-26T20:38:45.594 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:45 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:45.247+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:45.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:45.341+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:45.784 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:45 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:45.588+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:45.962 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:45 smithi080 systemd[1]: Stopping Ceph osd.4 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:46.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:45.851+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:46.219 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:45 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4[43396]: 2024-04-26T20:38:45.961+0000 7ffa13286700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:46.219 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:45 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4[43396]: 2024-04-26T20:38:45.961+0000 7ffa13286700 -1 osd.4 100 *** Got signal Terminated *** 2024-04-26T20:38:46.219 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:45 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4[43396]: 2024-04-26T20:38:45.961+0000 7ffa13286700 -1 osd.4 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:38:46.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:46 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:46.258+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:46.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:46.306+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:46.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:46 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:46.233+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:47.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:46 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:46.539+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:47.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:46.901+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:47.469 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:47 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:47.192+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:47.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:47 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:47.283+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:47.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:47 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:47.333+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:48.034 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:47 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:47.553+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:48.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:47 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:47.951+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:48.469 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:48 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4[43396]: 2024-04-26T20:38:48.023+0000 7ffa0b872700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.663888+0000 front 2024-04-26T20:38:23.663866+0000 (oldest deadline 2024-04-26T20:38:47.164060+0000) 2024-04-26T20:38:48.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:48 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:48.145+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:48.511 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:48 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:48.249+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:48.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:48 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:48.296+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:48.784 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:48 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:48.510+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:48.784 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:48 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:48.510+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:38:49.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:48 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:48.949+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:49.470 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:48 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4[43396]: 2024-04-26T20:38:48.991+0000 7ffa0b872700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.663888+0000 front 2024-04-26T20:38:23.663866+0000 (oldest deadline 2024-04-26T20:38:47.164060+0000) 2024-04-26T20:38:49.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:49 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:49.104+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:49.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:49 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:49.104+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:38:49.531 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:49 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:49.253+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:49.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:49 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:49.281+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:49.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:49 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:49.281+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:38:49.784 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:49 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:49.530+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:49.785 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:49 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:49.530+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:38:50.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:49 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:49.922+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:50.470 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:50 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4[43396]: 2024-04-26T20:38:50.032+0000 7ffa0b872700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.663888+0000 front 2024-04-26T20:38:23.663866+0000 (oldest deadline 2024-04-26T20:38:47.164060+0000) 2024-04-26T20:38:50.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:50 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:50.148+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:50.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:50 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:50.148+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:38:50.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:50 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:50.229+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:50.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:50 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:50.229+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:38:50.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:50 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:50.263+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:50.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:50 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:50.263+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:38:51.034 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:50 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:50.568+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:51.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:50 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:50.568+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:38:51.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:50 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:50.941+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:51.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:50 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:50.941+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.320893+0000 front 2024-04-26T20:38:25.320961+0000 (oldest deadline 2024-04-26T20:38:50.620875+0000) 2024-04-26T20:38:51.209 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:50 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:50.820+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:38:51.470 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:51 smithi080 podman[68175]: 2024-04-26 20:38:51.370169488 +0000 UTC m=+5.607789241 container died 6d5f8ef819aaecd0068dd554d03e37a4d38c2ce0ce3277ae6bd70c707c62756e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-26T20:38:51.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:51 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:51.169+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:51.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:51 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:51.169+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:38:51.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:51 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:51.221+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:51.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:51 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:51.221+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:38:51.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:51 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:51.266+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:51.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:51 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:51.266+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:38:51.969 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:51 smithi080 podman[68175]: 2024-04-26 20:38:51.761513237 +0000 UTC m=+5.999132980 container cleanup 6d5f8ef819aaecd0068dd554d03e37a4d38c2ce0ce3277ae6bd70c707c62756e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-26T20:38:51.970 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:51 smithi080 bash[68175]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4 2024-04-26T20:38:52.034 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:51 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:51.549+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:52.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:51 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:51.549+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:38:52.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:51 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:51.784+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:38:52.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:51 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:51.930+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:52.209 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:51 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:51.930+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.320893+0000 front 2024-04-26T20:38:25.320961+0000 (oldest deadline 2024-04-26T20:38:50.620875+0000) 2024-04-26T20:38:52.372 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:52 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:52.015+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:38:52.372 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:52 smithi080 podman[68192]: 2024-04-26 20:38:52.055062866 +0000 UTC m=+0.683555844 container remove 6d5f8ef819aaecd0068dd554d03e37a4d38c2ce0ce3277ae6bd70c707c62756e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-26T20:38:52.372 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:52 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:52.152+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:52.372 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:52 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:52.152+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:38:52.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:52 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:52.211+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:52.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:52 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:52.211+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:38:52.659 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:52 smithi080 podman[68280]: 2024-04-26 20:38:52.274719917 +0000 UTC m=+0.017881413 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:38:52.660 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:52 smithi080 podman[68280]: 2024-04-26 20:38:52.400086586 +0000 UTC m=+0.143248128 container create 8898020857b752bac84da2219037368269a089e48d588fb203862e2b94ccd3ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T20:38:52.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:52 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:52.245+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:52.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:52 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:52.245+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:38:52.954 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:52 smithi080 podman[68280]: 2024-04-26 20:38:52.6594836 +0000 UTC m=+0.402645110 container init 8898020857b752bac84da2219037368269a089e48d588fb203862e2b94ccd3ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:38:52.955 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:52 smithi080 podman[68280]: 2024-04-26 20:38:52.662768847 +0000 UTC m=+0.405930351 container start 8898020857b752bac84da2219037368269a089e48d588fb203862e2b94ccd3ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T20:38:52.955 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:52 smithi080 podman[68280]: 2024-04-26 20:38:52.725951584 +0000 UTC m=+0.469113103 container attach 8898020857b752bac84da2219037368269a089e48d588fb203862e2b94ccd3ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:38:53.034 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:52 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:52.597+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:53.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:52 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:52.597+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:38:53.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:52 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:52.781+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:38:53.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:52 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:52.941+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:53.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:52 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:52.941+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.320893+0000 front 2024-04-26T20:38:25.320961+0000 (oldest deadline 2024-04-26T20:38:50.620875+0000) 2024-04-26T20:38:53.219 INFO:journalctl@ceph.osd.4.smithi080.stdout:Apr 26 20:38:52 smithi080 podman[68280]: 2024-04-26 20:38:52.954742546 +0000 UTC m=+0.697904049 container died 8898020857b752bac84da2219037368269a089e48d588fb203862e2b94ccd3ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424) 2024-04-26T20:38:53.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:53 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:53.024+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:38:53.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:53 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:53.194+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:53.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:53 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:53.194+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:38:53.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:53 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:53.183+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:53.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:53 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:53.183+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:38:53.696 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.4.service' 2024-04-26T20:38:53.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:53 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:53.270+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:53.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:53 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:53.270+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:38:53.782 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:53.783 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-26T20:38:53.783 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-26T20:38:53.783 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.5 2024-04-26T20:38:54.034 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:53 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:53.572+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:54.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:53 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:53.572+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:38:54.094 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:53 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:53.809+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:38:54.094 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:53 smithi098 systemd[1]: Stopping Ceph osd.5 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:38:54.094 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:53 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:53.892+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:54.094 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:53 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:53.892+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.320893+0000 front 2024-04-26T20:38:25.320961+0000 (oldest deadline 2024-04-26T20:38:50.620875+0000) 2024-04-26T20:38:54.458 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:54 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:54.094+0000 7f3d66a91700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:54.459 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:54 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:54.094+0000 7f3d66a91700 -1 osd.5 100 *** Got signal Terminated *** 2024-04-26T20:38:54.459 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:54 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:54.094+0000 7f3d66a91700 -1 osd.5 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:38:54.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:54 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:54.235+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:54.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:54 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:54.235+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:38:54.469 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:53 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:53.991+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:38:54.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:54 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:54.228+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:54.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:54 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:54.228+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:38:54.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:54 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:54.160+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:54.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:54 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:54.160+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:38:55.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:54 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:54.572+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:55.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:54 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:54.572+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:38:55.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:54 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:54.844+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:38:55.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:54 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:54.899+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:55.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:54 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:54.899+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.320893+0000 front 2024-04-26T20:38:25.320961+0000 (oldest deadline 2024-04-26T20:38:50.620875+0000) 2024-04-26T20:38:55.469 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:54 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:54.991+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:38:55.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:55 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:55.192+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:55.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:55 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:55.192+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:38:55.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:55 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:55.140+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:55.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:55 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:55.140+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:38:55.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:55 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:55.233+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:55.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:55 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:55.233+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:38:56.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:55 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:55.581+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:56.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:55 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:55.581+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:38:56.202 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:55 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:55.877+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:38:56.202 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:55 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:55.878+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:56.203 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:55 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:55.878+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.320893+0000 front 2024-04-26T20:38:25.320961+0000 (oldest deadline 2024-04-26T20:38:50.620875+0000) 2024-04-26T20:38:56.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:56 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:56.202+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:56.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:56 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:56.202+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:38:56.469 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:56 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:56.010+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:38:56.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:56 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:56.217+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:56.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:56 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:56.217+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:38:56.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:56 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:56.130+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:56.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:56 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:56.130+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:38:56.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:56 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:56.130+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:38:57.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:56 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:56.622+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:57.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:56 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:56.622+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:38:57.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:56 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:56.891+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:57.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:56 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:56.891+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.320893+0000 front 2024-04-26T20:38:25.320961+0000 (oldest deadline 2024-04-26T20:38:50.620875+0000) 2024-04-26T20:38:57.209 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:56 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:56.880+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:38:57.209 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:56 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:56.880+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:38:57.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:56 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:56.993+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:38:57.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:56 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:56.993+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:38:57.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:57 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:57.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:57.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:57 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:57.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:38:57.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:57 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:57.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:38:57.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:57 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:57.085+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:57.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:57 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:57.085+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:38:57.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:57 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:57.085+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:38:57.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:57 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:57.242+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:57.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:57 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:57.242+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:38:57.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:57 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:57.242+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:38:58.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:57 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:57.602+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:58.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:57 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:57.602+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:38:58.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:57 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:57.602+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.199534+0000 front 2024-04-26T20:38:33.199559+0000 (oldest deadline 2024-04-26T20:38:56.699483+0000) 2024-04-26T20:38:58.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:57 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:57.874+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:58.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:57 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:57.874+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.320893+0000 front 2024-04-26T20:38:25.320961+0000 (oldest deadline 2024-04-26T20:38:50.620875+0000) 2024-04-26T20:38:58.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:57 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:57.926+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:38:58.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:57 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:57.926+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:38:58.227 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:57 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:57.974+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:38:58.227 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:57 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:57.974+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:38:58.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:58 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:58.115+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:58.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:58 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:58.115+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:38:58.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:58 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:58.115+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:38:58.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:58 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:58.271+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:58.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:58 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:58.271+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:38:58.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:58 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:58.271+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:38:58.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:58 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:58.226+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:58.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:58 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:58.226+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:38:58.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:58 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:58.226+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:38:59.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:58 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:58.645+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:38:59.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:58 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:58.645+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:38:59.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:58 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:58.645+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.199534+0000 front 2024-04-26T20:38:33.199559+0000 (oldest deadline 2024-04-26T20:38:56.699483+0000) 2024-04-26T20:38:59.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:58 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:58.852+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.718761+0000 front 2024-04-26T20:38:13.718919+0000 (oldest deadline 2024-04-26T20:38:39.018786+0000) 2024-04-26T20:38:59.209 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:58 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5[44416]: 2024-04-26T20:38:58.852+0000 7f3d63085700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.320893+0000 front 2024-04-26T20:38:25.320961+0000 (oldest deadline 2024-04-26T20:38:50.620875+0000) 2024-04-26T20:38:59.209 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:58 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:58.919+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:38:59.209 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:58 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:58.919+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:38:59.218 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:58 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:58.954+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:38:59.218 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:58 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:58.954+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:38:59.469 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:59 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:59.217+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:38:59.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:59 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:59.217+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:38:59.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:38:59 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:38:59.217+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:38:59.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:59 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:59.113+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:38:59.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:59 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:59.113+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:38:59.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:38:59 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:38:59.113+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:38:59.708 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:59 smithi098 podman[69756]: 2024-04-26 20:38:59.434864433 +0000 UTC m=+5.461865073 container died 973833c6c6f675074f8174b1d620b17c4298be8f6db2286f666f76515f504951 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5) 2024-04-26T20:38:59.709 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:59 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:59.237+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:38:59.709 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:59 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:59.237+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:38:59.709 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:38:59 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:38:59.237+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:00.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:59 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:59.688+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:39:00.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:59 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:59.688+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:39:00.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:38:59 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:38:59.688+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.199534+0000 front 2024-04-26T20:38:33.199559+0000 (oldest deadline 2024-04-26T20:38:56.699483+0000) 2024-04-26T20:39:00.079 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:59 smithi098 podman[69756]: 2024-04-26 20:38:59.844567463 +0000 UTC m=+5.871568095 container cleanup 973833c6c6f675074f8174b1d620b17c4298be8f6db2286f666f76515f504951 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:39:00.079 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:38:59 smithi098 bash[69756]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5 2024-04-26T20:39:00.079 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:59 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:59.954+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:00.079 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:38:59 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:38:59.954+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:00.219 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:59 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:59.939+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:00.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:38:59 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:38:59.939+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:00.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:00 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:00.181+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:00.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:00 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:00.181+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:00.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:00 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:00.181+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:00.380 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:39:00 smithi098 podman[69773]: 2024-04-26 20:39:00.079131851 +0000 UTC m=+0.639520181 container remove 973833c6c6f675074f8174b1d620b17c4298be8f6db2286f666f76515f504951 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:39:00.380 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:00 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:00.266+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:00.380 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:00 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:00.266+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:00.380 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:00 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:00.266+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:00.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:00.151+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:00.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:00.151+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:00.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:00.151+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:00.633 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:39:00 smithi098 podman[69865]: 2024-04-26 20:39:00.379918893 +0000 UTC m=+0.107036894 container create 138df68b37553a2f1da2c3ea03aa0817db95b0f340f96b4bd47c344d99a81d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-26T20:39:00.633 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:39:00 smithi098 podman[69865]: 2024-04-26 20:39:00.291116399 +0000 UTC m=+0.018234424 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:39:00.633 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:39:00 smithi098 podman[69865]: 2024-04-26 20:39:00.633228122 +0000 UTC m=+0.360346123 container init 138df68b37553a2f1da2c3ea03aa0817db95b0f340f96b4bd47c344d99a81d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-26T20:39:00.925 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:39:00 smithi098 podman[69865]: 2024-04-26 20:39:00.63649102 +0000 UTC m=+0.363609028 container start 138df68b37553a2f1da2c3ea03aa0817db95b0f340f96b4bd47c344d99a81d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-26T20:39:00.925 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:39:00 smithi098 podman[69865]: 2024-04-26 20:39:00.741606702 +0000 UTC m=+0.468724703 container attach 138df68b37553a2f1da2c3ea03aa0817db95b0f340f96b4bd47c344d99a81d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:39:01.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:00.666+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:39:01.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:00.666+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:39:01.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:00 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:00.666+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.199534+0000 front 2024-04-26T20:38:33.199559+0000 (oldest deadline 2024-04-26T20:38:56.699483+0000) 2024-04-26T20:39:01.204 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:00 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:00.931+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:01.204 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:00 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:00.931+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:01.208 INFO:journalctl@ceph.osd.5.smithi098.stdout:Apr 26 20:39:00 smithi098 podman[69865]: 2024-04-26 20:39:00.925140145 +0000 UTC m=+0.652258159 container died 138df68b37553a2f1da2c3ea03aa0817db95b0f340f96b4bd47c344d99a81d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-26T20:39:01.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:00 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:00.956+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:01.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:00 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:00.956+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:01.469 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:01 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:01.204+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:01.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:01 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:01.204+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:01.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:01 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:01.204+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:01.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:01 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:01.163+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:01.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:01 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:01.163+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:01.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:01 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:01.163+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:01.537 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:01 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:01.287+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:01.537 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:01 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:01.287+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:01.537 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:01 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:01.287+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:01.558 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.5.service' 2024-04-26T20:39:01.601 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:39:01.601 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-26T20:39:01.602 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-26T20:39:01.602 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.6 2024-04-26T20:39:02.034 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:01 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:01.632+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:39:02.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:01 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:01.632+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:39:02.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:01 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:01.632+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.199534+0000 front 2024-04-26T20:38:33.199559+0000 (oldest deadline 2024-04-26T20:38:56.699483+0000) 2024-04-26T20:39:02.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:01 smithi070 systemd[1]: Stopping Ceph osd.6 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:39:02.184 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:01 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:01.922+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:02.184 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:01 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:01.922+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:02.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:01 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:01.953+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:02.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:01 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:01.953+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:02.469 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:02.183+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:02.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:02.183+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:02.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:02.183+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:02.535 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:02.181+0000 7f93ddca0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:39:02.535 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:02.181+0000 7f93ddca0700 -1 osd.6 100 *** Got signal Terminated *** 2024-04-26T20:39:02.535 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:02.181+0000 7f93ddca0700 -1 osd.6 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:39:02.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:02.207+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:02.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:02.207+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:02.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:02.207+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:02.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:02.258+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:02.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:02.258+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:02.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:02.258+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:03.034 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:02.674+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:39:03.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:02.674+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:39:03.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:02 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:02.674+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.199534+0000 front 2024-04-26T20:38:33.199559+0000 (oldest deadline 2024-04-26T20:38:56.699483+0000) 2024-04-26T20:39:03.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:02.927+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:03.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:02 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:02.927+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:03.209 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:02.885+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:03.209 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:02 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:02.885+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:03.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:03 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:03.208+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:03.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:03 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:03.208+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:03.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:03 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:03.208+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:03.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:03.160+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:03.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:03.160+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:03.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:03.160+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:03.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:03 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:03.293+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:03.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:03 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:03.293+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:03.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:03 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:03.293+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:04.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:03.673+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:39:04.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:03.673+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:39:04.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:03.673+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.199534+0000 front 2024-04-26T20:38:33.199559+0000 (oldest deadline 2024-04-26T20:38:56.699483+0000) 2024-04-26T20:39:04.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:03.673+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.401012+0000 front 2024-04-26T20:38:39.401061+0000 (oldest deadline 2024-04-26T20:39:03.501180+0000) 2024-04-26T20:39:04.184 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:03 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:03.900+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:04.184 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:03 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:03.900+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:04.245 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:03 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:03.973+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:04.245 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:03 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:03.973+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:04.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:04 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:04.183+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:04.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:04 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:04.183+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:04.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:04 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:04.183+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:04.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:04 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:04.183+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:04.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:04 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:04.175+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:04.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:04 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:04.175+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:04.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:04 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:04.175+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:04.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:04 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:04.175+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:04.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:04 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:04.245+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:04.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:04 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:04.245+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:04.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:04 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:04.245+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:05.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:04 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:04.671+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:39:05.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:04 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:04.672+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:39:05.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:04 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:04.672+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.199534+0000 front 2024-04-26T20:38:33.199559+0000 (oldest deadline 2024-04-26T20:38:56.699483+0000) 2024-04-26T20:39:05.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:04 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:04.672+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.401012+0000 front 2024-04-26T20:38:39.401061+0000 (oldest deadline 2024-04-26T20:39:03.501180+0000) 2024-04-26T20:39:05.173 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:04 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:04.870+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:05.173 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:04 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:04.870+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:05.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:04 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:04.955+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:05.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:04 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:04.955+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:05.469 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:05 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:05.172+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:05.469 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:05 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:05.172+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:05.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:05 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:05.172+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:05.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:05 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:05.172+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:05.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:05.212+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:05.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:05.212+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:05.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:05.212+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:05.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:05.212+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:05.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:05 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:05.233+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:05.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:05 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:05.233+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:05.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:05 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:05.233+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:06.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:05.628+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:39:06.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:05.628+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:39:06.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:05.628+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.199534+0000 front 2024-04-26T20:38:33.199559+0000 (oldest deadline 2024-04-26T20:38:56.699483+0000) 2024-04-26T20:39:06.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:05 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:05.628+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.401012+0000 front 2024-04-26T20:38:39.401061+0000 (oldest deadline 2024-04-26T20:39:03.501180+0000) 2024-04-26T20:39:06.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:05 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:05.902+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:06.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:05 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:05.902+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:06.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:06 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:06.139+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:06.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:06 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:06.139+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:06.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:06 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:06.139+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:06.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:06 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:06.139+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:06.220 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:05 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:05.964+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:06.221 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:05 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:05.964+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:06.221 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:05 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:05.964+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:06.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:06.226+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:06.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:06.226+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:06.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:06.226+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:06.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:06.226+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:06.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:06 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:06.218+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:06.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:06 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:06.218+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:06.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:06 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:06.218+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:07.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:06.594+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:12.796196+0000 front 2024-04-26T20:38:12.796176+0000 (oldest deadline 2024-04-26T20:38:38.696286+0000) 2024-04-26T20:39:07.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:06.594+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.498020+0000 front 2024-04-26T20:38:24.497802+0000 (oldest deadline 2024-04-26T20:38:47.997743+0000) 2024-04-26T20:39:07.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:06.594+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.199534+0000 front 2024-04-26T20:38:33.199559+0000 (oldest deadline 2024-04-26T20:38:56.699483+0000) 2024-04-26T20:39:07.035 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:06 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6[57390]: 2024-04-26T20:39:06.594+0000 7f93d628c700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.401012+0000 front 2024-04-26T20:38:39.401061+0000 (oldest deadline 2024-04-26T20:39:03.501180+0000) 2024-04-26T20:39:07.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:06 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:06.938+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:07.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:06 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:06.938+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:07.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:06 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:06.938+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:41.309768+0000 front 2024-04-26T20:38:41.309782+0000 (oldest deadline 2024-04-26T20:39:06.609602+0000) 2024-04-26T20:39:07.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:07 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:07.184+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:07.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:07 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:07.184+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:07.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:07 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:07.184+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:07.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:07 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:07.184+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:07.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:07 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:07.197+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:07.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:07 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:07.197+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:07.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:07 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:07.197+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:07.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:06 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:06.996+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:07.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:06 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:06.996+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:07.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:06 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:06.996+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:07.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:07 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:07.195+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:07.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:07 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:07.195+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:07.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:07 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:07.195+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:07.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:07 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:07.195+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:07.958 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:07 smithi070 podman[88087]: 2024-04-26 20:39:07.689521862 +0000 UTC m=+5.900139921 container died af206cdccf379f9dbe3f3499704d87bd8f371b646fd4cb52fee7efafd32f58a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-26T20:39:08.285 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:08 smithi070 podman[88087]: 2024-04-26 20:39:08.056000845 +0000 UTC m=+6.266618903 container cleanup af206cdccf379f9dbe3f3499704d87bd8f371b646fd4cb52fee7efafd32f58a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2) 2024-04-26T20:39:08.285 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:08 smithi070 bash[88087]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6 2024-04-26T20:39:08.285 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:08 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:08.166+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:08.286 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:08 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:08.166+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:08.286 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:08 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:08.166+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:08.286 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:08 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:08.166+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:08.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:08 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:08.022+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:08.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:08 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:08.022+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:08.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:08 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:08.022+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:08.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:08 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:08.236+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:08.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:08 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:08.236+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:08.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:08 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:08.236+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:08.469 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:07 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:07.979+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:08.469 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:07 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:07.979+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:08.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:07 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:07.979+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:41.309768+0000 front 2024-04-26T20:38:41.309782+0000 (oldest deadline 2024-04-26T20:39:06.609602+0000) 2024-04-26T20:39:08.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:08 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:08.215+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:08.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:08 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:08.215+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:08.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:08 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:08.215+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:08.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:08 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:08.215+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:08.673 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:08 smithi070 podman[88104]: 2024-04-26 20:39:08.365941784 +0000 UTC m=+0.676561025 container remove af206cdccf379f9dbe3f3499704d87bd8f371b646fd4cb52fee7efafd32f58a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True) 2024-04-26T20:39:09.011 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:08 smithi070 podman[88195]: 2024-04-26 20:39:08.576394593 +0000 UTC m=+0.018281724 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:39:09.011 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:08 smithi070 podman[88195]: 2024-04-26 20:39:08.674977319 +0000 UTC m=+0.116864440 container create bc5f42957e6ffd29cb4027b0c2287df216fd499709290439377b03044f19d31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:39:09.012 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:08 smithi070 podman[88195]: 2024-04-26 20:39:08.911133093 +0000 UTC m=+0.353020215 container init bc5f42957e6ffd29cb4027b0c2287df216fd499709290439377b03044f19d31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:39:09.012 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:08 smithi070 podman[88195]: 2024-04-26 20:39:08.914208712 +0000 UTC m=+0.356095834 container start bc5f42957e6ffd29cb4027b0c2287df216fd499709290439377b03044f19d31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-26T20:39:09.285 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:09 smithi070 podman[88195]: 2024-04-26 20:39:09.011050846 +0000 UTC m=+0.452937976 container attach bc5f42957e6ffd29cb4027b0c2287df216fd499709290439377b03044f19d31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-26T20:39:09.285 INFO:journalctl@ceph.osd.6.smithi070.stdout:Apr 26 20:39:09 smithi070 podman[88195]: 2024-04-26 20:39:09.201244641 +0000 UTC m=+0.643131763 container died bc5f42957e6ffd29cb4027b0c2287df216fd499709290439377b03044f19d31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-6-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T20:39:09.286 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:09 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:09.203+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:09.286 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:09 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:09.203+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:09.286 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:09 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:09.203+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:09.286 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:09 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:09.203+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:09.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:08 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:08.984+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:09.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:08 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:08.984+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:09.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:08 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:08.984+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:09.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:09 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:09.220+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:09.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:09 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:09.220+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:09.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:09 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:09.220+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:09.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:09 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:09.003+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:09.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:09 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:09.003+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:09.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:09 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:09.003+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:41.309768+0000 front 2024-04-26T20:38:41.309782+0000 (oldest deadline 2024-04-26T20:39:06.609602+0000) 2024-04-26T20:39:09.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:09 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:09.199+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:09.473 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:09 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:09.199+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:09.473 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:09 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:09.199+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:09.473 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:09 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:09.199+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:09.892 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.6.service' 2024-04-26T20:39:09.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:39:09.931 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-26T20:39:09.931 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-26T20:39:09.931 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.7 2024-04-26T20:39:10.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:09 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:09.938+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:10.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:09 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:09.938+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:10.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:09 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:09.938+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:10.216 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:09 smithi080 systemd[1]: Stopping Ceph osd.7 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:39:10.216 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:10.008+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:10.216 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:10.008+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:10.216 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:10.008+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:41.309768+0000 front 2024-04-26T20:38:41.309782+0000 (oldest deadline 2024-04-26T20:39:06.609602+0000) 2024-04-26T20:39:10.216 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:10.214+0000 7f16794be700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:39:10.216 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:10.214+0000 7f16794be700 -1 osd.7 100 *** Got signal Terminated *** 2024-04-26T20:39:10.216 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:10.214+0000 7f16794be700 -1 osd.7 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:39:10.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:10.223+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:10.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:10.223+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:10.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:10.223+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:10.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:10.223+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:10.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:10 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:10.214+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:10.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:10 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:10.214+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:10.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:10 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:10.214+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:10.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:10 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:10.214+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:10.709 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:10 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:10.208+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:10.709 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:10 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:10.208+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:10.709 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:10 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:10.208+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:11.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:11 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:11.169+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:11.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:11 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:11.169+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:11.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:11 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:11.169+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:11.209 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:10 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:10.937+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:11.209 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:10 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:10.937+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:11.209 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:10 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:10.937+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:11.239 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:10.982+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:11.239 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:10.982+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:11.239 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:10 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:10.982+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:41.309768+0000 front 2024-04-26T20:38:41.309782+0000 (oldest deadline 2024-04-26T20:39:06.609602+0000) 2024-04-26T20:39:11.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:11 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:11.189+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:11.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:11 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:11.189+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:11.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:11 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:11.189+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:11.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:11 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:11.189+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:11.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:11.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:11.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:11.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:11.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:11.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:11.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:11.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:12.219 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:11.955+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:12.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:11.955+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:12.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:11.955+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:41.309768+0000 front 2024-04-26T20:38:41.309782+0000 (oldest deadline 2024-04-26T20:39:06.609602+0000) 2024-04-26T20:39:12.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:11 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:11.973+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:12.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:11 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:11.973+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:12.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:11 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:11.973+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:12.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:12 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:12.163+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:12.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:12 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:12.163+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:12.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:12 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:12.163+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:12.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:12 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:12.163+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:12.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:12 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:12.147+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:12.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:12 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:12.147+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:12.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:12 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:12.147+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:12.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:12 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:12.147+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:12.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:12 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:12.240+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:12.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:12 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:12.240+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:12.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:12 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:12.240+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:12.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:12 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:12.240+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:13.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:12 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:12.943+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:13.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:12 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:12.943+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:13.220 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:12 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:12.943+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:41.309768+0000 front 2024-04-26T20:38:41.309782+0000 (oldest deadline 2024-04-26T20:39:06.609602+0000) 2024-04-26T20:39:13.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:12 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:12.981+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:13.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:12 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:12.981+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:13.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:12 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:12.981+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:13.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:13 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:13.210+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:13.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:13 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:13.210+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:13.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:13 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:13.210+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:13.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:13 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:13.210+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:13.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:13 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:13.123+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:13.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:13 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:13.123+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:13.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:13 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:13.123+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:13.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:13 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:13.123+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:13.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:13 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:13.123+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:13.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:13 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:13.233+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:13.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:13 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:13.233+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:13.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:13 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:13.233+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:13.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:13 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:13.233+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:14.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:14.019+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:14.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:14.019+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:14.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:14.019+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:14.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:14.185+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:14.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:14.185+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:14.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:14.185+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:14.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:14 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:14.185+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:14.469 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:13 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:13.985+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:14.469 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:13 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:13.985+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:14.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:13 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:13.985+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:41.309768+0000 front 2024-04-26T20:38:41.309782+0000 (oldest deadline 2024-04-26T20:39:06.609602+0000) 2024-04-26T20:39:14.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:13 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:13.985+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:47.110380+0000 front 2024-04-26T20:38:47.110351+0000 (oldest deadline 2024-04-26T20:39:13.010486+0000) 2024-04-26T20:39:14.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:14 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:14.204+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:14.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:14 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:14.204+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:14.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:14 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:14.204+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:14.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:14 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:14.204+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:14.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:14 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:14.204+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:14.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:14 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:14.132+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:14.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:14 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:14.132+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:14.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:14 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:14.132+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:14.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:14 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:14.132+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:14.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:14 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:14.132+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:15.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:15.037+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:15.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:15.037+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:15.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:15.037+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:15.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:15.161+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:15.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:15.161+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:15.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:15.161+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:15.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:15.161+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:15.469 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:15.027+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.006808+0000 front 2024-04-26T20:38:25.006975+0000 (oldest deadline 2024-04-26T20:38:51.407522+0000) 2024-04-26T20:39:15.469 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:15.027+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.108526+0000 front 2024-04-26T20:38:33.108504+0000 (oldest deadline 2024-04-26T20:38:56.608570+0000) 2024-04-26T20:39:15.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:15.027+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:41.309768+0000 front 2024-04-26T20:38:41.309782+0000 (oldest deadline 2024-04-26T20:39:06.609602+0000) 2024-04-26T20:39:15.470 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7[49938]: 2024-04-26T20:39:15.027+0000 7f1671aaa700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:47.110380+0000 front 2024-04-26T20:38:47.110351+0000 (oldest deadline 2024-04-26T20:39:13.010486+0000) 2024-04-26T20:39:15.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:15.217+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:15.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:15.217+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:15.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:15.217+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:15.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:15.217+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:15.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:15.217+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:15.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:15 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:15.140+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:15.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:15 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:15.140+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:15.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:15 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:15.140+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:15.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:15 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:15.140+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:15.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:15 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:15.140+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:15.891 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:15 smithi080 podman[68398]: 2024-04-26 20:39:15.587846254 +0000 UTC m=+5.465721130 container died 4fed8a5af5b6c26b24312492405414f503dc4350e6ff565abcfbde91f5b1aa54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T20:39:16.215 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:15 smithi080 podman[68398]: 2024-04-26 20:39:15.998704279 +0000 UTC m=+5.876579155 container cleanup 4fed8a5af5b6c26b24312492405414f503dc4350e6ff565abcfbde91f5b1aa54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-26T20:39:16.216 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:15 smithi080 bash[68398]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7 2024-04-26T20:39:16.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:15.989+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:16.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:15.989+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:16.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:15.989+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:16.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:15 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:15.989+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:45.283532+0000 front 2024-04-26T20:38:45.283481+0000 (oldest deadline 2024-04-26T20:39:15.883852+0000) 2024-04-26T20:39:16.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:16 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:16.205+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:16.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:16 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:16.205+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:16.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:16 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:16.205+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:16.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:16 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:16.205+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:16.469 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:16 smithi080 podman[68416]: 2024-04-26 20:39:16.268892208 +0000 UTC m=+0.678938761 container remove 4fed8a5af5b6c26b24312492405414f503dc4350e6ff565abcfbde91f5b1aa54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-26T20:39:16.469 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:16 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:16.214+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:16.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:16 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:16.214+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:16.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:16 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:16.214+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:16.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:16 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:16.214+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:16.470 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:16 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:16.214+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:16.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:16 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:16.098+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:16.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:16 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:16.098+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:16.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:16 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:16.098+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:16.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:16 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:16.098+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:16.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:16 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:16.098+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:16.881 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:16 smithi080 podman[68509]: 2024-04-26 20:39:16.514255801 +0000 UTC m=+0.018173587 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:39:16.881 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:16 smithi080 podman[68509]: 2024-04-26 20:39:16.6509344 +0000 UTC m=+0.154852187 container create 4a46931e550d02f6f377d663a1cd8c295852606bd2c09b330283bd048033f511 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-26T20:39:16.881 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:16 smithi080 podman[68509]: 2024-04-26 20:39:16.881015267 +0000 UTC m=+0.384933054 container init 4a46931e550d02f6f377d663a1cd8c295852606bd2c09b330283bd048033f511 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:39:17.174 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:16 smithi080 podman[68509]: 2024-04-26 20:39:16.88418457 +0000 UTC m=+0.388102358 container start 4a46931e550d02f6f377d663a1cd8c295852606bd2c09b330283bd048033f511 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:39:17.174 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:16 smithi080 podman[68509]: 2024-04-26 20:39:16.989745374 +0000 UTC m=+0.493663173 container attach 4a46931e550d02f6f377d663a1cd8c295852606bd2c09b330283bd048033f511 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-26T20:39:17.451 INFO:journalctl@ceph.osd.7.smithi080.stdout:Apr 26 20:39:17 smithi080 podman[68509]: 2024-04-26 20:39:17.174689698 +0000 UTC m=+0.678607491 container died 4a46931e550d02f6f377d663a1cd8c295852606bd2c09b330283bd048033f511 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-26T20:39:17.451 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:17 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:17.210+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:17.451 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:17 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:17.210+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:17.451 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:17 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:17.210+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:17.451 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:17 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:17.210+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:17.451 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:17 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:17.210+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:17.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:17.179+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:17.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:17.179+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:17.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:17.179+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:17.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:17.179+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:17.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:17.017+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:17.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:17.017+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:17.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:17.017+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:17.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:17.017+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:45.283532+0000 front 2024-04-26T20:38:45.283481+0000 (oldest deadline 2024-04-26T20:39:15.883852+0000) 2024-04-26T20:39:17.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:17 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:17.116+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:17.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:17 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:17.116+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:17.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:17 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:17.116+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:17.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:17 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:17.116+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:17.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:17 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:17.116+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:17.862 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.7.service' 2024-04-26T20:39:17.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:39:17.898 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-26T20:39:17.898 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-26T20:39:17.898 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.8 2024-04-26T20:39:18.199 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:17 smithi098 systemd[1]: Stopping Ceph osd.8 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:39:18.199 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:17.998+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:18.199 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:17.998+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:18.199 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:17.998+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:18.199 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:17 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:17.998+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:45.283532+0000 front 2024-04-26T20:38:45.283481+0000 (oldest deadline 2024-04-26T20:39:15.883852+0000) 2024-04-26T20:39:18.199 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:18 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:18.144+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:18.200 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:18 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:18.144+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:18.200 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:18 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:18.144+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:18.200 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:18 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:18.144+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:18.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:18 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:18.197+0000 7f8e0093a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:39:18.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:18 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:18.197+0000 7f8e0093a700 -1 osd.8 100 *** Got signal Terminated *** 2024-04-26T20:39:18.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:18 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:18.197+0000 7f8e0093a700 -1 osd.8 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:39:18.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:18 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:18.141+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:18.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:18 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:18.141+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:18.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:18 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:18.141+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:18.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:18 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:18.141+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:18.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:18 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:18.141+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:18.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:18 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:18.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:18.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:18 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:18.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:18.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:18 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:18.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:18.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:18 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:18.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:18.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:18 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:18.239+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:19.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:19 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:19.147+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:19.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:19 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:19.147+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:19.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:19 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:19.147+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:19.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:19 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:19.147+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:19.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:19 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:19.039+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:19.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:19 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:19.039+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:19.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:19 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:19.039+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:19.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:19 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:19.039+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:45.283532+0000 front 2024-04-26T20:38:45.283481+0000 (oldest deadline 2024-04-26T20:39:15.883852+0000) 2024-04-26T20:39:19.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:19.149+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:19.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:19.149+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:19.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:19.149+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:19.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:19.149+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:19.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:19 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:19.149+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:19.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:19 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:19.254+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:19.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:19 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:19.254+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:19.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:19 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:19.254+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:19.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:19 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:19.254+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:19.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:19 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:19.254+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:20.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:20.125+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:20.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:20.125+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:20.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:20.125+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:20.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:20.125+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:20.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:20.047+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:20.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:20.047+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:20.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:20.047+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:20.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:20 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:20.047+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:45.283532+0000 front 2024-04-26T20:38:45.283481+0000 (oldest deadline 2024-04-26T20:39:15.883852+0000) 2024-04-26T20:39:20.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:20.162+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:20.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:20.162+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:20.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:20.162+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:20.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:20.162+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:20.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:20 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:20.162+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:20.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:20.227+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:20.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:20.227+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:20.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:20.227+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:20.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:20.227+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:20.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:20 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:20.227+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:21.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:21.105+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:21.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:21.105+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:21.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:21.105+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:21.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:21.105+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:21.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:21.029+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:21.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:21.029+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:21.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:21.029+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:21.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:21 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:21.029+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:45.283532+0000 front 2024-04-26T20:38:45.283481+0000 (oldest deadline 2024-04-26T20:39:15.883852+0000) 2024-04-26T20:39:21.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:21 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:21.193+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:21.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:21 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:21.193+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:21.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:21 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:21.193+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:21.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:21 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:21.193+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:21.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:21 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:21.193+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:21.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:21 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:21.231+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:21.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:21 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:21.231+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:21.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:21 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:21.231+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:21.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:21 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:21.231+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:21.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:21 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:21.231+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:22.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:22.033+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:22.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:22.033+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:22.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:22.033+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:22.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:22.033+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:45.283532+0000 front 2024-04-26T20:38:45.283481+0000 (oldest deadline 2024-04-26T20:39:15.883852+0000) 2024-04-26T20:39:22.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:22.056+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:22.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:22.056+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:22.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:22.056+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:22.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:22.056+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:22.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:22 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:22.056+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:22.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:22 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:22.150+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:22.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:22 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:22.150+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:22.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:22 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:22.150+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:22.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:22 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:22.150+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:22.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:22 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:22.150+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:22.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:22 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:22.240+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:22.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:22 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:22.240+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:22.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:22 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:22.240+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:22.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:22 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:22.240+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:22.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:22 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:22.240+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:23.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:23.011+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:23.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:23.011+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:23.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:23.011+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:23.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:23.011+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:23.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:23.011+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:23.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:23.060+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.580054+0000 front 2024-04-26T20:38:25.579962+0000 (oldest deadline 2024-04-26T20:38:50.280080+0000) 2024-04-26T20:39:23.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:23.060+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.582039+0000 front 2024-04-26T20:38:33.581991+0000 (oldest deadline 2024-04-26T20:38:55.882111+0000) 2024-04-26T20:39:23.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:23.060+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:40.583205+0000 front 2024-04-26T20:38:40.583187+0000 (oldest deadline 2024-04-26T20:39:05.282976+0000) 2024-04-26T20:39:23.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:23.060+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:45.283532+0000 front 2024-04-26T20:38:45.283481+0000 (oldest deadline 2024-04-26T20:39:15.883852+0000) 2024-04-26T20:39:23.459 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8[51263]: 2024-04-26T20:39:23.060+0000 7f8dfcf2e700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.784607+0000 front 2024-04-26T20:38:58.784681+0000 (oldest deadline 2024-04-26T20:39:22.884805+0000) 2024-04-26T20:39:23.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:23 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:23.191+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:23.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:23 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:23.191+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:23.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:23 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:23.191+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:23.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:23 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:23.191+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:23.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:23 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:23.191+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:23.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:23 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:23.191+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:56.451926+0000 front 2024-04-26T20:38:56.451858+0000 (oldest deadline 2024-04-26T20:39:22.351800+0000) 2024-04-26T20:39:23.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:23 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:23.226+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:23.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:23 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:23.226+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:23.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:23 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:23.226+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:23.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:23 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:23.226+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:23.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:23 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:23.226+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:23.941 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:23 smithi098 podman[69973]: 2024-04-26 20:39:23.643892258 +0000 UTC m=+5.557756396 container died 6cfb99db6cab6bc32a47a341e0746cbe0a0a7ab9f6dec9f8428836e7958088cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T20:39:24.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:24 smithi098 podman[69973]: 2024-04-26 20:39:24.04020149 +0000 UTC m=+5.954065627 container cleanup 6cfb99db6cab6bc32a47a341e0746cbe0a0a7ab9f6dec9f8428836e7958088cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-26T20:39:24.208 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:24 smithi098 bash[69973]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8 2024-04-26T20:39:24.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:23.963+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:24.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:23.963+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:24.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:23.963+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:24.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:23.963+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:24.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:23.963+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:24.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:24 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:24.178+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:24.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:24 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:24.178+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:24.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:24 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:24.178+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:24.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:24 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:24.178+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:24.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:24 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:24.178+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:24.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:24 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:24.178+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:56.451926+0000 front 2024-04-26T20:38:56.451858+0000 (oldest deadline 2024-04-26T20:39:22.351800+0000) 2024-04-26T20:39:24.659 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:24 smithi098 podman[69988]: 2024-04-26 20:39:24.258285436 +0000 UTC m=+0.611155964 container remove 6cfb99db6cab6bc32a47a341e0746cbe0a0a7ab9f6dec9f8428836e7958088cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:39:24.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:24 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:24.251+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:24.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:24 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:24.251+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:24.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:24 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:24.251+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:24.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:24 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:24.251+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:24.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:24 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:24.251+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:24.929 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:24 smithi098 podman[70083]: 2024-04-26 20:39:24.65893178 +0000 UTC m=+0.114388685 container create 2eeaadf70d8d45d2e7bf0a8a0a91c026d2b38f555c0dc7aad0f4873b973982bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T20:39:24.929 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:24 smithi098 podman[70083]: 2024-04-26 20:39:24.56265651 +0000 UTC m=+0.018113422 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:39:24.929 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:24 smithi098 podman[70083]: 2024-04-26 20:39:24.886531448 +0000 UTC m=+0.341988346 container init 2eeaadf70d8d45d2e7bf0a8a0a91c026d2b38f555c0dc7aad0f4873b973982bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-26T20:39:24.930 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:24 smithi098 podman[70083]: 2024-04-26 20:39:24.889586707 +0000 UTC m=+0.345043614 container start 2eeaadf70d8d45d2e7bf0a8a0a91c026d2b38f555c0dc7aad0f4873b973982bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424) 2024-04-26T20:39:25.183 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:25 smithi098 podman[70083]: 2024-04-26 20:39:25.020301874 +0000 UTC m=+0.475758788 container attach 2eeaadf70d8d45d2e7bf0a8a0a91c026d2b38f555c0dc7aad0f4873b973982bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-26T20:39:25.184 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:24 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:24.927+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:25.184 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:24 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:24.927+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:25.184 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:24 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:24.927+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:25.184 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:24 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:24.927+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:25.184 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:24 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:24.927+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:25.458 INFO:journalctl@ceph.osd.8.smithi098.stdout:Apr 26 20:39:25 smithi098 podman[70083]: 2024-04-26 20:39:25.183631166 +0000 UTC m=+0.639088071 container died 2eeaadf70d8d45d2e7bf0a8a0a91c026d2b38f555c0dc7aad0f4873b973982bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-26T20:39:25.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:25.183+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:25.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:25.183+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:25.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:25.183+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:25.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:25.183+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:25.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:25.183+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:25.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:25 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:25.183+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:56.451926+0000 front 2024-04-26T20:38:56.451858+0000 (oldest deadline 2024-04-26T20:39:22.351800+0000) 2024-04-26T20:39:25.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:25.296+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:25.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:25.296+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:25.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:25.296+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:25.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:25.296+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:25.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:25.296+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:25.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:25 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:25.296+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:25.893 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.8.service' 2024-04-26T20:39:25.929 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:39:25.930 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-26T20:39:25.930 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-26T20:39:25.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.9 2024-04-26T20:39:26.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:25 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:25.936+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:26.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:25 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:25.936+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:26.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:25 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:25.936+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:26.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:25 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:25.936+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:26.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:25 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:25.936+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:26.249 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:25 smithi070 systemd[1]: Stopping Ceph osd.9 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:39:26.249 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:26.156+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:26.249 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:26.156+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:26.249 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:26.156+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:26.250 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:26.156+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:26.250 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:26.156+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:26.250 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:26.156+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:56.451926+0000 front 2024-04-26T20:38:56.451858+0000 (oldest deadline 2024-04-26T20:39:22.351800+0000) 2024-04-26T20:39:26.250 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:26.248+0000 7f8b21db8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:39:26.250 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:26.248+0000 7f8b21db8700 -1 osd.9 100 *** Got signal Terminated *** 2024-04-26T20:39:26.250 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:26 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:26.248+0000 7f8b21db8700 -1 osd.9 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:39:26.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:26 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:26.261+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:26.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:26 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:26.261+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:26.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:26 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:26.261+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:26.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:26 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:26.261+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:26.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:26 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:26.261+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:26.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:26 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:26.261+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:27.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:26 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:26.943+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:27.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:26 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:26.943+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:27.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:26 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:26.943+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:27.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:26 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:26.943+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:27.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:26 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:26.943+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:27.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:27 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:27.131+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:27.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:27 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:27.131+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:27.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:27 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:27.131+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:27.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:27 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:27.131+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:27.536 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:27 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:27.131+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:27.536 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:27 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:27.131+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:56.451926+0000 front 2024-04-26T20:38:56.451858+0000 (oldest deadline 2024-04-26T20:39:22.351800+0000) 2024-04-26T20:39:27.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:27 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:27.308+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:27.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:27 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:27.308+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:27.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:27 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:27.308+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:27.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:27 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:27.308+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:27.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:27 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:27.308+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:27.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:27 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:27.308+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:28.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:27 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:27.943+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:28.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:27 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:27.943+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:28.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:27 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:27.943+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:28.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:27 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:27.943+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:28.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:27 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:27.943+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:28.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:28 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:28.170+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:28.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:28 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:28.170+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:28.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:28 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:28.170+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:28.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:28 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:28.170+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:28.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:28 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:28.170+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:28.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:28 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:28.170+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:56.451926+0000 front 2024-04-26T20:38:56.451858+0000 (oldest deadline 2024-04-26T20:39:22.351800+0000) 2024-04-26T20:39:28.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:28 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:28.170+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:05.753457+0000 front 2024-04-26T20:39:05.753476+0000 (oldest deadline 2024-04-26T20:39:28.053589+0000) 2024-04-26T20:39:28.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:28 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:28.274+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:28.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:28 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:28.274+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:28.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:28 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:28.274+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:28.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:28 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:28.274+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:28.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:28 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:28.274+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:28.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:28 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:28.274+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:29.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:28 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:28.928+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:29.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:28 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:28.928+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:29.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:28 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:28.928+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:29.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:28 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:28.928+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:29.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:28 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:28.928+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:29.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:29 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:29.129+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:29.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:29 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:29.129+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:29.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:29 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:29.129+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:29.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:29 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:29.129+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:29.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:29 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:29.129+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:29.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:29 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:29.129+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:56.451926+0000 front 2024-04-26T20:38:56.451858+0000 (oldest deadline 2024-04-26T20:39:22.351800+0000) 2024-04-26T20:39:29.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:29 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:29.129+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:05.753457+0000 front 2024-04-26T20:39:05.753476+0000 (oldest deadline 2024-04-26T20:39:28.053589+0000) 2024-04-26T20:39:29.621 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:29 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:29.272+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:29.622 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:29 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:29.272+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:29.622 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:29 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:29.272+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:29.622 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:29 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:29.272+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:29.622 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:29 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:29.272+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:29.622 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:29 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:29.272+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:30.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:29 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:29.977+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:30.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:29 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:29.977+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:30.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:29 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:29.977+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:30.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:29 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:29.977+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:30.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:29 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:29.977+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:30.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:30 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:30.153+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:30.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:30 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:30.153+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:30.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:30 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:30.153+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:30.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:30 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:30.153+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:30.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:30 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:30.153+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:30.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:30 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:30.153+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:56.451926+0000 front 2024-04-26T20:38:56.451858+0000 (oldest deadline 2024-04-26T20:39:22.351800+0000) 2024-04-26T20:39:30.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:30 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:30.153+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:05.753457+0000 front 2024-04-26T20:39:05.753476+0000 (oldest deadline 2024-04-26T20:39:28.053589+0000) 2024-04-26T20:39:30.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:30 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:30.289+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:30.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:30 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:30.289+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:30.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:30 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:30.289+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:30.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:30 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:30.289+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:30.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:30 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:30.289+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:30.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:30 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:30.289+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:30.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:30 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:30.289+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:04.291446+0000 front 2024-04-26T20:39:04.291488+0000 (oldest deadline 2024-04-26T20:39:29.591365+0000) 2024-04-26T20:39:31.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:30 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:30.945+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:31.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:30 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:30.945+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:31.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:30 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:30.945+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:31.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:30 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:30.945+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:31.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:30 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:30.945+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:31.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:30 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:30.945+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:31.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:31 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:31.139+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.143905+0000 front 2024-04-26T20:38:17.143928+0000 (oldest deadline 2024-04-26T20:38:38.843999+0000) 2024-04-26T20:39:31.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:31 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:31.139+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:24.145172+0000 front 2024-04-26T20:38:24.145016+0000 (oldest deadline 2024-04-26T20:38:49.444960+0000) 2024-04-26T20:39:31.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:31 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:31.139+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:33.545996+0000 front 2024-04-26T20:38:33.546144+0000 (oldest deadline 2024-04-26T20:38:55.146470+0000) 2024-04-26T20:39:31.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:31 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:31.139+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:42.147673+0000 front 2024-04-26T20:38:42.147866+0000 (oldest deadline 2024-04-26T20:39:03.247945+0000) 2024-04-26T20:39:31.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:31 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:31.139+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:50.051019+0000 front 2024-04-26T20:38:50.051221+0000 (oldest deadline 2024-04-26T20:39:12.950941+0000) 2024-04-26T20:39:31.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:31 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:31.139+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:56.451926+0000 front 2024-04-26T20:38:56.451858+0000 (oldest deadline 2024-04-26T20:39:22.351800+0000) 2024-04-26T20:39:31.535 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:31 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9[64419]: 2024-04-26T20:39:31.139+0000 7f8b1a3a4700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:05.753457+0000 front 2024-04-26T20:39:05.753476+0000 (oldest deadline 2024-04-26T20:39:28.053589+0000) 2024-04-26T20:39:31.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:31 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:31.276+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:31.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:31 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:31.276+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:31.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:31 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:31.276+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:31.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:31 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:31.276+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:31.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:31 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:31.276+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:31.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:31 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:31.276+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:31.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:31 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:31.276+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:04.291446+0000 front 2024-04-26T20:39:04.291488+0000 (oldest deadline 2024-04-26T20:39:29.591365+0000) 2024-04-26T20:39:31.875 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:31 smithi070 podman[88302]: 2024-04-26 20:39:31.612260172 +0000 UTC m=+5.487256300 container died 1078e0a7cca78efddea13cfadcf599f661d6e061c752ab0d083aca8fc2f66715 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-26T20:39:32.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:31 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:31.955+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:32.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:31 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:31.955+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:32.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:31 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:31.955+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:32.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:31 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:31.955+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:32.208 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:31 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:31.955+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:32.209 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:31 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:31.955+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:32.240 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:31 smithi070 podman[88302]: 2024-04-26 20:39:31.973090272 +0000 UTC m=+5.848086402 container cleanup 1078e0a7cca78efddea13cfadcf599f661d6e061c752ab0d083aca8fc2f66715 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-26T20:39:32.241 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:31 smithi070 bash[88302]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9 2024-04-26T20:39:32.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:32 smithi070 podman[88319]: 2024-04-26 20:39:32.240798763 +0000 UTC m=+0.631294748 container remove 1078e0a7cca78efddea13cfadcf599f661d6e061c752ab0d083aca8fc2f66715 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-26T20:39:32.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:32 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:32.323+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:32.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:32 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:32.323+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:32.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:32 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:32.323+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:32.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:32 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:32.323+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:32.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:32 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:32.323+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:32.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:32 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:32.323+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:32.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:32 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:32.323+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:04.291446+0000 front 2024-04-26T20:39:04.291488+0000 (oldest deadline 2024-04-26T20:39:29.591365+0000) 2024-04-26T20:39:32.893 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:32 smithi070 podman[88410]: 2024-04-26 20:39:32.485398326 +0000 UTC m=+0.017701037 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:39:32.894 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:32 smithi070 podman[88410]: 2024-04-26 20:39:32.591612766 +0000 UTC m=+0.123915468 container create 6d8b5ed50d9b458c6b7b14a5daa4c573308e0a49077e340f3c59112ea01e9af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:39:32.894 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:32 smithi070 podman[88410]: 2024-04-26 20:39:32.819256598 +0000 UTC m=+0.351559309 container init 6d8b5ed50d9b458c6b7b14a5daa4c573308e0a49077e340f3c59112ea01e9af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:39:32.894 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:32 smithi070 podman[88410]: 2024-04-26 20:39:32.822591518 +0000 UTC m=+0.354894227 container start 6d8b5ed50d9b458c6b7b14a5daa4c573308e0a49077e340f3c59112ea01e9af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:39:32.894 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:32 smithi070 podman[88410]: 2024-04-26 20:39:32.893750742 +0000 UTC m=+0.426053445 container attach 6d8b5ed50d9b458c6b7b14a5daa4c573308e0a49077e340f3c59112ea01e9af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-26T20:39:33.285 INFO:journalctl@ceph.osd.9.smithi070.stdout:Apr 26 20:39:33 smithi070 podman[88410]: 2024-04-26 20:39:33.11427417 +0000 UTC m=+0.646576876 container died 6d8b5ed50d9b458c6b7b14a5daa4c573308e0a49077e340f3c59112ea01e9af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T20:39:33.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:32 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:32.968+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:33.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:32 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:32.968+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:33.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:32 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:32.968+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:33.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:32 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:32.968+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:33.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:32 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:32.968+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:33.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:32 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:32.968+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:33.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:33 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:33.344+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:33.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:33 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:33.344+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:33.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:33 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:33.344+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:33.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:33 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:33.344+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:33.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:33 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:33.344+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:33.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:33 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:33.344+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:33.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:33 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:33.344+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:04.291446+0000 front 2024-04-26T20:39:04.291488+0000 (oldest deadline 2024-04-26T20:39:29.591365+0000) 2024-04-26T20:39:33.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.9.service' 2024-04-26T20:39:33.759 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:39:33.760 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-26T20:39:33.760 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-26T20:39:33.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.10 2024-04-26T20:39:34.079 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:33 smithi080 systemd[1]: Stopping Ceph osd.10 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:39:34.373 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:34 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:34.078+0000 7f6e2a5db700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:39:34.374 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:34 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:34.078+0000 7f6e2a5db700 -1 osd.10 100 *** Got signal Terminated *** 2024-04-26T20:39:34.374 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:34 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:34.078+0000 7f6e2a5db700 -1 osd.10 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:39:34.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:33 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:33.984+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:34.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:33 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:33.984+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:34.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:33 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:33.984+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:34.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:33 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:33.984+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:34.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:33 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:33.984+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:34.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:33 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:33.984+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:34.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:34 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:34.372+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:34.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:34 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:34.372+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:34.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:34 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:34.372+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:34.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:34 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:34.372+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:34.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:34 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:34.373+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:34.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:34 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:34.373+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:34.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:34 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:34.373+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:04.291446+0000 front 2024-04-26T20:39:04.291488+0000 (oldest deadline 2024-04-26T20:39:29.591365+0000) 2024-04-26T20:39:35.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:34 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:34.991+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:35.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:34 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:34.991+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:35.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:34 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:34.991+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:35.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:34 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:34.991+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:35.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:34 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:34.991+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:35.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:34 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:34.991+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:35.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:35 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:35.421+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:35.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:35 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:35.421+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:35.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:35 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:35.421+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:35.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:35 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:35.421+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:35.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:35 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:35.421+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:35.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:35 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:35.421+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:35.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:35 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:35.421+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:04.291446+0000 front 2024-04-26T20:39:04.291488+0000 (oldest deadline 2024-04-26T20:39:29.591365+0000) 2024-04-26T20:39:36.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:36 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:36.034+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:36.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:36 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:36.034+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:36.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:36 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:36.034+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:36.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:36 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:36.034+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:36.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:36 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:36.034+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:36.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:36 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:36.034+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:36.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:36 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:36.379+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:36.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:36 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:36.379+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:36.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:36 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:36.379+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:36.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:36 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:36.379+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:36.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:36 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:36.379+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:36.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:36 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:36.379+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:36.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:36 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:36.379+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:04.291446+0000 front 2024-04-26T20:39:04.291488+0000 (oldest deadline 2024-04-26T20:39:29.591365+0000) 2024-04-26T20:39:37.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:37 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:37.028+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:37.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:37 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:37.028+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:37.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:37 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:37.028+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:37.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:37 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:37.028+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:37.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:37 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:37.028+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:37.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:37 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:37.028+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:37.719 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:37 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:37.361+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:37.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:37 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:37.361+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:37.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:37 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:37.361+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:37.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:37 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:37.361+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:37.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:37 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:37.361+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:37.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:37 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:37.361+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:37.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:37 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:37.361+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:04.291446+0000 front 2024-04-26T20:39:04.291488+0000 (oldest deadline 2024-04-26T20:39:29.591365+0000) 2024-04-26T20:39:38.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:38 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:38.044+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:38.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:38 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:38.044+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:38.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:38 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:38.044+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:38.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:38 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:38.044+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:38.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:38 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:38.044+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:38.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:38 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:38.044+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:38.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:38 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:38.385+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:17.283205+0000 front 2024-04-26T20:38:17.283228+0000 (oldest deadline 2024-04-26T20:38:40.183407+0000) 2024-04-26T20:39:38.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:38 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:38.385+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:25.984905+0000 front 2024-04-26T20:38:25.984982+0000 (oldest deadline 2024-04-26T20:38:48.285016+0000) 2024-04-26T20:39:38.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:38 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:38.385+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:31.686338+0000 front 2024-04-26T20:38:31.686551+0000 (oldest deadline 2024-04-26T20:38:56.986354+0000) 2024-04-26T20:39:38.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:38 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:38.385+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-04-26T20:38:39.287286+0000 front 2024-04-26T20:38:39.287338+0000 (oldest deadline 2024-04-26T20:39:03.987363+0000) 2024-04-26T20:39:38.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:38 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:38.385+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.689214+0000 front 2024-04-26T20:38:49.689252+0000 (oldest deadline 2024-04-26T20:39:13.789398+0000) 2024-04-26T20:39:38.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:38 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:38.385+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.991230+0000 front 2024-04-26T20:38:58.991280+0000 (oldest deadline 2024-04-26T20:39:24.290946+0000) 2024-04-26T20:39:38.720 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:38 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10[56982]: 2024-04-26T20:39:38.385+0000 7f6e22bc7700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:04.291446+0000 front 2024-04-26T20:39:04.291488+0000 (oldest deadline 2024-04-26T20:39:29.591365+0000) 2024-04-26T20:39:39.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:39 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:39.033+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:39.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:39 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:39.033+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:39.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:39 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:39.033+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:39.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:39 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:39.033+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:39.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:39 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:39.033+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:39.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:39 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:39.033+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:39.781 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:39 smithi080 podman[68639]: 2024-04-26 20:39:39.51056854 +0000 UTC m=+5.561133251 container died 47c872512d51f22be2b77ca7f21841e5baa87f822cb2773c76657a34ad5d41ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:39:40.172 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:39 smithi080 podman[68639]: 2024-04-26 20:39:39.870696079 +0000 UTC m=+5.921260787 container cleanup 47c872512d51f22be2b77ca7f21841e5baa87f822cb2773c76657a34ad5d41ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-26T20:39:40.172 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:39 smithi080 bash[68639]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10 2024-04-26T20:39:40.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:40 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:40.078+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:40.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:40 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:40.078+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:40.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:40 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:40.078+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:40.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:40 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:40.078+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:40.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:40 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:40.078+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:40.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:40 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:40.078+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:40.469 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:40 smithi080 podman[68657]: 2024-04-26 20:39:40.171937996 +0000 UTC m=+0.654550461 container remove 47c872512d51f22be2b77ca7f21841e5baa87f822cb2773c76657a34ad5d41ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:39:40.826 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:40 smithi080 podman[68748]: 2024-04-26 20:39:40.401984719 +0000 UTC m=+0.018346635 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:39:40.826 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:40 smithi080 podman[68748]: 2024-04-26 20:39:40.514587169 +0000 UTC m=+0.130949081 container create 710b4aac8bcfb13e9e93d34188c7b0f45564aba95605ca9c53f05b1f0c094ad5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-26T20:39:40.826 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:40 smithi080 podman[68748]: 2024-04-26 20:39:40.742662122 +0000 UTC m=+0.359024040 container init 710b4aac8bcfb13e9e93d34188c7b0f45564aba95605ca9c53f05b1f0c094ad5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:39:40.826 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:40 smithi080 podman[68748]: 2024-04-26 20:39:40.74560222 +0000 UTC m=+0.361964140 container start 710b4aac8bcfb13e9e93d34188c7b0f45564aba95605ca9c53f05b1f0c094ad5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:39:40.826 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:40 smithi080 podman[68748]: 2024-04-26 20:39:40.826034396 +0000 UTC m=+0.442396318 container attach 710b4aac8bcfb13e9e93d34188c7b0f45564aba95605ca9c53f05b1f0c094ad5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-26T20:39:41.220 INFO:journalctl@ceph.osd.10.smithi080.stdout:Apr 26 20:39:41 smithi080 podman[68748]: 2024-04-26 20:39:41.048150036 +0000 UTC m=+0.664511952 container died 710b4aac8bcfb13e9e93d34188c7b0f45564aba95605ca9c53f05b1f0c094ad5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-10-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-26T20:39:41.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:41 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:41.063+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:41.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:41 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:41.063+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:41.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:41 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:41.063+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:41.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:41 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:41.063+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:41.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:41 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:41.063+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:41.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:41 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:41.063+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:41.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:41 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:41.063+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6820 osd.7 since back 2024-04-26T20:39:14.784726+0000 front 2024-04-26T20:39:14.784767+0000 (oldest deadline 2024-04-26T20:39:40.084730+0000) 2024-04-26T20:39:41.637 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.10.service' 2024-04-26T20:39:41.673 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:39:41.673 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-26T20:39:41.673 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-26T20:39:41.673 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.11 2024-04-26T20:39:41.958 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:41 smithi098 systemd[1]: Stopping Ceph osd.11 for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:39:42.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:41 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:41.992+0000 7fdd716d2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:39:42.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:41 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:41.992+0000 7fdd716d2700 -1 osd.11 100 *** Got signal Terminated *** 2024-04-26T20:39:42.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:41 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:41.992+0000 7fdd716d2700 -1 osd.11 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:39:42.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:42 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:42.092+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:42.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:42 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:42.092+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:42.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:42 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:42.092+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:42.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:42 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:42.092+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:42.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:42 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:42.092+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:42.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:42 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:42.092+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:42.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:42 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:42.092+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6820 osd.7 since back 2024-04-26T20:39:14.784726+0000 front 2024-04-26T20:39:14.784767+0000 (oldest deadline 2024-04-26T20:39:40.084730+0000) 2024-04-26T20:39:43.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:43 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:43.050+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:43.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:43 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:43.050+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:43.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:43 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:43.050+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:43.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:43 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:43.050+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:43.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:43 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:43.050+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:43.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:43 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:43.050+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:43.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:43 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:43.050+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6820 osd.7 since back 2024-04-26T20:39:14.784726+0000 front 2024-04-26T20:39:14.784767+0000 (oldest deadline 2024-04-26T20:39:40.084730+0000) 2024-04-26T20:39:44.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:44 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:44.004+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:44.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:44 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:44.004+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:44.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:44 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:44.004+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:44.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:44 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:44.004+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:44.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:44 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:44.004+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:44.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:44 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:44.004+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:44.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:44 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:44.004+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6820 osd.7 since back 2024-04-26T20:39:14.784726+0000 front 2024-04-26T20:39:14.784767+0000 (oldest deadline 2024-04-26T20:39:40.084730+0000) 2024-04-26T20:39:45.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.012+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:45.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.012+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:45.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.012+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:45.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.012+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:45.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.012+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:45.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.012+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:45.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.012+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6820 osd.7 since back 2024-04-26T20:39:14.784726+0000 front 2024-04-26T20:39:14.784767+0000 (oldest deadline 2024-04-26T20:39:40.084730+0000) 2024-04-26T20:39:46.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.985+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:46.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.985+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:46.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.985+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:46.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.985+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:46.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.985+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:46.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.985+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:46.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:45 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:45.985+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6820 osd.7 since back 2024-04-26T20:39:14.784726+0000 front 2024-04-26T20:39:14.784767+0000 (oldest deadline 2024-04-26T20:39:40.084730+0000) 2024-04-26T20:39:47.458 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:46.981+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-04-26T20:38:13.274399+0000 front 2024-04-26T20:38:13.274417+0000 (oldest deadline 2024-04-26T20:38:42.674980+0000) 2024-04-26T20:39:47.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:46.981+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6804 osd.1 since back 2024-04-26T20:38:23.176317+0000 front 2024-04-26T20:38:23.176153+0000 (oldest deadline 2024-04-26T20:38:48.476007+0000) 2024-04-26T20:39:47.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:46.981+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-04-26T20:38:34.277625+0000 front 2024-04-26T20:38:34.277644+0000 (oldest deadline 2024-04-26T20:38:57.177673+0000) 2024-04-26T20:39:47.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:46.981+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6812 osd.4 since back 2024-04-26T20:38:49.980438+0000 front 2024-04-26T20:38:49.980397+0000 (oldest deadline 2024-04-26T20:39:11.680289+0000) 2024-04-26T20:39:47.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:46.981+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-04-26T20:38:58.581932+0000 front 2024-04-26T20:38:58.581989+0000 (oldest deadline 2024-04-26T20:39:21.482020+0000) 2024-04-26T20:39:47.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:46.981+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-04-26T20:39:06.683471+0000 front 2024-04-26T20:39:06.683493+0000 (oldest deadline 2024-04-26T20:39:30.183373+0000) 2024-04-26T20:39:47.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:46.981+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.80:6820 osd.7 since back 2024-04-26T20:39:14.784726+0000 front 2024-04-26T20:39:14.784767+0000 (oldest deadline 2024-04-26T20:39:40.084730+0000) 2024-04-26T20:39:47.459 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:46 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11[58304]: 2024-04-26T20:39:46.981+0000 7fdd69cbe700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.98:6820 osd.8 since back 2024-04-26T20:39:20.585632+0000 front 2024-04-26T20:39:20.585604+0000 (oldest deadline 2024-04-26T20:39:46.485653+0000) 2024-04-26T20:39:47.795 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:47 smithi098 podman[70202]: 2024-04-26 20:39:47.510088301 +0000 UTC m=+5.645912421 container died aef829dc90053ebeb272f39c839283c3fd37db756d02117d7246d4437bc7b6ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-26T20:39:48.128 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:47 smithi098 podman[70202]: 2024-04-26 20:39:47.885071976 +0000 UTC m=+6.020896105 container cleanup aef829dc90053ebeb272f39c839283c3fd37db756d02117d7246d4437bc7b6ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-26T20:39:48.128 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:47 smithi098 bash[70202]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11 2024-04-26T20:39:48.456 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:48 smithi098 podman[70221]: 2024-04-26 20:39:48.127885781 +0000 UTC m=+0.614341215 container remove aef829dc90053ebeb272f39c839283c3fd37db756d02117d7246d4437bc7b6ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0) 2024-04-26T20:39:48.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:48 smithi098 podman[70310]: 2024-04-26 20:39:48.359637774 +0000 UTC m=+0.018181207 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:39:48.708 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:48 smithi098 podman[70310]: 2024-04-26 20:39:48.462072301 +0000 UTC m=+0.120615720 container create d1bf475952931b753f02e7acb6f41cd0e0cf2854857cc38f4111060cb6f4dba4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-04-26T20:39:49.015 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:48 smithi098 podman[70310]: 2024-04-26 20:39:48.714547504 +0000 UTC m=+0.373090918 container init d1bf475952931b753f02e7acb6f41cd0e0cf2854857cc38f4111060cb6f4dba4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:39:49.015 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:48 smithi098 podman[70310]: 2024-04-26 20:39:48.717783101 +0000 UTC m=+0.376326516 container start d1bf475952931b753f02e7acb6f41cd0e0cf2854857cc38f4111060cb6f4dba4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux ) 2024-04-26T20:39:49.015 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:48 smithi098 podman[70310]: 2024-04-26 20:39:48.806141406 +0000 UTC m=+0.464684836 container attach d1bf475952931b753f02e7acb6f41cd0e0cf2854857cc38f4111060cb6f4dba4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:39:49.308 INFO:journalctl@ceph.osd.11.smithi098.stdout:Apr 26 20:39:49 smithi098 podman[70310]: 2024-04-26 20:39:49.015368976 +0000 UTC m=+0.673912400 container died d1bf475952931b753f02e7acb6f41cd0e0cf2854857cc38f4111060cb6f4dba4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:39:49.603 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@osd.11.service' 2024-04-26T20:39:49.639 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:39:49.640 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-26T20:39:49.640 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-26T20:39:49.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.a 2024-04-26T20:39:49.965 INFO:journalctl@ceph.mds.a.smithi070.stdout:Apr 26 20:39:49 smithi070 systemd[1]: Stopping Ceph mds.a for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:39:50.284 INFO:journalctl@ceph.mds.a.smithi070.stdout:Apr 26 20:39:49 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-a[71148]: 2024-04-26T20:39:49.963+0000 7f79467fa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:39:50.285 INFO:journalctl@ceph.mds.a.smithi070.stdout:Apr 26 20:39:49 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-a[71148]: 2024-04-26T20:39:49.963+0000 7f79467fa700 -1 mds.a *** got signal Terminated *** 2024-04-26T20:39:54.248 INFO:journalctl@ceph.mds.a.smithi070.stdout:Apr 26 20:39:53 smithi070 podman[88528]: 2024-04-26 20:39:53.970614652 +0000 UTC m=+4.142160173 container died e10b5154867041e7f3903ed1828c600ea005283a88234c5ca7c8be6d3905eec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-a, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-26T20:39:54.534 INFO:journalctl@ceph.mds.a.smithi070.stdout:Apr 26 20:39:54 smithi070 podman[88528]: 2024-04-26 20:39:54.338523445 +0000 UTC m=+4.510068953 container cleanup e10b5154867041e7f3903ed1828c600ea005283a88234c5ca7c8be6d3905eec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T20:39:54.535 INFO:journalctl@ceph.mds.a.smithi070.stdout:Apr 26 20:39:54 smithi070 bash[88528]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-a 2024-04-26T20:39:54.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.a.service' 2024-04-26T20:39:54.807 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:39:54.807 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-26T20:39:54.807 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-26T20:39:54.807 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.d 2024-04-26T20:39:55.235 INFO:journalctl@ceph.mds.d.smithi070.stdout:Apr 26 20:39:54 smithi070 systemd[1]: Stopping Ceph mds.d for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:39:55.534 INFO:journalctl@ceph.mds.d.smithi070.stdout:Apr 26 20:39:55 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-d[70182]: 2024-04-26T20:39:55.234+0000 7fe6e7d8f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:39:55.535 INFO:journalctl@ceph.mds.d.smithi070.stdout:Apr 26 20:39:55 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-d[70182]: 2024-04-26T20:39:55.234+0000 7fe6e7d8f700 -1 mds.d *** got signal Terminated *** 2024-04-26T20:39:58.943 INFO:journalctl@ceph.mds.d.smithi070.stdout:Apr 26 20:39:58 smithi070 podman[88651]: 2024-04-26 20:39:58.656020595 +0000 UTC m=+3.634417579 container died 8796fa5407f6f5a4d017a5731afb353c45815d182657f05b42e2660216e3dcb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-d, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, io.buildah.version=1.33.5) 2024-04-26T20:39:59.284 INFO:journalctl@ceph.mds.d.smithi070.stdout:Apr 26 20:39:59 smithi070 podman[88651]: 2024-04-26 20:39:59.025645442 +0000 UTC m=+4.004042434 container cleanup 8796fa5407f6f5a4d017a5731afb353c45815d182657f05b42e2660216e3dcb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-26T20:39:59.285 INFO:journalctl@ceph.mds.d.smithi070.stdout:Apr 26 20:39:59 smithi070 bash[88651]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-d 2024-04-26T20:39:59.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.d.service' 2024-04-26T20:39:59.484 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:39:59.484 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-26T20:39:59.485 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-26T20:39:59.485 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.g 2024-04-26T20:40:00.034 INFO:journalctl@ceph.mds.g.smithi070.stdout:Apr 26 20:39:59 smithi070 systemd[1]: Stopping Ceph mds.g for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:40:00.035 INFO:journalctl@ceph.mds.g.smithi070.stdout:Apr 26 20:39:59 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-g[70787]: 2024-04-26T20:39:59.812+0000 7f17f29fa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:40:00.035 INFO:journalctl@ceph.mds.g.smithi070.stdout:Apr 26 20:39:59 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-g[70787]: 2024-04-26T20:39:59.812+0000 7f17f29fa700 -1 mds.g *** got signal Terminated *** 2024-04-26T20:40:02.535 INFO:journalctl@ceph.mds.g.smithi070.stdout:Apr 26 20:40:02 smithi070 podman[88771]: 2024-04-26 20:40:02.238600328 +0000 UTC m=+2.532579830 container died 53faf2c80c94b61140e55e363dca15d3f84a1bf7a3a54d6ee16c3cc131a1700b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-g, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:40:02.838 INFO:journalctl@ceph.mds.g.smithi070.stdout:Apr 26 20:40:02 smithi070 podman[88771]: 2024-04-26 20:40:02.62054044 +0000 UTC m=+2.914519949 container cleanup 53faf2c80c94b61140e55e363dca15d3f84a1bf7a3a54d6ee16c3cc131a1700b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-g, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0) 2024-04-26T20:40:02.838 INFO:journalctl@ceph.mds.g.smithi070.stdout:Apr 26 20:40:02 smithi070 bash[88771]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-g 2024-04-26T20:40:02.975 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.g.service' 2024-04-26T20:40:03.007 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:40:03.007 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-26T20:40:03.007 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-26T20:40:03.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.j 2024-04-26T20:40:03.535 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:40:03 smithi070 systemd[1]: Stopping Ceph mds.j for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:40:03.535 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:40:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-j[69793]: 2024-04-26T20:40:03.307+0000 7f4dcde25700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:40:03.535 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:40:03 smithi070 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-j[69793]: 2024-04-26T20:40:03.307+0000 7f4dcde25700 -1 mds.j *** got signal Terminated *** 2024-04-26T20:40:07.641 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:40:07 smithi070 podman[88892]: 2024-04-26 20:40:07.356299871 +0000 UTC m=+4.129640928 container died a6318ca21c6423445b00c10a2c0051a91dc9d8087aecec44636d7f90499263ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-j, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:40:08.035 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:40:07 smithi070 podman[88892]: 2024-04-26 20:40:07.732137221 +0000 UTC m=+4.505478274 container cleanup a6318ca21c6423445b00c10a2c0051a91dc9d8087aecec44636d7f90499263ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-j, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:40:08.035 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:40:07 smithi070 bash[88892]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-j 2024-04-26T20:40:08.035 INFO:journalctl@ceph.mds.j.smithi070.stdout:Apr 26 20:40:07 smithi070 podman[88906]: 2024-04-26 20:40:07.874738463 +0000 UTC m=+0.551327101 container remove a6318ca21c6423445b00c10a2c0051a91dc9d8087aecec44636d7f90499263ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-j, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T20:40:08.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.j.service' 2024-04-26T20:40:08.127 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:40:08.127 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-26T20:40:08.128 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-26T20:40:08.128 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.b 2024-04-26T20:40:08.413 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:40:08 smithi080 systemd[1]: Stopping Ceph mds.b for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:40:08.719 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:40:08 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b[62209]: 2024-04-26T20:40:08.412+0000 7f7fed470700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:40:08.719 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:40:08 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b[62209]: 2024-04-26T20:40:08.412+0000 7f7fed470700 -1 mds.b *** got signal Terminated *** 2024-04-26T20:40:10.546 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:40:10 smithi080 podman[68855]: 2024-04-26 20:40:10.2274693 +0000 UTC m=+1.916375484 container died 65c65c3936300b1fd61230a82ebcb5ef98d649e4ec2875ef4717f2004c093595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T20:40:10.881 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:40:10 smithi080 podman[68855]: 2024-04-26 20:40:10.646334299 +0000 UTC m=+2.335240477 container cleanup 65c65c3936300b1fd61230a82ebcb5ef98d649e4ec2875ef4717f2004c093595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-26T20:40:10.881 INFO:journalctl@ceph.mds.b.smithi080.stdout:Apr 26 20:40:10 smithi080 bash[68855]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-b 2024-04-26T20:40:11.017 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.b.service' 2024-04-26T20:40:11.052 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:40:11.052 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-26T20:40:11.052 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-26T20:40:11.053 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.e 2024-04-26T20:40:11.219 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:40:11 smithi080 systemd[1]: Stopping Ceph mds.e for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:40:11.719 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:40:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e[61590]: 2024-04-26T20:40:11.375+0000 7f857f47c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:40:11.719 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:40:11 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e[61590]: 2024-04-26T20:40:11.375+0000 7f857f47c700 -1 mds.e *** got signal Terminated *** 2024-04-26T20:40:14.518 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:40:14 smithi080 podman[68987]: 2024-04-26 20:40:14.245611755 +0000 UTC m=+2.977920403 container died 4e4863d539fdfd5eb074ab2206898fe35cce69c0cadd9d3e6e596fa61033c76c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:40:14.785 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:40:14 smithi080 podman[68987]: 2024-04-26 20:40:14.583724423 +0000 UTC m=+3.316033065 container cleanup 4e4863d539fdfd5eb074ab2206898fe35cce69c0cadd9d3e6e596fa61033c76c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:40:14.785 INFO:journalctl@ceph.mds.e.smithi080.stdout:Apr 26 20:40:14 smithi080 bash[68987]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-e 2024-04-26T20:40:15.006 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.e.service' 2024-04-26T20:40:15.038 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:40:15.038 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-26T20:40:15.038 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-26T20:40:15.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.h 2024-04-26T20:40:15.354 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:40:15 smithi080 systemd[1]: Stopping Ceph mds.h for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:40:15.720 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:40:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h[61900]: 2024-04-26T20:40:15.353+0000 7fbc396d7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:40:15.720 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:40:15 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h[61900]: 2024-04-26T20:40:15.353+0000 7fbc396d7700 -1 mds.h *** got signal Terminated *** 2024-04-26T20:40:18.605 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:40:18 smithi080 podman[69107]: 2024-04-26 20:40:18.233996337 +0000 UTC m=+2.979004057 container died 8d796e6cfab63933b13fba348262d87c58ee3eea397731e75510172cbd4fac4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T20:40:18.889 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:40:18 smithi080 podman[69107]: 2024-04-26 20:40:18.696308133 +0000 UTC m=+3.441315851 container cleanup 8d796e6cfab63933b13fba348262d87c58ee3eea397731e75510172cbd4fac4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:40:18.889 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:40:18 smithi080 bash[69107]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h 2024-04-26T20:40:19.125 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.h.service' 2024-04-26T20:40:19.145 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:40:18 smithi080 podman[69121]: 2024-04-26 20:40:18.889367551 +0000 UTC m=+0.656243388 container remove 8d796e6cfab63933b13fba348262d87c58ee3eea397731e75510172cbd4fac4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-h, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:40:19.145 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:40:19 smithi080 systemd[1]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.h.service: Deactivated successfully. 2024-04-26T20:40:19.145 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:40:19 smithi080 systemd[1]: Stopped Ceph mds.h for cc0136ee-0409-11ef-bc93-c7b262605968. 2024-04-26T20:40:19.145 INFO:journalctl@ceph.mds.h.smithi080.stdout:Apr 26 20:40:19 smithi080 systemd[1]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.h.service: Consumed 4.456s CPU time. 2024-04-26T20:40:19.156 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:40:19.157 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-26T20:40:19.157 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-26T20:40:19.157 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.k 2024-04-26T20:40:19.470 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:40:19 smithi080 systemd[1]: Stopping Ceph mds.k for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:40:19.969 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:40:19 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k[61270]: 2024-04-26T20:40:19.483+0000 7fa919d53700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:40:19.970 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:40:19 smithi080 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k[61270]: 2024-04-26T20:40:19.483+0000 7fa919d53700 -1 mds.k *** got signal Terminated *** 2024-04-26T20:40:22.535 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:40:22 smithi080 podman[69227]: 2024-04-26 20:40:22.246000522 +0000 UTC m=+2.868292766 container died ebb72b90741f2a14c9ce339d5b20ba1727b7d6a15eea57e0929963b0b17361af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-04-26T20:40:22.868 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:40:22 smithi080 podman[69227]: 2024-04-26 20:40:22.633845436 +0000 UTC m=+3.256137680 container cleanup ebb72b90741f2a14c9ce339d5b20ba1727b7d6a15eea57e0929963b0b17361af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T20:40:22.868 INFO:journalctl@ceph.mds.k.smithi080.stdout:Apr 26 20:40:22 smithi080 bash[69227]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-k 2024-04-26T20:40:23.014 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.k.service' 2024-04-26T20:40:23.044 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:40:23.045 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-26T20:40:23.045 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-26T20:40:23.045 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.c 2024-04-26T20:40:23.458 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:40:23 smithi098 systemd[1]: Stopping Ceph mds.c for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:40:23.722 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:40:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c[63506]: 2024-04-26T20:40:23.460+0000 7fd3418f3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:40:23.722 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:40:23 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c[63506]: 2024-04-26T20:40:23.460+0000 7fd3418f3700 -1 mds.c *** got signal Terminated *** 2024-04-26T20:40:26.519 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:40:26 smithi098 podman[70415]: 2024-04-26 20:40:26.239337005 +0000 UTC m=+3.000872548 container died 10e6c2710488ee0ca1f59a5a7c9e4fdbb526cf39543ec5837f22f52fefe9e815 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-26T20:40:26.853 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:40:26 smithi098 podman[70415]: 2024-04-26 20:40:26.618285184 +0000 UTC m=+3.379820716 container cleanup 10e6c2710488ee0ca1f59a5a7c9e4fdbb526cf39543ec5837f22f52fefe9e815 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS) 2024-04-26T20:40:26.853 INFO:journalctl@ceph.mds.c.smithi098.stdout:Apr 26 20:40:26 smithi098 bash[70415]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-c 2024-04-26T20:40:26.992 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.c.service' 2024-04-26T20:40:27.027 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:40:27.027 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-26T20:40:27.027 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-26T20:40:27.027 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.f 2024-04-26T20:40:27.458 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:40:27 smithi098 systemd[1]: Stopping Ceph mds.f for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:40:27.458 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:40:27 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f[63184]: 2024-04-26T20:40:27.354+0000 7f6c387c7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:40:27.458 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:40:27 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f[63184]: 2024-04-26T20:40:27.354+0000 7f6c387c7700 -1 mds.f *** got signal Terminated *** 2024-04-26T20:40:30.515 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:40:30 smithi098 podman[70547]: 2024-04-26 20:40:30.244553767 +0000 UTC m=+2.995975718 container died 46300548d288a440d5c91b7c828a32d3cdad3dca2647ddfe137e80bd78f144c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-26T20:40:30.865 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:40:30 smithi098 podman[70547]: 2024-04-26 20:40:30.622564983 +0000 UTC m=+3.373986933 container cleanup 46300548d288a440d5c91b7c828a32d3cdad3dca2647ddfe137e80bd78f144c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424) 2024-04-26T20:40:30.865 INFO:journalctl@ceph.mds.f.smithi098.stdout:Apr 26 20:40:30 smithi098 bash[70547]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-f 2024-04-26T20:40:30.992 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.f.service' 2024-04-26T20:40:31.023 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:40:31.024 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-26T20:40:31.024 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-26T20:40:31.024 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.i 2024-04-26T20:40:31.208 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:40:31 smithi098 systemd[1]: Stopping Ceph mds.i for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:40:31.708 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:40:31 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i[63814]: 2024-04-26T20:40:31.342+0000 7ff11fa91700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:40:31.708 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:40:31 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i[63814]: 2024-04-26T20:40:31.342+0000 7ff11fa91700 -1 mds.i *** got signal Terminated *** 2024-04-26T20:40:34.558 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:40:34 smithi098 podman[70668]: 2024-04-26 20:40:34.242984921 +0000 UTC m=+3.008494352 container died 1a2204d234f6022f1fccc5c1fa59dccd89f9a5cd2b2d009f6b3454df48b9c027 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-26T20:40:34.936 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:40:34 smithi098 podman[70668]: 2024-04-26 20:40:34.593523577 +0000 UTC m=+3.359033008 container cleanup 1a2204d234f6022f1fccc5c1fa59dccd89f9a5cd2b2d009f6b3454df48b9c027 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T20:40:34.936 INFO:journalctl@ceph.mds.i.smithi098.stdout:Apr 26 20:40:34 smithi098 bash[70668]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-i 2024-04-26T20:40:35.062 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.i.service' 2024-04-26T20:40:35.093 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:40:35.093 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-26T20:40:35.093 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-26T20:40:35.094 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.l 2024-04-26T20:40:35.208 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:40:35 smithi098 systemd[1]: Stopping Ceph mds.l for cc0136ee-0409-11ef-bc93-c7b262605968... 2024-04-26T20:40:35.708 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:40:35 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l[62884]: 2024-04-26T20:40:35.421+0000 7f4ab73c3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:40:35.708 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:40:35 smithi098 ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l[62884]: 2024-04-26T20:40:35.421+0000 7f4ab73c3700 -1 mds.l *** got signal Terminated *** 2024-04-26T20:40:38.498 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:40:38 smithi098 podman[70789]: 2024-04-26 20:40:38.240239411 +0000 UTC m=+2.928856071 container died 994820d5e67913bd58893a201784b42e97b4d00c31a52fb87b49634c29dfe776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424) 2024-04-26T20:40:38.765 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:40:38 smithi098 podman[70789]: 2024-04-26 20:40:38.57270267 +0000 UTC m=+3.261319361 container cleanup 994820d5e67913bd58893a201784b42e97b4d00c31a52fb87b49634c29dfe776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:40:38.765 INFO:journalctl@ceph.mds.l.smithi098.stdout:Apr 26 20:40:38 smithi098 bash[70789]: ceph-cc0136ee-0409-11ef-bc93-c7b262605968-mds-l 2024-04-26T20:40:38.985 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cc0136ee-0409-11ef-bc93-c7b262605968@mds.l.service' 2024-04-26T20:40:39.016 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:40:39.016 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-26T20:40:39.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cc0136ee-0409-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T20:40:39.204 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:40:41.640 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cc0136ee-0409-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T20:40:41.828 INFO:teuthology.orchestra.run.smithi080.stdout:Deleting cluster with fsid: cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:40:44.249 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cc0136ee-0409-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T20:40:44.436 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:40:46.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:40:46.808 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:40:46.840 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:40:46.865 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-26T20:40:46.867 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158/remote/smithi070/crash 2024-04-26T20:40:46.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/crash -- . 2024-04-26T20:40:46.894 INFO:teuthology.orchestra.run.smithi070.stderr:tar: /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T20:40:46.895 INFO:teuthology.orchestra.run.smithi070.stderr:tar: Error is not recoverable: exiting now 2024-04-26T20:40:46.896 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158/remote/smithi080/crash 2024-04-26T20:40:46.897 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/crash -- . 2024-04-26T20:40:46.958 INFO:teuthology.orchestra.run.smithi080.stderr:tar: /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T20:40:46.958 INFO:teuthology.orchestra.run.smithi080.stderr:tar: Error is not recoverable: exiting now 2024-04-26T20:40:46.960 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158/remote/smithi098/crash 2024-04-26T20:40:46.960 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/crash -- . 2024-04-26T20:40:47.006 INFO:teuthology.orchestra.run.smithi098.stderr:tar: /var/lib/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T20:40:47.006 INFO:teuthology.orchestra.run.smithi098.stderr:tar: Error is not recoverable: exiting now 2024-04-26T20:40:47.010 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-26T20:40:47.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-26T20:40:47.047 INFO:tasks.cephadm:Compressing logs... 2024-04-26T20:40:47.047 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T20:40:47.090 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T20:40:47.092 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T20:40:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T20:40:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:: No such file or directory 2024-04-26T20:40:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.log 2024-04-26T20:40:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T20:40:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.g.log 2024-04-26T20:40:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.j.log 2024-04-26T20:40:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-26T20:40:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.g.log: /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-26T20:40:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mgr.x.log 2024-04-26T20:40:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mon.a.log 2024-04-26T20:40:47.118 INFO:teuthology.orchestra.run.smithi070.stderr: 87.3% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T20:40:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.6.log 2024-04-26T20:40:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mon.a.log: 90.3% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T20:40:47.130 INFO:teuthology.orchestra.run.smithi070.stderr: 94.7% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.j.log.gz 2024-04-26T20:40:47.130 INFO:teuthology.orchestra.run.smithi070.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T20:40:47.130 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T20:40:47.130 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.a.log 2024-04-26T20:40:47.130 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T20:40:47.130 INFO:teuthology.orchestra.run.smithi070.stderr: 84.2% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T20:40:47.133 INFO:teuthology.orchestra.run.smithi080.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log: No such file or directory 2024-04-26T20:40:47.133 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-26T20:40:47.133 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.log 2024-04-26T20:40:47.133 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T20:40:47.133 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.7.log 2024-04-26T20:40:47.133 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.b.log 2024-04-26T20:40:47.133 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-26T20:40:47.133 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.7.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T20:40:47.133 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mgr.y.log 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.h.log 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi080.stderr: 87.4% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.log.gz/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mgr.y.log: 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.10.log 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.10.log: 90.5% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.e.log 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.cephadm.log: 83.9% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.e.log: 91.8% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mgr.y.log.gz 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mon.b.log 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi098.stderr:: No such file or directory 2024-04-26T20:40:47.134 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.log 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.f.log 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.f.log: /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.c.log 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.5.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mon.c.log 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mgr.z.log 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.i.log 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.i.log: 90.5% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.11.log 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.cephadm.log: 83.9% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T20:40:47.135 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.8.log 2024-04-26T20:40:47.136 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.11.log: 91.9% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mgr.z.log.gz 2024-04-26T20:40:47.136 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T20:40:47.137 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.l.log 2024-04-26T20:40:47.139 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.d.log 2024-04-26T20:40:47.142 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T20:40:47.143 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.k.log 2024-04-26T20:40:47.153 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-volume.log: 91.1% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T20:40:47.158 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.9.log 2024-04-26T20:40:47.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.d.log.gz 2024-04-26T20:40:47.176 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.9.log: 94.3% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.g.log.gz 2024-04-26T20:40:47.176 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T20:40:47.278 INFO:teuthology.orchestra.run.smithi098.stderr: 93.5% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.f.log.gz 2024-04-26T20:40:47.299 INFO:teuthology.orchestra.run.smithi070.stderr: 94.8% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.a.log.gz 2024-04-26T20:40:47.470 INFO:teuthology.orchestra.run.smithi070.stderr: 90.2% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mgr.x.log.gz 2024-04-26T20:40:47.498 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mon.b.log: /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.k.log: 95.4% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.k.log.gz 2024-04-26T20:40:47.550 INFO:teuthology.orchestra.run.smithi080.stderr: 92.1% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mon.b.log.gz 2024-04-26T20:40:47.601 INFO:teuthology.orchestra.run.smithi098.stderr: 92.0% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mon.c.log.gz 2024-04-26T20:40:47.975 INFO:teuthology.orchestra.run.smithi098.stderr: 95.2% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.l.log.gz 2024-04-26T20:40:47.995 INFO:teuthology.orchestra.run.smithi070.stderr: 90.5% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mon.a.log.gz 2024-04-26T20:40:48.376 INFO:teuthology.orchestra.run.smithi080.stderr: 93.8% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.h.log.gz 2024-04-26T20:40:49.713 INFO:teuthology.orchestra.run.smithi098.stderr: 93.8% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.c.log.gz 2024-04-26T20:40:49.773 INFO:teuthology.orchestra.run.smithi070.stderr: 92.3% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.9.log.gz 2024-04-26T20:40:50.176 INFO:teuthology.orchestra.run.smithi070.stderr: 91.6% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-26T20:40:50.186 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-26T20:40:50.223 INFO:teuthology.orchestra.run.smithi098.stderr: 91.6% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-26T20:40:50.348 INFO:teuthology.orchestra.run.smithi098.stderr: 92.0% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.11.log.gz 2024-04-26T20:40:50.368 INFO:teuthology.orchestra.run.smithi080.stderr: 91.6% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-26T20:40:50.526 INFO:teuthology.orchestra.run.smithi080.stderr: 92.2% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-26T20:40:50.608 INFO:teuthology.orchestra.run.smithi080.stderr: 92.1% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.10.log.gz 2024-04-26T20:40:50.639 INFO:teuthology.orchestra.run.smithi070.stderr: 91.9% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.6.log.gz 2024-04-26T20:40:50.641 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-04-26T20:40:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m3.538s 2024-04-26T20:40:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m13.314s 2024-04-26T20:40:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.451s 2024-04-26T20:40:50.689 INFO:teuthology.orchestra.run.smithi080.stderr: 95.4% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.e.log.gz 2024-04-26T20:40:50.727 INFO:teuthology.orchestra.run.smithi098.stderr: 91.7% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.8.log.gz 2024-04-26T20:40:51.267 INFO:teuthology.orchestra.run.smithi098.stderr: 92.0% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-26T20:40:51.644 INFO:teuthology.orchestra.run.smithi080.stderr: 91.9% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-osd.7.log.gz 2024-04-26T20:40:53.729 INFO:teuthology.orchestra.run.smithi098.stderr: 93.1% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.i.log.gz 2024-04-26T20:40:53.731 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-04-26T20:40:53.731 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m6.625s 2024-04-26T20:40:53.731 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m23.982s 2024-04-26T20:40:53.731 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.646s 2024-04-26T20:41:18.019 INFO:teuthology.orchestra.run.smithi080.stderr: 93.0% -- replaced with /var/log/ceph/cc0136ee-0409-11ef-bc93-c7b262605968/ceph-mds.b.log.gz 2024-04-26T20:41:18.021 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-26T20:41:18.021 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m30.915s 2024-04-26T20:41:18.021 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m49.205s 2024-04-26T20:41:18.021 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m1.495s 2024-04-26T20:41:18.021 INFO:tasks.cephadm:Archiving logs... 2024-04-26T20:41:18.022 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158/remote/smithi070/log 2024-04-26T20:41:18.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T20:41:20.091 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158/remote/smithi080/log 2024-04-26T20:41:20.092 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T20:41:26.629 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158/remote/smithi098/log 2024-04-26T20:41:26.630 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T20:41:29.813 INFO:tasks.cephadm:Removing cluster... 2024-04-26T20:41:29.814 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cc0136ee-0409-11ef-bc93-c7b262605968 --force 2024-04-26T20:41:30.003 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:41:30.296 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cc0136ee-0409-11ef-bc93-c7b262605968 --force 2024-04-26T20:41:30.482 INFO:teuthology.orchestra.run.smithi080.stdout:Deleting cluster with fsid: cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:41:30.791 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cc0136ee-0409-11ef-bc93-c7b262605968 --force 2024-04-26T20:41:30.980 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: cc0136ee-0409-11ef-bc93-c7b262605968 2024-04-26T20:41:31.257 INFO:tasks.cephadm:Removing cephadm ... 2024-04-26T20:41:31.257 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T20:41:31.275 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T20:41:31.291 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T20:41:31.306 INFO:tasks.cephadm:Teardown complete 2024-04-26T20:41:31.307 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T20:41:31.319 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T20:41:31.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T20:41:31.322 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T20:41:31.333 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T20:41:31.437 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T20:41:31.447 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T20:41:31.448 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:41:31.451 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:41:31.453 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:41:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:41:31.465 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:41:31.467 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:41:31.469 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:41:31.469 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-26T20:41:31.469 INFO:teuthology.orchestra.run.smithi080.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 +1582us[+1566us] +/- 67ms 2024-04-26T20:41:31.469 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -764us[ -764us] +/- 53ms 2024-04-26T20:41:31.469 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 -612us[ -627us] +/- 65ms 2024-04-26T20:41:31.469 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:41:31.470 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:41:31.470 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-04-26T20:41:31.470 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +1591us[+1533us] +/- 67ms 2024-04-26T20:41:31.471 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -753us[ -811us] +/- 53ms 2024-04-26T20:41:31.471 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -646us[ -646us] +/- 65ms 2024-04-26T20:41:31.471 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:41:31.472 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:41:31.472 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-04-26T20:41:31.472 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 +1591us[+1544us] +/- 67ms 2024-04-26T20:41:31.472 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -741us[ -741us] +/- 53ms 2024-04-26T20:41:31.472 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -625us[ -625us] +/- 65ms 2024-04-26T20:41:31.472 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:41:31.472 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T20:41:31.483 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T20:41:31.483 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T20:41:31.494 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T20:41:31.587 DEBUG:teuthology.orchestra.run.smithi080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T20:41:31.651 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T20:41:31.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:41:31.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:41:31.744 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:41:31.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:41:31.770 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:41:31.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:41:31.798 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T20:41:31.808 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T20:41:31.818 INFO:teuthology.task.internal:Duration was 1906.415333 seconds 2024-04-26T20:41:31.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T20:41:31.828 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T20:41:31.828 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T20:41:31.831 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T20:41:31.833 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T20:41:31.867 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:41:31.869 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:41:31.873 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:41:32.259 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T20:41:32.259 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T20:41:32.259 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T20:41:32.282 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T20:41:32.282 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T20:41:32.327 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-04-26T20:41:32.327 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T20:41:32.361 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T20:41:32.361 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T20:41:32.363 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T20:41:32.370 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T20:41:32.425 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T20:41:32.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T20:41:32.431 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T20:41:32.436 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T20:41:32.816 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T20:41:32.829 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T20:41:32.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T20:41:32.852 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T20:41:32.877 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T20:41:32.900 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T20:41:32.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:41:32.913 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:41:32.918 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:41:32.933 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-04-26T20:41:32.938 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-04-26T20:41:32.962 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-04-26T20:41:33.004 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:41:33.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:41:33.019 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:41:33.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:41:33.033 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:41:33.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:41:33.059 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T20:41:33.069 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T20:41:33.070 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158/remote/smithi070 2024-04-26T20:41:33.070 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T20:41:33.110 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158/remote/smithi080 2024-04-26T20:41:33.110 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T20:41:33.144 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675158/remote/smithi098 2024-04-26T20:41:33.144 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T20:41:33.179 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T20:41:33.179 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T20:41:33.181 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T20:41:33.184 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T20:41:33.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T20:41:33.239 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T20:41:33.239 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T20:41:33.285 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T20:41:33.286 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T20:41:33.288 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T20:41:33.291 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T20:41:33.300 INFO:teuthology.orchestra.run.smithi070.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 20:41 /home/ubuntu/cephtest 2024-04-26T20:41:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 20:41 /home/ubuntu/cephtest 2024-04-26T20:41:33.306 INFO:teuthology.orchestra.run.smithi098.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 20:41 /home/ubuntu/cephtest 2024-04-26T20:41:33.307 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T20:41:33.323 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T20:41:33.389 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/norstats}} duration: 1906.4153332710266 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-04-26T20:41:33.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T20:41:33.504 INFO:teuthology.run:pass